Started working on galaxy PGC3290016 at Sun Jun 7 12:33:52 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 176.59813350000002 -1.8364473999999997 --width 297 --height 297 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/PGC3290016-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/PGC3290016-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T12:33:54.774005 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '176.59813350000002', '-1.8364473999999997', '--width', '297', '--height', '297', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/PGC3290016-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/PGC3290016-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 176.59813350000002 -1.8364473999999997 --width 297 --height 297 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/PGC3290016-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/PGC3290016-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 176.59813350000002 -1.8364473999999997 Starting process 33738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 33739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 33740 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 33741 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T12:33:58.073851 Keeping 11 CCDs: c4d_170302_053615_ooi_r_ls9.fits.fz c4d_170302_053615_ooi_r_ls9-N18 r exptime 41.0 propid 2014B-0404 seeing 0.90 MJD 57814.232 object DECaLS_7019_r c4d_170303_061137_ooi_g_ls9.fits.fz c4d_170303_061137_ooi_g_ls9-N18 g exptime 113.0 propid 2014B-0404 seeing 1.03 MJD 57815.256 object DECaLS_7019_g c4d_190102_082647_ooi_z_ls9.fits.fz c4d_190102_082647_ooi_z_ls9-N18 z exptime 91.0 propid 2014B-0404 seeing 0.70 MJD 58485.352 object DECaLS_7019_z c4d_150330_004412_ooi_z_ls9.fits.fz c4d_150330_004412_ooi_z_ls9-N18 z exptime 69.0 propid 2014B-0404 seeing 0.90 MJD 57111.029 object DECaLS_7019_z c4d_160302_060013_ooi_z_ls9.fits.fz c4d_160302_060013_ooi_z_ls9-N17 z exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 57449.249 object DECaLS_22891_z c4d_160409_030454_ooi_g_ls9.fits.fz c4d_160409_030454_ooi_g_ls9-N17 g exptime 76.0 propid 2014B-0404 seeing 1.46 MJD 57487.127 object DECaLS_22891_g c4d_160408_033229_ooi_r_ls9.fits.fz c4d_160408_033229_ooi_r_ls9-N17 r exptime 68.0 propid 2014B-0404 seeing 1.24 MJD 57486.146 object DECaLS_22891_r c4d_180314_065538_ooi_g_ls9.fits.fz c4d_180314_065538_ooi_g_ls9-N10 g exptime 125.0 propid 2014B-0404 seeing 1.12 MJD 58191.289 object DECaLS_38763_g c4d_150328_042334_ooi_z_ls9.fits.fz c4d_150328_042334_ooi_z_ls9-N10 z exptime 195.0 propid 2014B-0404 seeing 1.79 MJD 57109.180 object DECaLS_38763_z c4d_170401_033528_ooi_r_ls9.fits.fz c4d_170401_033528_ooi_r_ls9-N10 r exptime 125.0 propid 2014B-0404 seeing 1.80 MJD 57844.148 object DECaLS_38763_r c4d_180516_232355_ooi_r_ls9.fits.fz c4d_180516_232355_ooi_r_ls9-N10 r exptime 40.0 propid 2014B-0404 seeing 0.87 MJD 58254.975 object DECaLS_38763_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957d412-z-20150330T004211_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95340ea-z-20190102T082647_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T053443_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ee1d-g-20170303T060854_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954dee2-z-20160302T055804_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956f863-r-20160408T033032_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d2d9-g-20180314T065538_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95800b4-z-20150328T041929_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180516T232355_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9516c11-r-20170401T033233_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T030247_oi[N17,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 109.45 s, CPU: 4.90 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 178 MB, VmData: 211 MB, maxrss: 0.455896 MB Stage tims finished: 2020-06-07T12:35:47.528737 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957d412-z-20150330T004211_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954dee2-z-20160302T055804_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95800b4-z-20150328T041929_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T053443_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956f863-r-20160408T033032_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180516T232355_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ee1d-g-20170303T060854_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d2d9-g-20180314T065538_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9516c11-r-20170401T033233_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 4.782 s worker CPU, 294.153 s worker Wall, Wall: 109.456 s, Cores in use: 0.09, Total efficiency (on 4 cores): 2.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/PGC3290016-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/PGC3290016-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95340ea-z-20190102T082647_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T030247_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-07T12:35:48.060820 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06398.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06271.fits Matched 12 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/metrics/cus/reference-custom-176598m01836.fits Stage refs : Wall: 8.71 s, CPU: 8.30 s, VmPeak: 1026 MB, VmSize: 1010 MB, VmRSS: 193 MB, VmData: 226 MB, maxrss: 0.455896 MB Stage refs finished: 2020-06-07T12:35:56.771765 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.712 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T12:35:56.773091 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/metrics/cus/outlier-mask-custom-176598m01836.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/metrics/cus/outliers-pre-custom-176598m01836.jpg Image c4d_160409_030454_ooi_g_ls9-N17 g : masking 62 positive outlier pixels and 0 negative outlier pixels Image c4d_170303_061137_ooi_g_ls9-N18 g : masking 88 positive outlier pixels and 0 negative outlier pixels Image c4d_180516_232355_ooi_r_ls9-N10 r : masking 372 positive outlier pixels and 0 negative outlier pixels Image c4d_160408_033229_ooi_r_ls9-N17 r : masking 0 positive outlier pixels and 304 negative outlier pixels Image c4d_170401_033528_ooi_r_ls9-N10 r : masking 930 positive outlier pixels and 0 negative outlier pixels Image c4d_150328_042334_ooi_z_ls9-N10 z : masking 63 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/metrics/cus/outlier-mask-custom-176598m01836.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/metrics/cus/outliers-post-custom-176598m01836.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/metrics/cus/outliers-masked-pos-custom-176598m01836.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/metrics/cus/outliers-masked-neg-custom-176598m01836.jpg Stage outliers : Wall: 10.50 s, CPU: 9.01 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 211 MB, VmData: 241 MB, maxrss: 0.455896 MB Stage outliers finished: 2020-06-07T12:36:07.274242 Resources for stage outliers : 1.366 s worker CPU, 1.411 s worker Wall, Wall: 10.502 s, Cores in use: 0.99, Total efficiency (on 4 cores): 24.7 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T12:36:07.275747 Stage halos : Wall: 8.30 s, CPU: 5.55 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 211 MB, VmData: 241 MB, maxrss: 0.455896 MB Stage halos finished: 2020-06-07T12:36:15.575807 Resources for stage halos : 0.274 s worker CPU, 10.097 s worker Wall, Wall: 8.301 s, Cores in use: 0.70, Total efficiency (on 4 cores): 17.6 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T12:36:15.577579 PSF sigmas in coadd pixels: ['1.67', '2.37', '1.81'] Using average PSF sigma 1.951184395656847 Gaussian PSF norm 0.1445761827543284 vs pixelized 0.12945932 average tim pixel scale / coadd scale: 1.0010984971522148 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.46', '2.02', '2.92', '1.41'] Using average PSF sigma 1.9526456963023975 Gaussian PSF norm 0.14446798633672425 vs pixelized 0.10045465 average tim pixel scale / coadd scale: 1.0010761694044215 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.13', '1.47', '1.63', '2.90'] Using average PSF sigma 1.7825777683744217 Gaussian PSF norm 0.15825104339269733 vs pixelized 0.119196996 average tim pixel scale / coadd scale: 1.0011078864700367 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.35 s, CPU: 0.23 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.455896 MB Stage fit_on_coadds finished: 2020-06-07T12:36:15.932374 Resources for stage fit_on_coadds : 0.288 s worker CPU, 0.305 s worker Wall, Wall: 0.356 s, Cores in use: 1.45, Total efficiency (on 4 cores): 36.2 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T12:36:15.935124 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 25 potential peaks Of 25 potential peaks: 5 in veto map, 3 cut by saddle test, 0 cut by aper test, 17 kept SED z : 17 new peaks Found 31 potential peaks Of 31 potential peaks: 24 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept SED r : 5 new peaks Found 30 potential peaks Of 30 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 49 potential peaks Of 49 potential peaks: 37 in veto map, 4 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 40 potential peaks Of 40 potential peaks: 37 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 33 new sources Median coadd sky for g : -7.041725e-05 Median coadd sky for r : -6.135591e-05 Median coadd sky for z : 0.00011867183 Stage srcs : Wall: 7.95 s, CPU: 7.90 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.455896 MB Stage srcs finished: 2020-06-07T12:36:23.883011 Resources for stage srcs : 0.127 s worker CPU, 0.139 s worker Wall, Wall: 7.949 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/PGC3290016-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/PGC3290016-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T12:36:23.896339 Blob 1 of 27, id: 7, sources: 3, size: 134x152, npix 8880, brick X: 49,183, Y: 47,199, one pixel: 75 47 Blob 2 of 27, id: 22, sources: 3, size: 69x62, npix 2425, brick X: 210,279, Y: 221,283, one pixel: 251 221 Blob 3 of 27, id: 26, sources: 3, size: 63x45, npix 1681, brick X: 4,67, Y: 252,297, one pixel: 35 252 Blob 4 of 27, id: 12, sources: 1, size: 39x42, npix 1166, brick X: 10,49, Y: 120,162, one pixel: 28 120 Blob 5 of 27, id: 23, sources: 2, size: 31x48, npix 964, brick X: 175,206, Y: 224,272, one pixel: 184 224 Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147088 MB Blob 6 of 27, id: 6, sources: 1, size: 32x32, npix 691, brick X: 220,252, Y: 25,57, one pixel: 233 25 Blob 5 finished, total: Wall: 1.49 s, CPU: 1.49 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147088 MB Blob 7 of 27, id: 2, sources: 2, size: 27x37, npix 690, brick X: 0,27, Y: 3,40, one pixel: 10 3 Blob 3 finished, total: Wall: 3.44 s, CPU: 3.44 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150268 MB Blob 8 of 27, id: 9, sources: 1, size: 27x28, npix 487, brick X: 244,271, Y: 85,113, one pixel: 259 85 Blob 6 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147088 MB Blob 9 of 27, id: 3, sources: 1, size: 27x28, npix 474, brick X: 187,214, Y: 20,48, one pixel: 198 20 Blob 8 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147088 MB Blob 10 of 27, id: 24, sources: 1, size: 28x25, npix 468, brick X: 0,28, Y: 235,260, one pixel: 9 235 Measuring 1 iterative sources Blob 7 finished, total: Wall: 1.58 s, CPU: 1.58 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150268 MB Blob 11 of 27, id: 16, sources: 1, size: 26x26, npix 451, brick X: 37,63, Y: 149,175, one pixel: 47 149 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.50602, ee1=0.454299, ee2=-1.41155 Measuring 5 iterative sources Blob 9 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147088 MB Blob 12 of 27, id: 20, sources: 1, size: 24x25, npix 388, brick X: 182,206, Y: 191,216, one pixel: 193 191 Measuring 1 iterative sources Blob 10 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150268 MB Blob 13 of 27, id: 11, sources: 1, size: 24x24, npix 352, brick X: 254,278, Y: 119,143, one pixel: 264 119 Blob 2 finished, total: Wall: 5.86 s, CPU: 5.86 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150368 MB Blob 14 of 27, id: 8, sources: 1, size: 23x23, npix 299, brick X: 156,179, Y: 79,102, one pixel: 165 79 Blob 11 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147088 MB Blob 15 of 27, id: 1, sources: 1, size: 23x18, npix 288, brick X: 226,249, Y: 0,18, one pixel: 231 0 Blob 12 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150268 MB Blob 16 of 27, id: 0, sources: 1, size: 24x17, npix 283, brick X: 73,97, Y: 0,17, one pixel: 77 0 Blob 13 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150368 MB Blob 17 of 27, id: 5, sources: 1, size: 16x23, npix 261, brick X: 281,297, Y: 24,47, one pixel: 290 24 Blob 14 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147088 MB Blob 18 of 27, id: 17, sources: 1, size: 20x20, npix 228, brick X: 94,114, Y: 159,179, one pixel: 102 159 Blob 15 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150268 MB Blob 19 of 27, id: 25, sources: 1, size: 19x20, npix 218, brick X: 150,169, Y: 248,268, one pixel: 158 248 Blob 18 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150268 MB Blob 20 of 27, id: 15, sources: 1, size: 19x19, npix 208, brick X: 224,243, Y: 147,166, one pixel: 232 147 Blob 19 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150268 MB Blob 21 of 27, id: 14, sources: 1, size: 19x19, npix 199, brick X: 67,86, Y: 142,161, one pixel: 75 142 Blob 16 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150368 MB Blob 22 of 27, id: 10, sources: 1, size: 19x19, npix 198, brick X: 145,164, Y: 98,117, one pixel: 153 98 Blob 17 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147088 MB Blob 23 of 27, id: 18, sources: 1, size: 19x18, npix 198, brick X: 227,246, Y: 171,189, one pixel: 235 171 Blob 22 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147088 MB Blob 24 of 27, id: 4, sources: 1, size: 19x19, npix 190, brick X: 63,82, Y: 24,43, one pixel: 72 24 Blob 21 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150368 MB Blob 25 of 27, id: 13, sources: 1, size: 17x19, npix 187, brick X: 280,297, Y: 121,140, one pixel: 288 121 Blob 20 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150268 MB Blob 26 of 27, id: 19, sources: 1, size: 17x19, npix 179, brick X: 58,75, Y: 184,203, one pixel: 66 184 Blob 24 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150368 MB Blob 27 of 27, id: 21, sources: 1, size: 18x18, npix 162, brick X: 120,138, Y: 194,212, one pixel: 129 194 Blob 26 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150368 MB Blob 27 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150368 MB Blob 23 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147088 MB Blob 25 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150268 MB Blob 1 finished, total: Wall: 9.69 s, CPU: 9.69 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150912 MB Old catalog: 38 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/metrics/cus/blobs-custom-176598m01836.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/metrics/cus/all-models-custom-176598m01836.fits Stage fitblobs : Wall: 17.82 s, CPU: 7.48 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.455896 MB Stage fitblobs finished: 2020-06-07T12:36:41.711896 Resources for stage fitblobs : 35.222 s worker CPU, 35.256 s worker Wall, Wall: 17.817 s, Cores in use: 2.40, Total efficiency (on 4 cores): 59.9 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T12:36:41.713571 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/tmp-legacysurvey-custom-176598m01836-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/tmp-legacysurvey-custom-176598m01836-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/tmp-legacysurvey-custom-176598m01836-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/tmp-legacysurvey-custom-176598m01836-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-resid.jpg Stage coadds : Wall: 11.14 s, CPU: 8.48 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.455896 MB Stage coadds finished: 2020-06-07T12:36:52.851073 Resources for stage coadds : 2.588 s worker CPU, 2.692 s worker Wall, Wall: 11.138 s, Cores in use: 0.99, Total efficiency (on 4 cores): 24.9 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T12:36:52.852465 Cut to 1 unWISE tiles Reading WISE tile 1769m016 band 1 Reading WISE tile 1769m016 band 2 Reading WISE tile 1769m016 band 4 Reading WISE tile 1769m016 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 961 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.2108 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 963 MB, VmSize: 796 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.21088 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 963 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.207076 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/176/1769m016/unwise-1769m016-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 952 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.191804 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/tmp-legacysurvey-custom-176598m01836-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/tmp-legacysurvey-custom-176598m01836-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 19.03 s, CPU: 10.24 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.455896 MB Stage wise_forced finished: 2020-06-07T12:37:11.883242 Resources for stage wise_forced : 3.288 s worker CPU, 14.219 s worker Wall, Wall: 19.032 s, Cores in use: 0.71, Total efficiency (on 4 cores): 17.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T12:37:11.885061 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/coadd/cus/custom-176598m01836/legacysurvey-custom-176598m01836-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/tractor-i/cus/tractor-custom-176598m01836.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/tractor/cus/tractor-custom-176598m01836.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC3290016/tractor/cus/brick-custom-176598m01836.sha256sum Stage writecat : Wall: 9.29 s, CPU: 8.91 s, VmPeak: 1152 MB, VmSize: 1024 MB, VmRSS: 218 MB, VmData: 242 MB, maxrss: 0.455896 MB Stage writecat finished: 2020-06-07T12:37:21.175284 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.291 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 % Stage writecat finished All done: 47.937 s worker CPU, 358.274 s worker Wall, Wall: 203.106 s, Cores in use: 0.59, Total efficiency (on 4 cores): 14.6 % Finished galaxy PGC3290016 in 3.484 minutes.