Started working on galaxy PGC1408164 at Thu Jun 4 10:02:32 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.299239 12.3626107 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/PGC1408164-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/PGC1408164-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T10:02:33.718514 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.299239', '12.3626107', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/PGC1408164-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/PGC1408164-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.299239 12.3626107 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/PGC1408164-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/PGC1408164-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 167.299239 12.3626107 Starting process 26826 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB Starting process 26827 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057404 MB Starting process 26828 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057472 MB Starting process 26829 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057408 MB Starting process 26830 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057416 MB Starting process 26831 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05742 MB Starting process 26832 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05742 MB Starting process 26833 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05742 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T10:02:37.493214 Keeping 14 CCDs: c4d_170110_061543_ooi_z_ls9.fits.fz c4d_170110_061543_ooi_z_ls9-N27 z exptime 110.0 propid 2014B-0404 seeing 1.21 MJD 57763.259 object DECaLS_19224_z c4d_180212_060351_ooi_r_ls9.fits.fz c4d_180212_060351_ooi_r_ls9-N27 r exptime 92.0 propid 2014B-0404 seeing 1.45 MJD 58161.253 object DECaLS_19224_r c4d_180128_072106_ooi_g_ls9.fits.fz c4d_180128_072106_ooi_g_ls9-N27 g exptime 154.0 propid 2014B-0404 seeing 1.08 MJD 58146.306 object DECaLS_19224_g c4d_160117_081507_ooi_g_ls9.fits.fz c4d_160117_081507_ooi_g_ls9-S25 g exptime 65.0 propid 2014B-0404 seeing 1.43 MJD 57404.342 object DECaLS_3374_g c4d_160117_081329_ooi_r_ls9.fits.fz c4d_160117_081329_ooi_r_ls9-S25 r exptime 40.0 propid 2014B-0404 seeing 1.13 MJD 57404.342 object DECaLS_3374_r c4d_190306_051857_ooi_g_ls9.fits.fz c4d_190306_051857_ooi_g_ls9-S25 g exptime 81.0 propid 2014B-0404 seeing 1.30 MJD 58548.221 object DECaLS_3374_g c4d_160110_083003_ooi_z_ls9.fits.fz c4d_160110_083003_ooi_z_ls9-S25 z exptime 87.0 propid 2014B-0404 seeing 1.08 MJD 57397.353 object DECaLS_3374_z c4d_160114_082417_ooi_g_ls9.fits.fz c4d_160114_082417_ooi_g_ls9-N28 g exptime 62.0 propid 2014B-0404 seeing 1.07 MJD 57401.349 object DECaLS_3352_g c4d_160110_083551_ooi_z_ls9.fits.fz c4d_160110_083551_ooi_z_ls9-N28 z exptime 86.0 propid 2014B-0404 seeing 1.01 MJD 57397.357 object DECaLS_3352_z c4d_190206_063111_ooi_g_ls9.fits.fz c4d_190206_063111_ooi_g_ls9-N28 g exptime 152.0 propid 2014B-0404 seeing 1.71 MJD 58520.272 object DECaLS_3352_g c4d_160114_082528_ooi_r_ls9.fits.fz c4d_160114_082528_ooi_r_ls9-N28 r exptime 40.0 propid 2014B-0404 seeing 0.99 MJD 57401.350 object DECaLS_3352_r c4d_180317_044325_ooi_r_ls9.fits.fz c4d_180317_044325_ooi_r_ls9-N22 r exptime 52.0 propid 2014B-0404 seeing 1.24 MJD 58194.197 object DECaLS_35096_r c4d_180317_044035_ooi_g_ls9.fits.fz c4d_180317_044035_ooi_g_ls9-N22 g exptime 142.0 propid 2014B-0404 seeing 1.39 MJD 58194.195 object DECaLS_35096_g c4d_170317_040816_ooi_z_ls9.fits.fz c4d_170317_040816_ooi_z_ls9-N22 z exptime 105.0 propid 2014B-0404 seeing 1.02 MJD 57829.171 object DECaLS_35096_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95710b9-g-20160114T082225_oi[N28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953d2b6-z-20170110T061302_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952a3cf-r-20180212T060351_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9553d83-z-20160110T082744_oi[S25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e86d-g-20160117T081308_oi[S25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a3c6-g-20190306T051857_oi[S25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9553d83-z-20160110T083333_oi[N28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539fed-g-20190206T063111_oi[N28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9576b40-r-20160114T082356_oi[N28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952dda8-g-20180317T044035_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da1d-r-20180317T044325_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9571eaa-r-20160117T081200_oi[S25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950fef3-z-20170317T040541_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95297f5-g-20180128T072106_oi[N27,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 73.04 s, CPU: 3.07 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 177 MB, VmData: 211 MB, maxrss: 0.448748 MB Stage tims finished: 2020-06-04T10:03:50.532596 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95710b9-g-20160114T082225_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9553d83-z-20160110T083333_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953d2b6-z-20170110T061302_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539fed-g-20190206T063111_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952a3cf-r-20180212T060351_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9576b40-r-20160114T082356_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e86d-g-20160117T081308_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952dda8-g-20180317T044035_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9553d83-z-20160110T082744_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da1d-r-20180317T044325_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9571eaa-r-20160117T081200_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95297f5-g-20180128T072106_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a3c6-g-20190306T051857_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950fef3-z-20170317T040541_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 6.515 s worker CPU, 293.736 s worker Wall, Wall: 73.041 s, Cores in use: 0.13, Total efficiency (on 8 cores): 1.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/PGC1408164-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/PGC1408164-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-04T10:03:50.561560 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04859.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04731.fits Matched 7 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/metrics/cus/reference-custom-167299p12362.fits Stage refs : Wall: 7.13 s, CPU: 4.58 s, VmPeak: 1027 MB, VmSize: 1008 MB, VmRSS: 190 MB, VmData: 222 MB, maxrss: 0.448748 MB Stage refs finished: 2020-06-04T10:03:57.692401 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.132 s, Cores in use: 0.64, Total efficiency (on 8 cores): 8.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T10:03:57.694152 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/metrics/cus/outlier-mask-custom-167299p12362.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/metrics/cus/outliers-pre-custom-167299p12362.jpg Image c4d_190306_051857_ooi_g_ls9-S25 g : masking 398 positive outlier pixels and 0 negative outlier pixels Image c4d_160114_082417_ooi_g_ls9-N28 g : masking 457 positive outlier pixels and 0 negative outlier pixels Image c4d_190206_063111_ooi_g_ls9-N28 g : masking 2431 positive outlier pixels and 0 negative outlier pixels Image c4d_180317_044035_ooi_g_ls9-N22 g : masking 0 positive outlier pixels and 246 negative outlier pixels Image c4d_180212_060351_ooi_r_ls9-N27 r : masking 131 positive outlier pixels and 138 negative outlier pixels Image c4d_180317_044325_ooi_r_ls9-N22 r : masking 269 positive outlier pixels and 0 negative outlier pixels Image c4d_170110_061543_ooi_z_ls9-N27 z : masking 3751 positive outlier pixels and 0 negative outlier pixels Image c4d_160110_083551_ooi_z_ls9-N28 z : masking 0 positive outlier pixels and 266 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/metrics/cus/outlier-mask-custom-167299p12362.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/metrics/cus/outliers-post-custom-167299p12362.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/metrics/cus/outliers-masked-pos-custom-167299p12362.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/metrics/cus/outliers-masked-neg-custom-167299p12362.jpg Stage outliers : Wall: 4.38 s, CPU: 4.16 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.448748 MB Stage outliers finished: 2020-06-04T10:04:02.071664 Resources for stage outliers : 1.128 s worker CPU, 1.131 s worker Wall, Wall: 4.379 s, Cores in use: 1.21, Total efficiency (on 8 cores): 15.1 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T10:04:02.073883 Stage halos : Wall: 7.07 s, CPU: 5.38 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.448748 MB Stage halos finished: 2020-06-04T10:04:09.146129 Resources for stage halos : 0.523 s worker CPU, 11.927 s worker Wall, Wall: 7.074 s, Cores in use: 0.83, Total efficiency (on 8 cores): 10.4 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-04T10:04:09.148527 PSF sigmas in coadd pixels: ['1.75', '2.32', '2.11', '1.73', '2.77', '2.26'] Using average PSF sigma 2.159832125621327 Gaussian PSF norm 0.13060959156384755 vs pixelized 0.10793895 average tim pixel scale / coadd scale: 1.0011662135455217 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.35', '1.83', '1.60', '2.02'] Using average PSF sigma 1.9511036229985803 Gaussian PSF norm 0.1445821679836445 vs pixelized 0.11706178 average tim pixel scale / coadd scale: 1.0011947897301972 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.96', '1.75', '1.64', '1.65'] Using average PSF sigma 1.7491709624616245 Gaussian PSF norm 0.16127342485544324 vs pixelized 0.15200593 average tim pixel scale / coadd scale: 1.0011645972831815 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.20 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.448748 MB Stage fit_on_coadds finished: 2020-06-04T10:04:09.384663 Resources for stage fit_on_coadds : 0.297 s worker CPU, 0.298 s worker Wall, Wall: 0.237 s, Cores in use: 2.09, Total efficiency (on 8 cores): 26.2 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T10:04:09.387960 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 18 potential peaks Of 18 potential peaks: 4 in veto map, 2 cut by saddle test, 0 cut by aper test, 12 kept SED z : 12 new peaks Found 12 potential peaks Of 12 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 19 potential peaks Of 19 potential peaks: 10 in veto map, 2 cut by saddle test, 0 cut by aper test, 7 kept SED g : 7 new peaks Found 32 potential peaks Of 32 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 34 potential peaks Of 34 potential peaks: 29 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 25 new sources Median coadd sky for g : 3.059686e-05 Median coadd sky for r : -2.0562752e-06 Median coadd sky for z : 0.0005176211 Stage srcs : Wall: 3.81 s, CPU: 3.77 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.448748 MB Stage srcs finished: 2020-06-04T10:04:13.193469 Resources for stage srcs : 0.061 s worker CPU, 0.061 s worker Wall, Wall: 3.806 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/PGC1408164-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/PGC1408164-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T10:04:13.234468 Blob 1 of 19, id: 6, sources: 3, size: 78x139, npix 6553, brick X: 73,151, Y: 50,189, one pixel: 84 50 Blob 2 of 19, id: 10, sources: 4, size: 52x100, npix 3053, brick X: 0,52, Y: 81,181, one pixel: 21 81 Blob 3 of 19, id: 11, sources: 2, size: 50x58, npix 1635, brick X: 163,213, Y: 131,189, one pixel: 171 131 Blob 4 of 19, id: 15, sources: 2, size: 52x39, npix 1260, brick X: 107,159, Y: 186,225, one pixel: 144 186 Blob 5 of 19, id: 0, sources: 3, size: 66x33, npix 1118, brick X: 0,66, Y: 0,33, one pixel: 3 0 Blob 6 of 19, id: 7, sources: 1, size: 27x34, npix 571, brick X: 151,178, Y: 51,85, one pixel: 160 51 Blob 7 of 19, id: 3, sources: 1, size: 23x31, npix 537, brick X: 210,233, Y: 17,48, one pixel: 223 17 Blob 8 of 19, id: 9, sources: 1, size: 27x29, npix 469, brick X: 50,77, Y: 78,107, one pixel: 59 78 Blob 9 of 19, id: 2, sources: 1, size: 23x23, npix 316, brick X: 186,209, Y: 11,34, one pixel: 196 11 Blob 5 finished, total: Wall: 1.27 s, CPU: 1.22 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146748 MB Blob 10 of 19, id: 4, sources: 1, size: 23x22, npix 306, brick X: 142,165, Y: 18,40, one pixel: 152 18 Blob 8 finished, total: Wall: 1.33 s, CPU: 1.33 s, VmPeak: 926 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147936 MB Blob 11 of 19, id: 5, sources: 1, size: 22x21, npix 304, brick X: 0,22, Y: 30,51, one pixel: 8 30 Blob 4 finished, total: Wall: 1.42 s, CPU: 1.42 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146396 MB Blob 12 of 19, id: 17, sources: 1, size: 21x21, npix 259, brick X: 169,190, Y: 209,230, one pixel: 178 209 Blob 9 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146748 MB Blob 13 of 19, id: 16, sources: 1, size: 21x20, npix 257, brick X: 74,95, Y: 194,214, one pixel: 83 194 Blob 2 finished, total: Wall: 1.73 s, CPU: 1.73 s, VmPeak: 931 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14814 MB Blob 14 of 19, id: 14, sources: 1, size: 21x21, npix 250, brick X: 27,48, Y: 179,200, one pixel: 36 179 Blob 11 finished, total: Wall: 0.30 s, CPU: 0.29 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146396 MB Blob 15 of 19, id: 1, sources: 1, size: 21x20, npix 248, brick X: 134,155, Y: 1,21, one pixel: 143 1 Measuring 3 iterative sources Blob 12 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146748 MB Blob 16 of 19, id: 12, sources: 1, size: 15x22, npix 223, brick X: 218,233, Y: 153,175, one pixel: 227 153 Blob 7 finished, total: Wall: 2.01 s, CPU: 1.97 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148792 MB Blob 10 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 926 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147936 MB Blob 17 of 19, id: 8, sources: 1, size: 17x20, npix 203, brick X: 0,17, Y: 69,89, one pixel: 7 69 Blob 18 of 19, id: 18, sources: 1, size: 19x19, npix 199, brick X: 36,55, Y: 212,231, one pixel: 44 212 Blob 17 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148792 MB Blob 19 of 19, id: 13, sources: 1, size: 18x19, npix 189, brick X: 6,24, Y: 179,198, one pixel: 14 179 Blob 18 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148792 MB Blob 15 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146748 MB Blob 19 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148792 MB Blob 6 finished, total: Wall: 2.51 s, CPU: 2.51 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148476 MB Blob 13 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 931 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148204 MB Blob 14 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146396 MB Blob 16 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 926 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147936 MB Blob 3 finished, total: Wall: 2.89 s, CPU: 2.89 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146636 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.650768, ee1=0.610762, ee2=-0.336242 Blob 1 finished, total: Wall: 6.15 s, CPU: 6.14 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15082 MB Old catalog: 30 New catalog: 24 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/metrics/cus/blobs-custom-167299p12362.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/metrics/cus/all-models-custom-167299p12362.fits Stage fitblobs : Wall: 9.53 s, CPU: 3.42 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.448748 MB Stage fitblobs finished: 2020-06-04T10:04:22.761781 Resources for stage fitblobs : 24.081 s worker CPU, 24.258 s worker Wall, Wall: 9.529 s, Cores in use: 2.89, Total efficiency (on 8 cores): 36.1 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T10:04:22.763795 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/tmp-legacysurvey-custom-167299p12362-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/tmp-legacysurvey-custom-167299p12362-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/tmp-legacysurvey-custom-167299p12362-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/tmp-legacysurvey-custom-167299p12362-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-resid.jpg Stage coadds : Wall: 6.28 s, CPU: 5.63 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 209 MB, VmData: 236 MB, maxrss: 0.448748 MB Stage coadds finished: 2020-06-04T10:04:29.042976 Resources for stage coadds : 3.768 s worker CPU, 4.023 s worker Wall, Wall: 6.280 s, Cores in use: 1.50, Total efficiency (on 8 cores): 18.7 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T10:04:29.044616 Cut to 1 unWISE tiles Reading WISE tile 1668p121 band 2 Reading WISE tile 1668p121 band 3 Reading WISE tile 1668p121 band 1 Reading WISE tile 1668p121 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 957 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.18864 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 791 MB, VmRSS: 143 MB, VmData: 170 MB, maxrss: 0.204428 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.204312 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p121/unwise-1668p121-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 961 MB, VmSize: 791 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206276 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/tmp-legacysurvey-custom-167299p12362-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/tmp-legacysurvey-custom-167299p12362-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 8.56 s, CPU: 4.56 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 209 MB, VmData: 236 MB, maxrss: 0.448748 MB Stage wise_forced finished: 2020-06-04T10:04:37.600985 Resources for stage wise_forced : 3.088 s worker CPU, 7.564 s worker Wall, Wall: 8.558 s, Cores in use: 0.89, Total efficiency (on 8 cores): 11.2 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T10:04:37.602941 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/coadd/cus/custom-167299p12362/legacysurvey-custom-167299p12362-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/tractor-i/cus/tractor-custom-167299p12362.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/tractor/cus/tractor-custom-167299p12362.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1408164/tractor/cus/brick-custom-167299p12362.sha256sum Stage writecat : Wall: 4.84 s, CPU: 4.66 s, VmPeak: 1149 MB, VmSize: 1021 MB, VmRSS: 211 MB, VmData: 236 MB, maxrss: 0.448748 MB Stage writecat finished: 2020-06-04T10:04:42.444981 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.843 s, Cores in use: 0.96, Total efficiency (on 8 cores): 12.0 % Stage writecat finished All done: 39.463 s worker CPU, 343.001 s worker Wall, Wall: 124.962 s, Cores in use: 0.63, Total efficiency (on 8 cores): 7.9 % Finished galaxy PGC1408164 in 2.173 minutes.