Started working on galaxy PGC3088881 at Thu Jun 4 19:16:58 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.9301975 32.5193412 --width 315 --height 315 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/PGC3088881-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/PGC3088881-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T19:17:00.386180 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.9301975', '32.5193412', '--width', '315', '--height', '315', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/PGC3088881-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/PGC3088881-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.9301975 32.5193412 --width 315 --height 315 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/PGC3088881-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/PGC3088881-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 167.9301975 32.5193412 Starting process 1491 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 1492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 1493 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 1494 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 1495 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 1496 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 1497 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 1498 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T19:17:03.985846 Keeping 11 CCDs: k4m_170103_112202_ooi_zd_ls9.fits.fz k4m_170103_112202_ooi_zd_ls9-CCD1 z exptime 80.105 propid 2016A-0453 seeing 1.05 MJD 57756.474 object MzLS_566777_z k4m_170512_033710_ooi_zd_ls9.fits.fz k4m_170512_033710_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 1.10 MJD 57885.151 object MzLS_565720_z k4m_170127_102933_ooi_zd_ls9.fits.fz k4m_170127_102933_ooi_zd_ls9-CCD2 z exptime 169.105 propid 2016A-0453 seeing 1.42 MJD 57780.437 object MzLS_564664_z ksb_170203_101847_ooi_r_ls9.fits.fz ksb_170203_101847_ooi_r_ls9-CCD2 r exptime 75.878 propid BASS seeing 1.07 MJD 57787.430 object 04663 ksb_170123_112356_ooi_g_ls9.fits.fz ksb_170123_112356_ooi_g_ls9-CCD2 g exptime 112.8 propid BASS seeing 1.57 MJD 57776.475 object 04663 ksb_170519_052054_ooi_g_ls9.fits.fz ksb_170519_052054_ooi_g_ls9-CCD3 g exptime 123.187 propid 2015A-0801 seeing 1.62 MJD 57892.223 object 03281 ksb_180421_070006_ooi_r_ls9.fits.fz ksb_180421_070006_ooi_r_ls9-CCD3 r exptime 108.3 propid BASS seeing 1.48 MJD 58229.292 object 03281 ksb_180421_065020_ooi_r_ls9.fits.fz ksb_180421_065020_ooi_r_ls9-CCD1 r exptime 111.4 propid BASS seeing 1.71 MJD 58229.285 object 03272 ksb_170330_070251_ooi_g_ls9.fits.fz ksb_170330_070251_ooi_g_ls9-CCD1 g exptime 96.375 propid BASS seeing 1.42 MJD 57842.294 object 03272 ksb_170421_065506_ooi_r_ls9.fits.fz ksb_170421_065506_ooi_r_ls9-CCD4 r exptime 100.341 propid BASS seeing 1.57 MJD 57864.288 object 04661 ksb_170519_051804_ooi_g_ls9.fits.fz ksb_170519_051804_ooi_g_ls9-CCD4 g exptime 132.457 propid 2015A-0801 seeing 1.56 MJD 57892.221 object 04661 mosaic get_fwhm: self.fwhm = 4.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 616 942 and amp range 0 2005 and image y 1143 1469 and amp range 0 2039 Range in image: x 0 327 , y 0 327 (with image size 327 x 327) dzp 0.007397243 -> scaling image by 1.006836374469654 mosaic get_fwhm: self.fwhm = 4.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3354 3672 and amp range 2006 4053 and image y 3232 3556 and amp range 2040 4078 Range in image: x 0 319 , y 0 325 (with image size 319 x 325) dzp -0.0021409686 -> scaling image by 0.9980300379995196 mosaic get_fwhm: self.fwhm = 5.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1775 2095 and amp range 0 2047 and image y 1779 2099 and amp range 0 2039 Range in image: x 0 273 , y 0 261 (with image size 321 x 321) dzp -0.0096683735 -> scaling image by 0.9911346301237048 Found overlap: image x 1775 2095 and amp range 2048 4095 and image y 1779 2099 and amp range 0 2039 Range in image: x 273 321 , y 0 261 (with image size 321 x 321) dzp 0.0044767857 -> scaling image by 1.004131784351374 Found overlap: image x 1775 2095 and amp range 0 2047 and image y 1779 2099 and amp range 2040 4078 Range in image: x 0 273 , y 261 321 (with image size 321 x 321) dzp 0.015739892 -> scaling image by 1.0146025667655956 Found overlap: image x 1775 2095 and amp range 2048 4095 and image y 1779 2099 and amp range 2040 4078 Range in image: x 273 321 , y 261 321 (with image size 321 x 321) dzp -0.032976374 -> scaling image by 0.9700842429001929 Faked up EXPNUM 78920103 Faked up EXPNUM 78920103 Faked up EXPNUM 78920103 90prime get_fwhm: self.fwhm = 3.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 18 76 and amp range 0 2015 and image y 2186 2370 and amp range 2048 4095 Range in image: x 0 59 , y 0 185 (with image size 59 x 185) dzp -0.045992933 -> scaling image by 0.958523636456738 Faked up EXPNUM 82290089 Faked up EXPNUM 82290089 Faked up EXPNUM 82290089 90prime get_fwhm: self.fwhm = 3.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 18 87 and amp range 0 2015 and image y 2168 2352 and amp range 2048 4095 Range in image: x 0 70 , y 0 185 (with image size 70 x 185) dzp -0.038361903 -> scaling image by 0.9652842912941227 Faked up EXPNUM 77760089 Faked up EXPNUM 77760089 Faked up EXPNUM 77760089 90prime get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1653 1836 and amp range 0 2015 and image y 3451 3634 and amp range 2048 4095 Range in image: x 0 184 , y 0 184 (with image size 184 x 184) dzp 0.051889952 -> scaling image by 1.0489528829333021 Faked up EXPNUM 82290085 Faked up EXPNUM 82290085 Faked up EXPNUM 82290085 90prime get_fwhm: self.fwhm = 3.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1827 2013 and amp range 0 2015 and image y 600 785 and amp range 0 2047 Range in image: x 0 187 , y 0 186 (with image size 187 x 186) dzp -0.04811793 -> scaling image by 0.9566494556405901 Faked up EXPNUM 78640116 Faked up EXPNUM 78640116 Faked up EXPNUM 78640116 90prime get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3581 3766 and amp range 2016 4031 and image y 1030 1213 and amp range 0 2047 Range in image: x 0 186 , y 0 184 (with image size 186 x 184) dzp 0.02499258 -> scaling image by 1.0232859986636875 Faked up EXPNUM 78920102 Faked up EXPNUM 78920102 Faked up EXPNUM 78920102 90prime get_fwhm: self.fwhm = 3.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3675 3860 and amp range 2016 4031 and image y 1006 1189 and amp range 0 2047 Range in image: x 0 186 , y 0 184 (with image size 186 x 184) dzp 0.016679538 -> scaling image by 1.0154810312115594 Faked up EXPNUM 78420120 Faked up EXPNUM 78420120 Faked up EXPNUM 78420120 90prime get_fwhm: self.fwhm = 3.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1833 2018 and amp range 0 2015 and image y 609 794 and amp range 0 2047 Range in image: x 0 183 , y 0 186 (with image size 186 x 186) dzp -0.023075538 -> scaling image by 0.9789709052881876 Found overlap: image x 1833 2018 and amp range 2016 4031 and image y 609 794 and amp range 0 2047 Range in image: x 183 186 , y 0 186 (with image size 186 x 186) dzp -0.011406615 -> scaling image by 0.9895491130016149 Faked up EXPNUM 77870160 Faked up EXPNUM 77870160 Faked up EXPNUM 77870160 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1656 1839 and amp range 0 2015 and image y 3457 3640 and amp range 2048 4095 Range in image: x 0 184 , y 0 184 (with image size 184 x 184) dzp 0.05525464 -> scaling image by 1.0522086198429996 Stage tims : Wall: 10.26 s, CPU: 5.08 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.450036 MB Stage tims finished: 2020-06-04T19:17:14.248971 Resources for stage tims : 5.079 s worker CPU, 28.828 s worker Wall, Wall: 10.264 s, Cores in use: 0.99, Total efficiency (on 8 cores): 12.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/PGC3088881-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/PGC3088881-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-04T19:17:14.270505 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02811.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02940.fits Matched 10 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/metrics/cus/reference-custom-167930p32519.fits Stage refs : Wall: 12.46 s, CPU: 5.39 s, VmPeak: 972 MB, VmSize: 951 MB, VmRSS: 183 MB, VmData: 216 MB, maxrss: 0.450036 MB Stage refs finished: 2020-06-04T19:17:26.733186 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.464 s, Cores in use: 0.43, Total efficiency (on 8 cores): 5.4 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T19:17:26.735034 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/metrics/cus/outlier-mask-custom-167930p32519.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/metrics/cus/outliers-pre-custom-167930p32519.jpg Image ksb_170330_070251_ooi_g_ls9-CCD1 g : masking 79 positive outlier pixels and 0 negative outlier pixels Image k4m_170103_112202_ooi_zd_ls9-CCD1 z : masking 0 positive outlier pixels and 178 negative outlier pixels Image k4m_170127_102933_ooi_zd_ls9-CCD2 z : masking 1349 positive outlier pixels and 377 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/metrics/cus/outlier-mask-custom-167930p32519.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/metrics/cus/outliers-post-custom-167930p32519.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/metrics/cus/outliers-masked-pos-custom-167930p32519.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/metrics/cus/outliers-masked-neg-custom-167930p32519.jpg Stage outliers : Wall: 3.10 s, CPU: 2.86 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 204 MB, VmData: 234 MB, maxrss: 0.450036 MB Stage outliers finished: 2020-06-04T19:17:29.836087 Resources for stage outliers : 1.010 s worker CPU, 1.013 s worker Wall, Wall: 3.102 s, Cores in use: 1.25, Total efficiency (on 8 cores): 15.6 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T19:17:29.838186 Stage halos : Wall: 2.24 s, CPU: 2.23 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 204 MB, VmData: 234 MB, maxrss: 0.450036 MB Stage halos finished: 2020-06-04T19:17:32.080238 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.243 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-04T19:17:32.081965 PSF sigmas in coadd pixels: ['2.55', '2.63', '2.30', '2.53'] Using average PSF sigma 2.502753745279248 Gaussian PSF norm 0.11271376271276065 vs pixelized 0.10007131 average tim pixel scale / coadd scale: 1.7298339123620814 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.73', '2.41', '2.78', '2.55'] Using average PSF sigma 2.367013882464786 Gaussian PSF norm 0.11917749780163144 vs pixelized 0.1070908 average tim pixel scale / coadd scale: 1.7301503332058066 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.70', '1.78', '2.31'] Using average PSF sigma 1.9297962393538697 Gaussian PSF norm 0.14617853741301132 vs pixelized 0.122192495 average tim pixel scale / coadd scale: 0.9908927169109459 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.22 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.450036 MB Stage fit_on_coadds finished: 2020-06-04T19:17:32.310408 Resources for stage fit_on_coadds : 0.243 s worker CPU, 0.244 s worker Wall, Wall: 0.230 s, Cores in use: 2.03, Total efficiency (on 8 cores): 25.4 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T19:17:32.313504 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 26 potential peaks Of 26 potential peaks: 6 in veto map, 4 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 38 potential peaks Of 38 potential peaks: 29 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 30 potential peaks Of 30 potential peaks: 21 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 47 potential peaks Of 47 potential peaks: 36 in veto map, 7 cut by saddle test, 1 cut by aper test, 3 kept SED Flat : 3 new peaks Found 46 potential peaks Of 46 potential peaks: 35 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 26 new sources Median coadd sky for g : 0.00023346345 Median coadd sky for r : 0.00028894667 Median coadd sky for z : -4.7275204e-05 Stage srcs : Wall: 2.71 s, CPU: 2.67 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.450036 MB Stage srcs finished: 2020-06-04T19:17:35.020706 Resources for stage srcs : 0.133 s worker CPU, 0.133 s worker Wall, Wall: 2.708 s, Cores in use: 1.03, Total efficiency (on 8 cores): 12.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/PGC3088881-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/PGC3088881-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T19:17:35.033213 Blob 1 of 21, id: 8, sources: 5, size: 227x161, npix 19266, brick X: 20,247, Y: 90,251, one pixel: 172 90 Blob 2 of 21, id: 14, sources: 1, size: 45x42, npix 1204, brick X: 269,314, Y: 242,284, one pixel: 298 242 Blob 3 of 21, id: 3, sources: 2, size: 54x31, npix 1023, brick X: 235,289, Y: 0,31, one pixel: 256 0 Blob 4 of 21, id: 19, sources: 2, size: 51x33, npix 987, brick X: 2,53, Y: 282,315, one pixel: 13 282 Blob 5 of 21, id: 9, sources: 1, size: 38x37, npix 982, brick X: 261,299, Y: 141,178, one pixel: 275 141 Blob 6 of 21, id: 6, sources: 1, size: 35x36, npix 850, brick X: 62,97, Y: 52,88, one pixel: 75 52 Blob 7 of 21, id: 2, sources: 2, size: 50x29, npix 822, brick X: 150,200, Y: 0,29, one pixel: 166 0 Blob 8 of 21, id: 16, sources: 1, size: 34x41, npix 781, brick X: 124,158, Y: 262,303, one pixel: 135 262 Blob 9 of 21, id: 1, sources: 1, size: 32x25, npix 566, brick X: 84,116, Y: 0,25, one pixel: 92 0 Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141228 MB Blob 10 of 21, id: 15, sources: 1, size: 31x28, npix 540, brick X: 13,44, Y: 260,288, one pixel: 27 260 Measuring 1 iterative sources Blob 2 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143116 MB Blob 11 of 21, id: 20, sources: 1, size: 29x27, npix 477, brick X: 157,186, Y: 288,315, one pixel: 170 288 Blob 8 finished, total: Wall: 1.03 s, CPU: 0.84 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.140976 MB Blob 12 of 21, id: 10, sources: 1, size: 25x28, npix 436, brick X: 47,72, Y: 165,193, one pixel: 59 165 Blob 9 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143232 MB Blob 13 of 21, id: 5, sources: 1, size: 24x24, npix 364, brick X: 125,149, Y: 40,64, one pixel: 135 40 Blob 11 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.140976 MB Blob 14 of 21, id: 17, sources: 1, size: 23x24, npix 319, brick X: 166,189, Y: 267,291, one pixel: 175 267 Blob 15 of 21, id: 18, sources: 1, size: 17x27, npix 315, brick X: 298,315, Y: 276,303, one pixel: 310 276 Measuring 1 iterative sources Blob 5 finished, total: Wall: 2.14 s, CPU: 1.95 s, VmPeak: 794 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143084 MB Blob 16 of 21, id: 13, sources: 1, size: 22x22, npix 293, brick X: 2,24, Y: 227,249, one pixel: 11 227 Blob 3 finished, total: Wall: 2.16 s, CPU: 2.16 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14318 MB Blob 17 of 21, id: 12, sources: 1, size: 20x20, npix 220, brick X: 278,298, Y: 218,238, one pixel: 287 218 Blob 12 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143232 MB Blob 18 of 21, id: 0, sources: 1, size: 23x13, npix 205, brick X: 23,46, Y: 0,13, one pixel: 24 0 Measuring 1 iterative sources Blob 13 finished, total: Wall: 0.54 s, CPU: 0.53 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.140976 MB Blob 19 of 21, id: 7, sources: 1, size: 19x19, npix 199, brick X: 264,283, Y: 74,93, one pixel: 272 74 Blob 10 finished, total: Wall: 1.60 s, CPU: 1.60 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1437 MB Blob 20 of 21, id: 4, sources: 1, size: 18x19, npix 198, brick X: 232,250, Y: 33,52, one pixel: 240 33 Blob 17 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.140976 MB Blob 21 of 21, id: 11, sources: 1, size: 18x19, npix 180, brick X: 12,30, Y: 210,229, one pixel: 21 210 Blob 14 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 794 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143792 MB Blob 16 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143232 MB Blob 20 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 794 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143792 MB Blob 21 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143232 MB Blob 18 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1437 MB Blob 4 finished, total: Wall: 2.69 s, CPU: 2.69 s, VmPeak: 794 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14316 MB Blob 15 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14318 MB Blob 19 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143076 MB Blob 7 finished, total: Wall: 2.78 s, CPU: 2.54 s, VmPeak: 793 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142808 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.467268, ee1=-0.169997, ee2=0.162785 Measuring 3 iterative sources Blob 1 finished, total: Wall: 16.99 s, CPU: 16.99 s, VmPeak: 804 MB, VmSize: 716 MB, VmRSS: 150 MB, VmData: 182 MB, maxrss: 0.153516 MB Old catalog: 29 New catalog: 30 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/metrics/cus/blobs-custom-167930p32519.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/metrics/cus/all-models-custom-167930p32519.fits Stage fitblobs : Wall: 20.43 s, CPU: 2.20 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.450036 MB Stage fitblobs finished: 2020-06-04T19:17:55.467742 Resources for stage fitblobs : 35.131 s worker CPU, 35.838 s worker Wall, Wall: 20.436 s, Cores in use: 1.83, Total efficiency (on 8 cores): 22.8 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T19:17:55.470135 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/tmp-legacysurvey-custom-167930p32519-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/tmp-legacysurvey-custom-167930p32519-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/tmp-legacysurvey-custom-167930p32519-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/tmp-legacysurvey-custom-167930p32519-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-resid.jpg Stage coadds : Wall: 5.80 s, CPU: 4.94 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 207 MB, VmData: 234 MB, maxrss: 0.450036 MB Stage coadds finished: 2020-06-04T19:18:01.269490 Resources for stage coadds : 3.464 s worker CPU, 3.629 s worker Wall, Wall: 5.801 s, Cores in use: 1.45, Total efficiency (on 8 cores): 18.1 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T19:18:01.271699 Cut to 1 unWISE tiles Reading WISE tile 1676p318 band 2 Reading WISE tile 1676p318 band 3 Reading WISE tile 1676p318 band 1 Reading WISE tile 1676p318 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 795 MB, VmSize: 795 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.186764 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 794 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207276 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 794 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207324 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 794 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20882 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/tmp-legacysurvey-custom-167930p32519-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/tmp-legacysurvey-custom-167930p32519-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 7.84 s, CPU: 4.19 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 208 MB, VmData: 234 MB, maxrss: 0.450036 MB Stage wise_forced finished: 2020-06-04T19:18:09.110267 Resources for stage wise_forced : 3.924 s worker CPU, 6.685 s worker Wall, Wall: 7.840 s, Cores in use: 1.04, Total efficiency (on 8 cores): 12.9 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T19:18:09.112466 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/coadd/cus/custom-167930p32519/legacysurvey-custom-167930p32519-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/tractor-i/cus/tractor-custom-167930p32519.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/tractor/cus/tractor-custom-167930p32519.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3088881/tractor/cus/brick-custom-167930p32519.sha256sum Stage writecat : Wall: 9.20 s, CPU: 2.83 s, VmPeak: 1093 MB, VmSize: 965 MB, VmRSS: 210 MB, VmData: 234 MB, maxrss: 0.450036 MB Stage writecat finished: 2020-06-04T19:18:18.312332 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.201 s, Cores in use: 0.31, Total efficiency (on 8 cores): 3.8 % Stage writecat finished All done: 48.988 s worker CPU, 76.375 s worker Wall, Wall: 74.408 s, Cores in use: 1.10, Total efficiency (on 8 cores): 13.7 % Finished galaxy PGC3088881 in 1.331 minutes.