Started working on galaxy PGC2314821 at Mon Jun 15 07:41:32 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.161875 48.3148333 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-15T07:41:33.159893 legacypipe git version: DR9.5.2-29-gb5a6d7b1 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.161875', '48.3148333', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.161875 48.3148333 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.161875 48.3148333 Starting process 36392 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 36393 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 36394 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 36395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 36396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Starting process 36397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057336 MB Starting process 36398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057336 MB Starting process 36399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057336 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-15T07:41:34.005594 Keeping 10 CCDs: k4m_160518_095133_ooi_zd_ls9.fits.fz k4m_160518_095133_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 1.14 MJD 57526.411 object MzLS_641267_z k4m_160524_091638_ooi_zd_ls9.fits.fz k4m_160524_091638_ooi_zd_ls9-CCD3 z exptime 84.104 propid 2016A-0453 seeing 0.96 MJD 57532.387 object MzLS_643775_z k4m_160516_100502_ooi_zd_ls9.fits.fz k4m_160516_100502_ooi_zd_ls9-CCD1 z exptime 80.103 propid 2016A-0453 seeing 1.15 MJD 57524.420 object MzLS_642942_z k4m_170531_111320_ooi_zd_ls9.fits.fz k4m_170531_111320_ooi_zd_ls9-CCD4 z exptime 250.105 propid 2016A-0453 seeing 1.50 MJD 57904.468 object MzLS_642106_z ksb_170527_091338_ooi_g_ls9.fits.fz ksb_170527_091338_ooi_g_ls9-CCD1 g exptime 99.9 propid 2015A-0801 seeing 1.14 MJD 57900.384 object 24841 ksb_160611_095822_ooi_r_ls9.fits.fz ksb_160611_095822_ooi_r_ls9-CCD1 r exptime 59.5 propid BASS seeing 1.12 MJD 57550.416 object 24841 ksb_180518_102810_ooi_r_ls9.fits.fz ksb_180518_102810_ooi_r_ls9-CCD2 r exptime 87.08 propid NOTBASS seeing 1.16 MJD 58256.436 object 26023 ksb_170619_054514_ooi_g_ls9.fits.fz ksb_170619_054514_ooi_g_ls9-CCD2 g exptime 209.283 propid BASS seeing 1.61 MJD 57923.240 object 26023 ksb_160706_074633_ooi_g_ls9.fits.fz ksb_160706_074633_ooi_g_ls9-CCD3 g exptime 95.8 propid BASS seeing 1.70 MJD 57575.324 object 24842 ksb_160612_102749_ooi_r_ls9.fits.fz ksb_160612_102749_ooi_r_ls9-CCD3 r exptime 78.0 propid BASS seeing 1.23 MJD 57551.436 object 24842 mosaic get_fwhm: self.fwhm = 4.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2858 3093 and amp range 2006 4053 and image y 1334 1572 and amp range 0 2039 Range in image: x 0 236 , y 0 239 (with image size 236 x 239) dzp 0.001388291 -> scaling image by 1.0012794811153327 Faked up EXPNUM 79000145 Faked up EXPNUM 79000145 Faked up EXPNUM 79000145 90prime get_fwhm: self.fwhm = 2.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1533 1669 and amp range 0 2015 and image y 3989 4080 and amp range 2048 4095 Range in image: x 0 137 , y 0 92 (with image size 137 x 92) dzp -0.034377232 -> scaling image by 0.9688334104074875 mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 158 398 and amp range 0 2005 and image y 1500 1739 and amp range 0 2039 Range in image: x 0 241 , y 0 240 (with image size 241 x 240) dzp -0.005856539 -> scaling image by 0.9946204500110131 Faked up EXPNUM 82560198 Faked up EXPNUM 82560198 Faked up EXPNUM 82560198 90prime get_fwhm: self.fwhm = 2.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3277 3415 and amp range 2016 4031 and image y 1499 1637 and amp range 0 2047 Range in image: x 0 139 , y 0 139 (with image size 139 x 139) dzp 0.014483032 -> scaling image by 1.0134287315188357 Faked up EXPNUM 75500157 Faked up EXPNUM 75500157 Faked up EXPNUM 75500157 90prime get_fwhm: self.fwhm = 2.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1519 1655 and amp range 0 2015 and image y 3998 4080 and amp range 2048 4095 Range in image: x 0 137 , y 0 83 (with image size 137 x 83) dzp -0.00015519658 -> scaling image by 0.9998570688798908 Faked up EXPNUM 79230078 Faked up EXPNUM 79230078 Faked up EXPNUM 79230078 90prime get_fwhm: self.fwhm = 3.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3293 3430 and amp range 2016 4031 and image y 1508 1646 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.01918938 -> scaling image by 1.017831182878158 mosaic get_fwhm: self.fwhm = 5.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1300 1536 and amp range 0 2047 and image y 387 622 and amp range 0 2021 Range in image: x 0 237 , y 0 236 (with image size 237 x 236) dzp -0.018417627 -> scaling image by 0.9831798050134541 mosaic get_fwhm: self.fwhm = 4.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4006 4095 and amp range 2048 4095 and image y 3887 4077 and amp range 2040 4078 Range in image: x 0 90 , y 0 191 (with image size 90 x 191) dzp -0.009154885 -> scaling image by 0.9916034885139223 Faked up EXPNUM 75750109 Faked up EXPNUM 75750109 Faked up EXPNUM 75750109 90prime get_fwhm: self.fwhm = 3.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3540 3676 and amp range 2016 4031 and image y 1510 1645 and amp range 0 2047 Range in image: x 0 137 , y 0 136 (with image size 137 x 136) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Faked up EXPNUM 75510123 Faked up EXPNUM 75510123 Faked up EXPNUM 75510123 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3548 3684 and amp range 2016 4031 and image y 1505 1640 and amp range 0 2047 Range in image: x 0 137 , y 0 136 (with image size 137 x 136) dzp 0.004245165 -> scaling image by 1.0039175950705865 Stage tims : Wall: 3.90 s, CPU: 1.21 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.246096 MB Stage tims finished: 2020-06-15T07:41:37.905454 Resources for stage tims : 4.065 s worker CPU, 15.635 s worker Wall, Wall: 3.901 s, Cores in use: 1.35, Total efficiency (on 8 cores): 16.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-15T07:41:37.933283 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01596.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01485.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/metrics/cus/reference-custom-272161p48314.fits Stage refs : Wall: 4.72 s, CPU: 4.19 s, VmPeak: 993 MB, VmSize: 987 MB, VmRSS: 219 MB, VmData: 250 MB, maxrss: 0.246096 MB Stage refs finished: 2020-06-15T07:41:42.657375 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.725 s, Cores in use: 0.89, Total efficiency (on 8 cores): 11.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-06-15T07:41:42.688748 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/metrics/cus/outlier-mask-custom-272161p48314.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/metrics/cus/outliers-pre-custom-272161p48314.jpg Image ksb_170527_091338_ooi_g_ls9-CCD1 g : masking 44 positive outlier pixels and 0 negative outlier pixels Image k4m_160518_095133_ooi_zd_ls9-CCD2 z : masking 785 positive outlier pixels and 0 negative outlier pixels Image k4m_160516_100502_ooi_zd_ls9-CCD1 z : masking 133 positive outlier pixels and 0 negative outlier pixels Image k4m_170531_111320_ooi_zd_ls9-CCD4 z : masking 201 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/metrics/cus/outlier-mask-custom-272161p48314.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/metrics/cus/outliers-post-custom-272161p48314.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/metrics/cus/outliers-masked-pos-custom-272161p48314.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/metrics/cus/outliers-masked-neg-custom-272161p48314.jpg Stage outliers : Wall: 1.18 s, CPU: 0.94 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 230 MB, VmData: 260 MB, maxrss: 0.246096 MB Stage outliers finished: 2020-06-15T07:41:43.872207 Resources for stage outliers : 0.544 s worker CPU, 0.544 s worker Wall, Wall: 1.185 s, Cores in use: 1.26, Total efficiency (on 8 cores): 15.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-06-15T07:41:43.899532 Stage halos : Wall: 0.55 s, CPU: 0.52 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 230 MB, VmData: 260 MB, maxrss: 0.246096 MB Stage halos finished: 2020-06-15T07:41:44.449356 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.551 s, Cores in use: 0.94, Total efficiency (on 8 cores): 11.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-15T07:41:44.479929 PSF sigmas in coadd pixels: ['1.85', '2.61', '2.76'] Using average PSF sigma 2.405976992515643 Gaussian PSF norm 0.11724750180546212 vs pixelized 0.08793778 average tim pixel scale / coadd scale: 1.7290506583019976 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.82', '1.88', '1.99'] Using average PSF sigma 1.8964164645805741 Gaussian PSF norm 0.14875149896795922 vs pixelized 0.11892578 average tim pixel scale / coadd scale: 1.7295888569988025 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.85', '1.56', '1.87', '2.43'] Using average PSF sigma 1.9291838755099664 Gaussian PSF norm 0.14622493757849203 vs pixelized 0.12555705 average tim pixel scale / coadd scale: 0.9909422045310546 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.13 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 232 MB, VmData: 261 MB, maxrss: 0.246096 MB Stage fit_on_coadds finished: 2020-06-15T07:41:44.642909 Resources for stage fit_on_coadds : 0.118 s worker CPU, 0.118 s worker Wall, Wall: 0.164 s, Cores in use: 1.51, Total efficiency (on 8 cores): 18.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-06-15T07:41:44.657987 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 21 potential peaks Of 21 potential peaks: 7 in veto map, 2 cut by saddle test, 0 cut by aper test, 12 kept SED z : 12 new peaks Found 41 potential peaks Of 41 potential peaks: 36 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 36 potential peaks Of 36 potential peaks: 33 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 42 potential peaks Of 42 potential peaks: 38 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 51 potential peaks Of 51 potential peaks: 45 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 17 new sources Median coadd sky for g : 0.0002109505 Median coadd sky for r : 0.00063451205 Median coadd sky for z : -0.00027217134 Stage srcs : Wall: 0.66 s, CPU: 0.61 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 233 MB, VmData: 261 MB, maxrss: 0.246096 MB Stage srcs finished: 2020-06-15T07:41:45.313512 Resources for stage srcs : 0.085 s worker CPU, 0.086 s worker Wall, Wall: 0.657 s, Cores in use: 1.06, Total efficiency (on 8 cores): 13.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-15T07:41:45.333120 Blob 1 of 9, id: 4, sources: 10, size: 232x165, npix 22008, brick X: 0,232, Y: 41,206, one pixel: 172 41 Blob 2 of 9, id: 5, sources: 1, size: 24x27, npix 448, brick X: 0,24, Y: 185,212, one pixel: 9 185 Blob 3 of 9, id: 1, sources: 1, size: 24x25, npix 398, brick X: 60,84, Y: 12,37, one pixel: 70 12 Blob 4 of 9, id: 6, sources: 1, size: 24x24, npix 372, brick X: 179,203, Y: 185,209, one pixel: 188 185 Blob 5 of 9, id: 7, sources: 1, size: 24x24, npix 342, brick X: 127,151, Y: 208,232, one pixel: 137 208 Blob 6 of 9, id: 0, sources: 1, size: 22x22, npix 303, brick X: 6,28, Y: 7,29, one pixel: 16 7 Blob 7 of 9, id: 3, sources: 1, size: 21x20, npix 249, brick X: 107,128, Y: 28,48, one pixel: 116 28 Blob 8 of 9, id: 8, sources: 1, size: 22x14, npix 208, brick X: 28,50, Y: 219,233, one pixel: 37 219 Blob 9 of 9, id: 2, sources: 1, size: 12x19, npix 134, brick X: 221,233, Y: 18,37, one pixel: 230 18 Blob 7 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 796 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139488 MB Blob 9 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 796 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141168 MB Blob 5 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 807 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139736 MB Blob 4 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 798 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141136 MB Blob 6 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 795 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139672 MB Blob 2 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141232 MB Blob 8 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 807 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139584 MB Blob 3 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 798 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141576 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.798821, ee1=-0.0817113, ee2=0.010356 Measuring 4 iterative sources Blob 1 finished, total: Wall: 8.76 s, CPU: 8.76 s, VmPeak: 793 MB, VmSize: 716 MB, VmRSS: 149 MB, VmData: 181 MB, maxrss: 0.152512 MB Old catalog: 27 New catalog: 18 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/metrics/cus/blobs-custom-272161p48314.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/metrics/cus/all-models-custom-272161p48314.fits Stage fitblobs : Wall: 9.25 s, CPU: 0.42 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 233 MB, VmData: 261 MB, maxrss: 0.246096 MB Stage fitblobs finished: 2020-06-15T07:41:54.582264 Resources for stage fitblobs : 10.844 s worker CPU, 10.892 s worker Wall, Wall: 9.251 s, Cores in use: 1.22, Total efficiency (on 8 cores): 15.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-06-15T07:41:54.597305 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/tmp-legacysurvey-custom-272161p48314-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/tmp-legacysurvey-custom-272161p48314-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/tmp-legacysurvey-custom-272161p48314-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/tmp-legacysurvey-custom-272161p48314-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-resid.jpg Stage coadds : Wall: 1.41 s, CPU: 0.67 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.246096 MB Stage coadds finished: 2020-06-15T07:41:56.003502 Resources for stage coadds : 1.933 s worker CPU, 2.890 s worker Wall, Wall: 1.407 s, Cores in use: 1.85, Total efficiency (on 8 cores): 23.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-06-15T07:41:56.020900 Cut to 1 unWISE tiles Reading WISE tile 2722p484 band 1 Reading WISE tile 2722p484 band 3 Reading WISE tile 2722p484 band 2 Reading WISE tile 2722p484 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 807 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.188424 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 798 MB, VmSize: 788 MB, VmRSS: 139 MB, VmData: 169 MB, maxrss: 0.202364 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 807 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207632 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 795 MB, VmSize: 792 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.213644 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/tmp-legacysurvey-custom-272161p48314-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/tmp-legacysurvey-custom-272161p48314-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.10 s, CPU: 0.60 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.246096 MB Stage wise_forced finished: 2020-06-15T07:41:58.116145 Resources for stage wise_forced : 3.018 s worker CPU, 3.876 s worker Wall, Wall: 2.096 s, Cores in use: 1.73, Total efficiency (on 8 cores): 21.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-06-15T07:41:58.136033 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/coadd/cus/custom-272161p48314/legacysurvey-custom-272161p48314-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/tractor-i/cus/tractor-custom-272161p48314.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/tractor/cus/tractor-custom-272161p48314.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/tractor/cus/brick-custom-272161p48314.sha256sum Stage writecat : Wall: 0.99 s, CPU: 0.66 s, VmPeak: 1129 MB, VmSize: 1001 MB, VmRSS: 236 MB, VmData: 261 MB, maxrss: 0.37294 MB Stage writecat finished: 2020-06-15T07:41:59.126000 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.991 s, Cores in use: 0.67, Total efficiency (on 8 cores): 8.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2314821/PGC2314821-largegalaxy-writecat.p All done: 20.610 s worker CPU, 34.045 s worker Wall, Wall: 25.156 s, Cores in use: 1.22, Total efficiency (on 8 cores): 15.2 % Finished galaxy PGC2314821 in 0.457 minutes.