Started working on galaxy PGC2047936 at Sun Jun 7 17:34:04 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.48593650000004 34.3578987 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T17:34:05.625133 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '278.48593650000004', '34.3578987', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.48593650000004 34.3578987 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 278.48593650000004 34.3578987 Starting process 38430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 38431 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 38432 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 38433 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T17:34:09.030088 Keeping 9 CCDs: k4m_160418_120204_ooi_zd_ls9.fits.fz k4m_160418_120204_ooi_zd_ls9-CCD3 z exptime 109.102 propid 2016A-0453 seeing 1.45 MJD 57496.501 object MzLS_576330_z k4m_160429_112135_ooi_zd_ls9.fits.fz k4m_160429_112135_ooi_zd_ls9-CCD2 z exptime 100.102 propid 2016A-0453 seeing 1.34 MJD 57507.473 object MzLS_574260_z k4m_160417_120508_ooi_zd_ls9.fits.fz k4m_160417_120508_ooi_zd_ls9-CCD4 z exptime 80.105 propid 2016A-0453 seeing 1.26 MJD 57495.504 object MzLS_575296_z k4m_180131_125126_ooi_zd_ls9.fits.fz k4m_180131_125126_ooi_zd_ls9-CCD1 z exptime 205.106 propid 2016A-0453 seeing 0.89 MJD 58149.536 object MzLS_576331_z k4m_160418_120436_ooi_zd_ls9.fits.fz k4m_160418_120436_ooi_zd_ls9-CCD1 z exptime 100.106 propid 2016A-0453 seeing 1.65 MJD 57496.503 object MzLS_576331_z ksb_180518_090211_ooi_r_ls9.fits.fz ksb_180518_090211_ooi_r_ls9-CCD4 r exptime 173.478 propid NOTBASS seeing 1.50 MJD 58256.377 object 60903 ksb_160628_070606_ooi_g_ls9.fits.fz ksb_160628_070606_ooi_g_ls9-CCD4 g exptime 129.199 propid BASS seeing 1.45 MJD 57567.296 object 60903 ksb_160602_085638_ooi_g_ls9.fits.fz ksb_160602_085638_ooi_g_ls9-CCD3 g exptime 125.4 propid BASS seeing 1.25 MJD 57541.373 object 60742 ksb_160513_104723_ooi_r_ls9.fits.fz ksb_160513_104723_ooi_r_ls9-CCD3 r exptime 69.4 propid BASS seeing 1.16 MJD 57521.450 object 60742 mosaic get_fwhm: self.fwhm = 3.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1766 2011 and amp range 0 2005 and image y 299 547 and amp range 0 2039 Range in image: x 0 240 , y 0 249 (with image size 246 x 249) dzp 0.009508088 -> scaling image by 1.0087957299815176 Found overlap: image x 1766 2011 and amp range 2006 4053 and image y 299 547 and amp range 0 2039 Range in image: x 240 246 , y 0 249 (with image size 246 x 249) dzp 0.0061123776 -> scaling image by 1.005645584425507 mosaic get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 4.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 235 477 and amp range 0 2047 and image y 2614 2857 and amp range 2022 4060 Found overlap: image x 2894 3137 and amp range 2048 4095 and image y 3140 3383 and amp range 2040 4078 Range in image: x 0 243 , y 0 244 (with image size 243 x 244) Range in image: x 0 244 , y 0 244 (with image size 244 x 244) dzp 0.0033053984 -> scaling image by 1.0030490232713904 dzp -0.009154885 -> scaling image by 0.9916034885139223 mosaic get_fwhm: self.fwhm = 5.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1787 2031 and amp range 0 2005 and image y 4000 4072 and amp range 2040 4078 Range in image: x 0 219 , y 0 73 (with image size 245 x 73) dzp 0.0022078273 -> scaling image by 1.0020355530120029 Found overlap: image x 1787 2031 and amp range 2006 4053 and image y 4000 4072 and amp range 2040 4078 Range in image: x 219 245 , y 0 73 (with image size 245 x 73) dzp -0.0026360443 -> scaling image by 0.99757505842151 Faked up EXPNUM 75670101 Faked up EXPNUM 75670101 Faked up EXPNUM 75670101 90prime get_fwhm: self.fwhm = 3.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2982 3122 and amp range 2016 4031 and image y 278 418 and amp range 0 2047 Range in image: x 0 141 , y 0 141 (with image size 141 x 141) dzp 0.010226944 -> scaling image by 1.0094638657706572 Faked up EXPNUM 75410140 Faked up EXPNUM 75410140 Faked up EXPNUM 75410140 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3198 3337 and amp range 2016 4031 and image y 1826 1965 and amp range 0 2047 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Faked up EXPNUM 75210216 Faked up EXPNUM 75210216 Faked up EXPNUM 75210216 90prime get_fwhm: self.fwhm = 2.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3200 3339 and amp range 2016 4031 and image y 1831 1971 and amp range 0 2047 Range in image: x 0 140 , y 0 141 (with image size 140 x 141) dzp 0.004245165 -> scaling image by 1.0039175950705865 Faked up EXPNUM 82560165 Faked up EXPNUM 82560165 Faked up EXPNUM 82560165 90prime get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2991 3132 and amp range 2016 4031 and image y 240 379 and amp range 0 2047 Range in image: x 0 142 , y 0 140 (with image size 142 x 140) dzp 0.043530058 -> scaling image by 1.0409072255640852 mosaic get_fwhm: self.fwhm = 6.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1760 2005 and amp range 0 2005 and image y 290 538 and amp range 0 2039 Range in image: x 0 246 , y 0 249 (with image size 246 x 249) dzp -0.011066288 -> scaling image by 0.989859339076806 Stage tims : Wall: 12.87 s, CPU: 4.56 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.566592 MB Stage tims finished: 2020-06-07T17:34:21.899057 Resources for stage tims : 3.178 s worker CPU, 25.430 s worker Wall, Wall: 12.870 s, Cores in use: 0.60, Total efficiency (on 4 cores): 15.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T17:34:21.915417 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02723.fits Matched 7 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/reference-custom-278485p34357.fits Stage refs : Wall: 14.07 s, CPU: 12.31 s, VmPeak: 1061 MB, VmSize: 1055 MB, VmRSS: 287 MB, VmData: 319 MB, maxrss: 0.566592 MB Stage refs finished: 2020-06-07T17:34:35.982465 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 14.068 s, Cores in use: 0.87, Total efficiency (on 4 cores): 21.9 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T17:34:35.983878 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outlier-mask-custom-278485p34357.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outliers-pre-custom-278485p34357.jpg Image ksb_160628_070606_ooi_g_ls9-CCD4 g : masking 50 positive outlier pixels and 0 negative outlier pixels Image ksb_180518_090211_ooi_r_ls9-CCD4 r : masking 136 positive outlier pixels and 0 negative outlier pixels Image k4m_180131_125126_ooi_zd_ls9-CCD1 z : masking 2095 positive outlier pixels and 0 negative outlier pixels Image k4m_160418_120436_ooi_zd_ls9-CCD1 z : masking 1516 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outlier-mask-custom-278485p34357.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outliers-post-custom-278485p34357.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outliers-masked-pos-custom-278485p34357.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outliers-masked-neg-custom-278485p34357.jpg Stage outliers : Wall: 7.60 s, CPU: 7.38 s, VmPeak: 1061 MB, VmSize: 965 MB, VmRSS: 199 MB, VmData: 229 MB, maxrss: 0.566592 MB Stage outliers finished: 2020-06-07T17:34:43.582220 Resources for stage outliers : 0.751 s worker CPU, 0.754 s worker Wall, Wall: 7.599 s, Cores in use: 1.07, Total efficiency (on 4 cores): 26.8 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T17:34:43.583959 Stage halos : Wall: 6.60 s, CPU: 6.60 s, VmPeak: 1061 MB, VmSize: 965 MB, VmRSS: 199 MB, VmData: 229 MB, maxrss: 0.566592 MB Stage halos finished: 2020-06-07T17:34:50.184998 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 6.602 s, Cores in use: 1.00, Total efficiency (on 4 cores): 25.0 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T17:34:50.186793 PSF sigmas in coadd pixels: ['2.36', '2.04'] Using average PSF sigma 2.2003896009070707 Gaussian PSF norm 0.12820220185443054 vs pixelized 0.11300821 average tim pixel scale / coadd scale: 1.7293894735435094 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.44', '1.89'] Using average PSF sigma 2.164668094165513 Gaussian PSF norm 0.13031780370127674 vs pixelized 0.10022695 average tim pixel scale / coadd scale: 1.7301519827931435 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.36', '2.17', '2.05', '1.45', '2.69'] Using average PSF sigma 2.1413816098717637 Gaussian PSF norm 0.13173494648194506 vs pixelized 0.10993664 average tim pixel scale / coadd scale: 0.9909958711057503 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.16 s, VmPeak: 1061 MB, VmSize: 965 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.566592 MB Stage fit_on_coadds finished: 2020-06-07T17:34:50.379062 Resources for stage fit_on_coadds : 0.204 s worker CPU, 0.207 s worker Wall, Wall: 0.193 s, Cores in use: 1.88, Total efficiency (on 4 cores): 47.0 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T17:34:50.381882 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 30 potential peaks Of 30 potential peaks: 8 in veto map, 3 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 29 potential peaks Of 29 potential peaks: 23 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 22 potential peaks Of 22 potential peaks: 17 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 29 potential peaks Of 29 potential peaks: 24 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 32 potential peaks Of 32 potential peaks: 29 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 21 new sources Median coadd sky for g : -6.893264e-05 Median coadd sky for r : 0.0001415754 Median coadd sky for z : -0.00017727666 Stage srcs : Wall: 5.94 s, CPU: 5.89 s, VmPeak: 1061 MB, VmSize: 965 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.566592 MB Stage srcs finished: 2020-06-07T17:34:56.317350 Resources for stage srcs : 0.120 s worker CPU, 0.128 s worker Wall, Wall: 5.936 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T17:34:56.335710 Blob 1 of 16, id: 5, sources: 11, size: 173x142, npix 12640, brick X: 28,201, Y: 32,174, one pixel: 66 32 Blob 2 of 16, id: 0, sources: 1, size: 61x75, npix 3280, brick X: 0,61, Y: 0,75, one pixel: 1 0 Blob 3 of 16, id: 1, sources: 1, size: 66x43, npix 2071, brick X: 90,156, Y: 0,43, one pixel: 97 0 Blob 4 of 16, id: 11, sources: 2, size: 38x61, npix 1659, brick X: 201,239, Y: 178,239, one pixel: 226 178 Blob 5 of 16, id: 6, sources: 2, size: 42x53, npix 1296, brick X: 197,239, Y: 49,102, one pixel: 217 49 Blob 3 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141144 MB Blob 6 of 16, id: 7, sources: 2, size: 35x54, npix 1177, brick X: 29,64, Y: 120,174, one pixel: 42 120 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.47242, 34.36604), pm (-2.5, -12.8), parallax 0.695 with NanoMaggies: g=19.7, r=19.1, z=19 Reset brightness to NanoMaggies: g=19.7, r=19.1, z=19 Blob 4 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 812 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141 MB Blob 2 finished, total: Wall: 0.23 s, CPU: 0.22 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.14066 MB Blob 7 of 16, id: 14, sources: 1, size: 33x33, npix 765, brick X: 71,104, Y: 198,231, one pixel: 84 198 Blob 8 of 16, id: 2, sources: 3, size: 34x33, npix 682, brick X: 173,207, Y: 0,33, one pixel: 180 0 Blob 7 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.14066 MB Blob 9 of 16, id: 13, sources: 1, size: 32x31, npix 671, brick X: 164,196, Y: 194,225, one pixel: 176 194 Blob 6 finished, total: Wall: 1.39 s, CPU: 1.39 s, VmPeak: 812 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141 MB Blob 10 of 16, id: 9, sources: 1, size: 34x29, npix 639, brick X: 182,216, Y: 148,177, one pixel: 199 148 Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.79 s, CPU: 1.79 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141144 MB Blob 11 of 16, id: 4, sources: 1, size: 32x32, npix 609, brick X: 158,190, Y: 21,53, one pixel: 167 21 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.47970, 34.34673), pm (1.1, -12.5), parallax 1.779 with NanoMaggies: g=20.5, r=19, z=17.4 Reset brightness to NanoMaggies: g=20.5, r=19, z=17.4 Blob 8 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.14066 MB Blob 12 of 16, id: 3, sources: 2, size: 28x36, npix 598, brick X: 211,239, Y: 6,42, one pixel: 228 6 Blob 9 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 812 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141748 MB Blob 13 of 16, id: 10, sources: 1, size: 25x25, npix 400, brick X: 57,82, Y: 176,201, one pixel: 67 176 Measuring 1 iterative sources Blob 12 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 812 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141748 MB Blob 14 of 16, id: 12, sources: 1, size: 25x23, npix 349, brick X: 140,165, Y: 186,209, one pixel: 149 186 Blob 11 finished, total: Wall: 1.41 s, CPU: 1.41 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141528 MB Blob 15 of 16, id: 8, sources: 1, size: 21x20, npix 267, brick X: 217,238, Y: 132,152, one pixel: 225 132 Blob 16 of 16, id: 15, sources: 1, size: 22x17, npix 232, brick X: 19,41, Y: 222,239, one pixel: 29 222 Measuring 1 iterative sources Blob 10 finished, total: Wall: 2.54 s, CPU: 2.54 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141848 MB Blob 14 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141528 MB Blob 13 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 812 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141748 MB Blob 16 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141528 MB Blob 15 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141848 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.75626, ee1=-0.0405634, ee2=-0.0203124 Measuring 1 iterative sources Blob 1 finished, total: Wall: 10.37 s, CPU: 10.37 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143912 MB Old catalog: 48 New catalog: 36 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/blobs-custom-278485p34357.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/all-models-custom-278485p34357.fits Stage fitblobs : Wall: 13.24 s, CPU: 2.92 s, VmPeak: 1061 MB, VmSize: 965 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.566592 MB Stage fitblobs finished: 2020-06-07T17:35:09.575505 Resources for stage fitblobs : 25.420 s worker CPU, 25.439 s worker Wall, Wall: 13.241 s, Cores in use: 2.14, Total efficiency (on 4 cores): 53.5 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T17:35:09.577158 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/tmp-legacysurvey-custom-278485p34357-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/tmp-legacysurvey-custom-278485p34357-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/tmp-legacysurvey-custom-278485p34357-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/tmp-legacysurvey-custom-278485p34357-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-resid.jpg Stage coadds : Wall: 21.33 s, CPU: 20.70 s, VmPeak: 1061 MB, VmSize: 965 MB, VmRSS: 202 MB, VmData: 229 MB, maxrss: 0.566592 MB Stage coadds finished: 2020-06-07T17:35:30.909571 Resources for stage coadds : 2.109 s worker CPU, 2.171 s worker Wall, Wall: 21.333 s, Cores in use: 1.07, Total efficiency (on 4 cores): 26.7 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T17:35:30.910956 Cut to 1 unWISE tiles Reading WISE tile 2777p348 band 1 Reading WISE tile 2777p348 band 2 Reading WISE tile 2777p348 band 3 Reading WISE tile 2777p348 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 811 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.204384 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 811 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208536 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 814 MB, VmSize: 795 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.188028 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 812 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.204688 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/tmp-legacysurvey-custom-278485p34357-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/tmp-legacysurvey-custom-278485p34357-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 28.05 s, CPU: 26.34 s, VmPeak: 1061 MB, VmSize: 965 MB, VmRSS: 202 MB, VmData: 229 MB, maxrss: 0.566592 MB Stage wise_forced finished: 2020-06-07T17:35:58.957013 Resources for stage wise_forced : 4.541 s worker CPU, 6.329 s worker Wall, Wall: 28.047 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.5 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T17:35:58.958888 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34357/legacysurvey-custom-278485p34357-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/tractor-i/cus/tractor-custom-278485p34357.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/tractor/cus/tractor-custom-278485p34357.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/tractor/cus/brick-custom-278485p34357.sha256sum Stage writecat : Wall: 6.08 s, CPU: 5.86 s, VmPeak: 1097 MB, VmSize: 969 MB, VmRSS: 204 MB, VmData: 229 MB, maxrss: 0.566592 MB Stage writecat finished: 2020-06-07T17:36:05.036828 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.079 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.1 % Stage writecat finished All done: 36.326 s worker CPU, 60.461 s worker Wall, Wall: 116.011 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 % Finished galaxy PGC2047936 in 2.013 minutes. Started working on galaxy PGC2047936 at Fri Aug 7 09:24:14 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.4855555982455 34.358044351232365 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:24:15.935158 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '278.4855555982455', '34.358044351232365', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.4855555982455 34.358044351232365 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 278.4855555982455 34.358044351232365 Starting process 41454 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 41455 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 41456 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 41457 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 41458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB Starting process 41459 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059356 MB Starting process 41460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059356 MB Starting process 41461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 41462 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 41463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 41464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 41465 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 41466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 41467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 41468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 41469 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:24:16.455598 Keeping 9 CCDs: k4m_160418_120204_ooi_zd_ls9-CCD3 z expnum 83131 exptime 109.102 propid 2016A-0453 seeing 1.45 MJD 57496.501 object MzLS_576330_z mosaic/CP/V4.3/CP20160417/k4m_160418_120204_ooi_zd_ls9.fits.fz k4m_160429_112135_ooi_zd_ls9-CCD2 z expnum 85818 exptime 100.102 propid 2016A-0453 seeing 1.34 MJD 57507.473 object MzLS_574260_z mosaic/CP/V4.3/CP20160428/k4m_160429_112135_ooi_zd_ls9.fits.fz k4m_160417_120508_ooi_zd_ls9-CCD4 z expnum 82871 exptime 80.105 propid 2016A-0453 seeing 1.26 MJD 57495.504 object MzLS_575296_z mosaic/CP/V4.3/CP20160416/k4m_160417_120508_ooi_zd_ls9.fits.fz k4m_180131_125126_ooi_zd_ls9-CCD1 z expnum 159335 exptime 205.106 propid 2016A-0453 seeing 0.89 MJD 58149.536 object MzLS_576331_z mosaic/CP/V4.3/CP20180130/k4m_180131_125126_ooi_zd_ls9.fits.fz k4m_160418_120436_ooi_zd_ls9-CCD1 z expnum 83132 exptime 100.106 propid 2016A-0453 seeing 1.65 MJD 57496.503 object MzLS_576331_z mosaic/CP/V4.3/CP20160417/k4m_160418_120436_ooi_zd_ls9.fits.fz ksb_180518_090211_ooi_r_ls9-CCD4 r expnum 82560165 exptime 173.478 propid NOTBASS seeing 1.50 MJD 58256.377 object 60903 90prime/CP/V2.3/CP20180517/ksb_180518_090211_ooi_r_ls9.fits.fz ksb_160628_070606_ooi_g_ls9-CCD4 g expnum 75670101 exptime 129.199 propid BASS seeing 1.45 MJD 57567.296 object 60903 90prime/CP/V2.3/CP20160627/ksb_160628_070606_ooi_g_ls9.fits.fz ksb_160602_085638_ooi_g_ls9-CCD3 g expnum 75410140 exptime 125.4 propid BASS seeing 1.25 MJD 57541.373 object 60742 90prime/CP/V2.3/CP20160601/ksb_160602_085638_ooi_g_ls9.fits.fz ksb_160513_104723_ooi_r_ls9-CCD3 r expnum 75210216 exptime 69.4 propid BASS seeing 1.16 MJD 57521.450 object 60742 90prime/CP/V2.3/CP20160512/ksb_160513_104723_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 5.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1790 2033 and amp range 0 2005 and image y 3995 4072 and amp range 2040 4078 Range in image: x 0 216 , y 0 78 (with image size 244 x 78) dzp 0.0022078273 -> scaling image by 1.0020355530120029 Found overlap: image x 1790 2033 and amp range 2006 4053 and image y 3995 4072 and amp range 2040 4078 Range in image: x 216 244 , y 0 78 (with image size 244 x 78) dzp -0.0026360443 -> scaling image by 0.99757505842151 mosaic get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2896 3139 and amp range 2048 4095 and image y 3136 3378 and amp range 2040 4078 Range in image: x 0 244 , y 0 243 (with image size 244 x 243) dzp -0.009154885 -> scaling image by 0.9916034885139223 mosaic get_fwhm: self.fwhm = 6.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1762 2007 and amp range 0 2005 and image y 285 533 and amp range 0 2039 Range in image: x 0 244 , y 0 249 (with image size 246 x 249) dzp -0.011066288 -> scaling image by 0.989859339076806 Found overlap: image x 1762 2007 and amp range 2006 4053 and image y 285 533 and amp range 0 2039 Range in image: x 244 246 , y 0 249 (with image size 246 x 249) dzp 0.001388291 -> scaling image by 1.0012794811153327 mosaic get_fwhm: self.fwhm = 4.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 237 479 and amp range 0 2047 and image y 2609 2852 and amp range 2022 4060 Range in image: x 0 243 , y 0 244 (with image size 243 x 244) dzp 0.0033053984 -> scaling image by 1.0030490232713904 mosaic get_fwhm: self.fwhm = 3.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1768 2013 and amp range 0 2005 and image y 294 542 and amp range 0 2039 Range in image: x 0 238 , y 0 249 (with image size 246 x 249) dzp 0.009508088 -> scaling image by 1.0087957299815176 Found overlap: image x 1768 2013 and amp range 2006 4053 and image y 294 542 and amp range 0 2039 Range in image: x 238 246 , y 0 249 (with image size 246 x 249) dzp 0.0061123776 -> scaling image by 1.005645584425507 Faked up EXPNUM 75210216 Faked up EXPNUM 75210216 Faked up EXPNUM 75210216 90prime get_fwhm: self.fwhm = 2.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3199 3338 and amp range 2016 4031 and image y 1834 1973 and amp range 0 2047 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp 0.004245165 -> scaling image by 1.0039175950705865 Faked up EXPNUM 82560165 Faked up EXPNUM 82560165 Faked up EXPNUM 82560165 90prime get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2990 3130 and amp range 2016 4031 and image y 242 382 and amp range 0 2047 Range in image: x 0 141 , y 0 141 (with image size 141 x 141) dzp 0.043530058 -> scaling image by 1.0409072255640852 Faked up EXPNUM 75410140 Faked up EXPNUM 75410140 Faked up EXPNUM 75410140 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3197 3336 and amp range 2016 4031 and image y 1829 1968 and amp range 0 2047 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Faked up EXPNUM 75670101 Faked up EXPNUM 75670101 Faked up EXPNUM 75670101 90prime get_fwhm: self.fwhm = 3.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2980 3121 and amp range 2016 4031 and image y 281 420 and amp range 0 2047 Range in image: x 0 142 , y 0 140 (with image size 142 x 140) dzp 0.010226944 -> scaling image by 1.0094638657706572 Stage tims : Wall: 113.23 s, CPU: 1.02 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.176832 MB Stage tims finished: 2020-08-07T09:26:09.689627 Resources for stage tims : 4.288 s worker CPU, 415.460 s worker Wall, Wall: 113.235 s, Cores in use: 0.05, Total efficiency (on 16 cores): 0.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:26:09.718444 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02723.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/reference-custom-278485p34358.fits Stage refs : Wall: 11.98 s, CPU: 9.35 s, VmPeak: 1071 MB, VmSize: 1065 MB, VmRSS: 290 MB, VmData: 320 MB, maxrss: 0.296204 MB Stage refs finished: 2020-08-07T09:26:21.698943 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.982 s, Cores in use: 0.78, Total efficiency (on 16 cores): 4.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:26:21.830982 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outlier-mask-custom-278485p34358.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outliers-pre-custom-278485p34358.jpg Image ksb_160628_070606_ooi_g_ls9-CCD4 g : masking 53 positive outlier pixels and 0 negative outlier pixels Image ksb_180518_090211_ooi_r_ls9-CCD4 r : masking 139 positive outlier pixels and 0 negative outlier pixels Image k4m_180131_125126_ooi_zd_ls9-CCD1 z : masking 2240 positive outlier pixels and 0 negative outlier pixels Image k4m_160418_120436_ooi_zd_ls9-CCD1 z : masking 1316 positive outlier pixels and 192 negative outlier pixels Image k4m_160418_120204_ooi_zd_ls9-CCD3 z : masking 76 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outlier-mask-custom-278485p34358.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outliers-post-custom-278485p34358.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outliers-masked-pos-custom-278485p34358.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/outliers-masked-neg-custom-278485p34358.jpg Stage outliers : Wall: 0.95 s, CPU: 0.61 s, VmPeak: 1075 MB, VmSize: 1075 MB, VmRSS: 301 MB, VmData: 329 MB, maxrss: 0.308104 MB Stage outliers finished: 2020-08-07T09:26:22.782587 Resources for stage outliers : 0.715 s worker CPU, 0.773 s worker Wall, Wall: 0.953 s, Cores in use: 1.39, Total efficiency (on 16 cores): 8.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:26:22.855297 Stage halos : Wall: 0.41 s, CPU: 0.37 s, VmPeak: 1075 MB, VmSize: 1075 MB, VmRSS: 301 MB, VmData: 330 MB, maxrss: 0.308436 MB Stage halos finished: 2020-08-07T09:26:23.260514 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.407 s, Cores in use: 0.91, Total efficiency (on 16 cores): 5.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:26:23.303898 PSF sigmas in coadd pixels: ['2.36', '2.04'] Using average PSF sigma 2.2003896009070707 Gaussian PSF norm 0.12820220185443054 vs pixelized 0.113010876 average tim pixel scale / coadd scale: 1.7293894735435094 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.44', '1.89'] Using average PSF sigma 2.164668094165513 Gaussian PSF norm 0.13031780370127674 vs pixelized 0.10022867 average tim pixel scale / coadd scale: 1.7301519827931435 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.36', '2.17', '2.05', '1.45', '2.69'] Using average PSF sigma 2.1413816098717637 Gaussian PSF norm 0.13173494648194506 vs pixelized 0.10993332 average tim pixel scale / coadd scale: 0.9909958711057503 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.12 s, VmPeak: 1075 MB, VmSize: 1075 MB, VmRSS: 303 MB, VmData: 330 MB, maxrss: 0.310672 MB Stage fit_on_coadds finished: 2020-08-07T09:26:23.546517 Resources for stage fit_on_coadds : 0.164 s worker CPU, 0.164 s worker Wall, Wall: 0.244 s, Cores in use: 1.19, Total efficiency (on 16 cores): 7.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T09:26:23.572222 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 10 in veto map, 4 cut by saddle test, 0 cut by aper test, 18 kept SED z : 18 new peaks Found 57 potential peaks Of 57 potential peaks: 52 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 27 potential peaks Of 27 potential peaks: 19 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 32 potential peaks Of 32 potential peaks: 24 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 35 potential peaks Of 35 potential peaks: 30 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 24 new sources Median coadd sky for g : -6.873174e-05 Median coadd sky for r : 0.00014159881 Median coadd sky for z : -8.472074e-05 Stage srcs : Wall: 0.49 s, CPU: 0.46 s, VmPeak: 1075 MB, VmSize: 1075 MB, VmRSS: 304 MB, VmData: 330 MB, maxrss: 0.311184 MB Stage srcs finished: 2020-08-07T09:26:24.064997 Resources for stage srcs : 0.094 s worker CPU, 0.094 s worker Wall, Wall: 0.494 s, Cores in use: 1.12, Total efficiency (on 16 cores): 7.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:26:24.114463 Blob 1 of 15, id: 5, sources: 10, size: 173x142, npix 12670, brick X: 24,197, Y: 30,172, one pixel: 62 30 Blob 2 of 15, id: 10, sources: 4, size: 79x70, npix 3375, brick X: 160,239, Y: 169,239, one pixel: 230 169 Blob 3 of 15, id: 0, sources: 6, size: 57x73, npix 2917, brick X: 0,57, Y: 0,73, one pixel: 0 0 Blob 4 of 15, id: 1, sources: 4, size: 67x41, npix 1933, brick X: 85,152, Y: 0,41, one pixel: 93 0 Blob 5 of 15, id: 6, sources: 2, size: 41x53, npix 1294, brick X: 193,234, Y: 47,100, one pixel: 212 47 Blob 6 of 15, id: 7, sources: 2, size: 36x54, npix 1193, brick X: 24,60, Y: 118,172, one pixel: 38 118 Blob 7 of 15, id: 13, sources: 1, size: 34x33, npix 771, brick X: 66,100, Y: 196,229, one pixel: 80 196 Blob 8 of 15, id: 2, sources: 3, size: 33x31, npix 649, brick X: 169,202, Y: 0,31, one pixel: 175 0 Blob 9 of 15, id: 9, sources: 1, size: 34x29, npix 639, brick X: 177,211, Y: 146,175, one pixel: 195 146 Blob 10 of 15, id: 3, sources: 2, size: 33x36, npix 633, brick X: 206,239, Y: 4,40, one pixel: 223 4 Blob 11 of 15, id: 4, sources: 1, size: 33x32, npix 600, brick X: 153,186, Y: 19,51, one pixel: 162 19 Blob 12 of 15, id: 11, sources: 1, size: 25x25, npix 392, brick X: 53,78, Y: 174,199, one pixel: 63 174 Blob 13 of 15, id: 12, sources: 1, size: 24x23, npix 348, brick X: 136,160, Y: 184,207, one pixel: 145 184 Blob 14 of 15, id: 14, sources: 1, size: 22x19, npix 272, brick X: 15,37, Y: 220,239, one pixel: 24 220 Blob 15 of 15, id: 8, sources: 1, size: 22x20, npix 269, brick X: 212,234, Y: 130,150, one pixel: 221 130 Blob 13 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145596 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.50068, 34.29758), pm (-5.9, -16.0), parallax 0.943 with NanoMaggies: g=11.2, r=10.4, z=10 Reset brightness to NanoMaggies: g=11.2, r=10.4, z=10 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.50185, 34.33363), pm (-9.8, -4.4), parallax 0.320 with NanoMaggies: g=13.8, r=12.9, z=12.6 Reset brightness to NanoMaggies: g=13.8, r=12.9, z=12.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.50777, 34.34413), pm (0.7, -3.4), parallax 0.542 with NanoMaggies: g=14.6, r=14.2, z=14.1 Reset brightness to NanoMaggies: g=14.6, r=14.2, z=14.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.51165, 34.33832), pm (-6.2, -10.8), parallax 0.598 with NanoMaggies: g=15.1, r=14.7, z=14.6 Reset brightness to NanoMaggies: g=15.1, r=14.7, z=14.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.49786, 34.34806), pm (-1.7, -6.0), parallax 0.629 with NanoMaggies: g=11.7, r=(flux -5.35e+04), z=14.9 Reset brightness to NanoMaggies: g=17.5, r=16.6, z=16.3 Blob 3 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 812 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145104 MB Blob 14 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093784 MB Blob 12 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145324 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.094984 MB Blob 15 finished, total: Wall: 0.82 s, CPU: 0.81 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092824 MB Blob 11 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 795 MB, VmSize: 711 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.133504 MB Blob 10 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.094904 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.47970, 34.34673), pm (1.1, -12.5), parallax 1.779 with NanoMaggies: g=20.5, r=19, z=17.4 Reset brightness to NanoMaggies: g=20.5, r=19, z=17.4 Blob 8 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 815 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145904 MB Blob 6 finished, total: Wall: 1.18 s, CPU: 1.18 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146016 MB Measuring 1 iterative sources Blob 9 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146244 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.61 s, CPU: 1.61 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14636 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.47242, 34.36604), pm (-2.5, -12.8), parallax 0.695 with NanoMaggies: g=19.7, r=19.1, z=(flux -131) Reset brightness to NanoMaggies: g=19.7, r=19.1, z=19 Blob 2 finished, total: Wall: 1.75 s, CPU: 1.75 s, VmPeak: 670 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.096292 MB Blob 4 finished, total: Wall: 2.49 s, CPU: 2.49 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.096828 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.61663, ee1=-0.0444908, ee2=-0.00927348 Blob 1 finished, total: Wall: 7.06 s, CPU: 7.06 s, VmPeak: 691 MB, VmSize: 688 MB, VmRSS: 113 MB, VmData: 156 MB, maxrss: 0.116972 MB Old catalog: 51 New catalog: 40 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/blobs-custom-278485p34358.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/metrics/cus/all-models-custom-278485p34358.fits Stage fitblobs : Wall: 7.45 s, CPU: 0.35 s, VmPeak: 1075 MB, VmSize: 1075 MB, VmRSS: 304 MB, VmData: 330 MB, maxrss: 0.311348 MB Stage fitblobs finished: 2020-08-07T09:26:31.566562 Resources for stage fitblobs : 22.067 s worker CPU, 22.168 s worker Wall, Wall: 7.454 s, Cores in use: 3.01, Total efficiency (on 16 cores): 18.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:26:31.595401 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/tmp-legacysurvey-custom-278485p34358-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/tmp-legacysurvey-custom-278485p34358-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/tmp-legacysurvey-custom-278485p34358-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/tmp-legacysurvey-custom-278485p34358-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-resid.jpg Stage coadds : Wall: 2.54 s, CPU: 0.69 s, VmPeak: 1075 MB, VmSize: 1075 MB, VmRSS: 304 MB, VmData: 330 MB, maxrss: 0.311672 MB Stage coadds finished: 2020-08-07T09:26:34.135973 Resources for stage coadds : 9.359 s worker CPU, 10.108 s worker Wall, Wall: 2.542 s, Cores in use: 3.95, Total efficiency (on 16 cores): 24.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:26:34.159280 Cut to 1 unWISE tiles Reading WISE tile 2777p348 band 1 Reading WISE tile 2777p348 band 2 Reading WISE tile 2777p348 band 3 Reading WISE tile 2777p348 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 814 MB, VmSize: 798 MB, VmRSS: 142 MB, VmData: 172 MB, maxrss: 0.204808 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 817 MB, VmSize: 793 MB, VmRSS: 137 MB, VmData: 171 MB, maxrss: 0.199152 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 808 MB, VmSize: 800 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209148 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 815 MB, VmSize: 803 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.187824 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/tmp-legacysurvey-custom-278485p34358-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/tmp-legacysurvey-custom-278485p34358-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 22.43 s, CPU: 0.47 s, VmPeak: 1075 MB, VmSize: 1075 MB, VmRSS: 305 MB, VmData: 330 MB, maxrss: 0.312184 MB Stage wise_forced finished: 2020-08-07T09:26:56.586474 Resources for stage wise_forced : 2.950 s worker CPU, 44.176 s worker Wall, Wall: 22.429 s, Cores in use: 0.15, Total efficiency (on 16 cores): 1.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:26:56.608151 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/coadd/cus/custom-278485p34358/legacysurvey-custom-278485p34358-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/tractor-i/cus/tractor-custom-278485p34358.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/tractor/cus/tractor-custom-278485p34358.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/tractor/cus/brick-custom-278485p34358.sha256sum Stage writecat : Wall: 1.67 s, CPU: 0.66 s, VmPeak: 1207 MB, VmSize: 1079 MB, VmRSS: 307 MB, VmData: 330 MB, maxrss: 0.445068 MB Stage writecat finished: 2020-08-07T09:26:58.278205 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.672 s, Cores in use: 0.40, Total efficiency (on 16 cores): 2.5 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2047936/PGC2047936-largegalaxy-writecat.p All done: 39.641 s worker CPU, 492.947 s worker Wall, Wall: 161.893 s, Cores in use: 0.33, Total efficiency (on 16 cores): 2.1 % Finished galaxy PGC2047936 in 2.747 minutes.