Started working on galaxy PGC2335227 at Sun Jun 7 16:33:20 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.0344415 49.164001500000005 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T16:33:28.186045 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.0344415', '49.164001500000005', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.0344415 49.164001500000005 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 276.0344415 49.164001500000005 Starting process 60095 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.057332 MB Starting process 60096 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.057332 MB Starting process 60097 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.057336 MB Starting process 60098 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.05734 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T16:33:28.729703 Keeping 9 CCDs: k4m_170805_073638_ooi_zd_ls9.fits.fz k4m_170805_073638_ooi_zd_ls9-CCD3 z exptime 98.104 propid 2016A-0453 seeing 0.89 MJD 57970.317 object MzLS_646258_z k4m_170901_060524_ooi_zd_ls9.fits.fz k4m_170901_060524_ooi_zd_ls9-CCD1 z exptime 131.104 propid 2016A-0453 seeing 0.90 MJD 57997.254 object MzLS_647078_z k4m_160516_101827_ooi_zd_ls9.fits.fz k4m_160516_101827_ooi_zd_ls9-CCD4 z exptime 80.103 propid 2016A-0453 seeing 0.96 MJD 57524.429 object MzLS_645435_z ksb_160611_105048_ooi_r_ls9.fits.fz ksb_160611_105048_ooi_r_ls9-CCD3 r exptime 65.6 propid BASS seeing 1.06 MJD 57550.452 object 26051 ksb_170604_105818_ooi_g_ls9.fits.fz ksb_170604_105818_ooi_g_ls9-CCD3 g exptime 101.086 propid BASS seeing 1.23 MJD 57908.457 object 26051 ksb_160612_105059_ooi_r_ls9.fits.fz ksb_160612_105059_ooi_r_ls9-CCD2 r exptime 82.9 propid BASS seeing 1.26 MJD 57551.452 object 26042 ksb_160706_095320_ooi_g_ls9.fits.fz ksb_160706_095320_ooi_g_ls9-CCD2 g exptime 173.2 propid BASS seeing 2.18 MJD 57575.412 object 26042 ksb_170624_101848_ooi_r_ls9.fits.fz ksb_170624_101848_ooi_r_ls9-CCD3 r exptime 127.3 propid BASS seeing 1.67 MJD 57928.430 object 26053 ksb_160709_101757_ooi_g_ls9.fits.fz ksb_160709_101757_ooi_g_ls9-CCD3 g exptime 166.2 propid BASS seeing 2.08 MJD 57578.429 object 26053 mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2225 2468 and amp range 2048 4095 and image y 446 686 and amp range 0 2021 Range in image: x 0 244 , y 0 241 (with image size 244 x 241) dzp -0.0006399284 -> scaling image by 0.9994107778325068 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3834 4046 and amp range 2006 4053 and image y 3309 3556 and amp range 2040 4078 Range in image: x 0 213 , y 0 248 (with image size 213 x 248) dzp 0.0056365696 -> scaling image by 1.005204971477435 Faked up EXPNUM 75500183 Faked up EXPNUM 75500183 Faked up EXPNUM 75500183 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2754 2893 and amp range 2016 4031 and image y 2972 3111 and amp range 2048 4095 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp -0.0005558773 -> scaling image by 0.99948814914245 mosaic get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1064 1310 and amp range 0 2005 and image y 1504 1749 and amp range 0 2039 Range in image: x 0 247 , y 0 246 (with image size 247 x 246) dzp 0.009508088 -> scaling image by 1.0087957299815176 Faked up EXPNUM 79080200 Faked up EXPNUM 79080200 Faked up EXPNUM 79080200 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2756 2895 and amp range 2016 4031 and image y 2983 3122 and amp range 2048 4095 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp -0.02530836 -> scaling image by 0.9769597156943128 Faked up EXPNUM 75750117 Faked up EXPNUM 75750117 Faked up EXPNUM 75750117 90prime get_fwhm: self.fwhm = 4.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 516 656 and amp range 0 2015 and image y 1437 1578 and amp range 0 2047 Range in image: x 0 141 , y 0 142 (with image size 141 x 142) dzp -0.008523628 -> scaling image by 0.992180183483648 Faked up EXPNUM 75510133 Faked up EXPNUM 75510133 Faked up EXPNUM 75510133 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 508 648 and amp range 0 2015 and image y 1425 1566 and amp range 0 2047 Range in image: x 0 141 , y 0 142 (with image size 141 x 142) dzp -0.006045583 -> scaling image by 0.9944472857505693 Faked up EXPNUM 75780123 Faked up EXPNUM 75780123 Faked up EXPNUM 75780123 90prime get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 763 902 and amp range 0 2015 and image y 982 1122 and amp range 0 2047 Range in image: x 0 140 , y 0 141 (with image size 140 x 141) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 79280162 Faked up EXPNUM 79280162 Faked up EXPNUM 79280162 90prime get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 697 836 and amp range 0 2015 and image y 952 1091 and amp range 0 2047 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp -0.043123975 -> scaling image by 0.961059796099719 Stage tims : Wall: 20.35 s, CPU: 1.13 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 203 MB, maxrss: 0.566484 MB Stage tims finished: 2020-06-07T16:33:49.077486 Resources for stage tims : 2.890 s worker CPU, 42.481 s worker Wall, Wall: 20.349 s, Cores in use: 0.20, Total efficiency (on 4 cores): 4.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T16:33:49.094226 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01597.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01486.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01598.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/reference-custom-276034p49164.fits Stage refs : Wall: 7.47 s, CPU: 5.20 s, VmPeak: 1005 MB, VmSize: 999 MB, VmRSS: 230 MB, VmData: 262 MB, maxrss: 0.566484 MB Stage refs finished: 2020-06-07T16:33:56.566971 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.474 s, Cores in use: 0.70, Total efficiency (on 4 cores): 17.4 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T16:33:56.568435 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outlier-mask-custom-276034p49164.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outliers-pre-custom-276034p49164.jpg Image ksb_160709_101757_ooi_g_ls9-CCD3 g : masking 84 positive outlier pixels and 0 negative outlier pixels Image ksb_160611_105048_ooi_r_ls9-CCD3 r : masking 99 positive outlier pixels and 0 negative outlier pixels Image ksb_170624_101848_ooi_r_ls9-CCD3 r : masking 111 positive outlier pixels and 0 negative outlier pixels Image k4m_170805_073638_ooi_zd_ls9-CCD3 z : masking 282 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outlier-mask-custom-276034p49164.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outliers-post-custom-276034p49164.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outliers-masked-pos-custom-276034p49164.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outliers-masked-neg-custom-276034p49164.jpg Stage outliers : Wall: 1.09 s, CPU: 0.86 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 242 MB, VmData: 272 MB, maxrss: 0.566484 MB Stage outliers finished: 2020-06-07T16:33:57.658657 Resources for stage outliers : 0.697 s worker CPU, 0.698 s worker Wall, Wall: 1.091 s, Cores in use: 1.43, Total efficiency (on 4 cores): 35.6 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T16:33:57.660347 Stage halos : Wall: 0.42 s, CPU: 0.41 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 242 MB, VmData: 272 MB, maxrss: 0.566484 MB Stage halos finished: 2020-06-07T16:33:58.078078 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.419 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.6 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T16:33:58.079828 PSF sigmas in coadd pixels: ['1.99', '3.54', '3.38'] Using average PSF sigma 2.9702007700352056 Gaussian PSF norm 0.0949749911251065 vs pixelized 0.07129414 average tim pixel scale / coadd scale: 1.729134903893671 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.73', '2.04', '2.71'] Using average PSF sigma 2.1608971638640697 Gaussian PSF norm 0.130545218204388 vs pixelized 0.11330584 average tim pixel scale / coadd scale: 1.7292396776833152 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.44', '1.46', '1.56'] Using average PSF sigma 1.4884562908605137 Gaussian PSF norm 0.18952171689958874 vs pixelized 0.15674691 average tim pixel scale / coadd scale: 0.9908973490854881 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.16 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 244 MB, VmData: 272 MB, maxrss: 0.566484 MB Stage fit_on_coadds finished: 2020-06-07T16:33:58.251182 Resources for stage fit_on_coadds : 0.133 s worker CPU, 0.133 s worker Wall, Wall: 0.173 s, Cores in use: 1.69, Total efficiency (on 4 cores): 42.2 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T16:33:58.253890 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 20 potential peaks Of 20 potential peaks: 6 in veto map, 2 cut by saddle test, 0 cut by aper test, 12 kept SED z : 12 new peaks Found 14 potential peaks Of 14 potential peaks: 12 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 8 potential peaks Of 8 potential peaks: 7 in veto map, 0 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 20 potential peaks Of 20 potential peaks: 18 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 21 potential peaks Of 21 potential peaks: 19 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 14 new sources Median coadd sky for g : 2.8757462e-05 Median coadd sky for r : -0.00021984446 Median coadd sky for z : -0.0002460427 Stage srcs : Wall: 0.61 s, CPU: 0.57 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 244 MB, VmData: 272 MB, maxrss: 0.566484 MB Stage srcs finished: 2020-06-07T16:33:58.865338 Resources for stage srcs : 0.098 s worker CPU, 0.106 s worker Wall, Wall: 0.612 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T16:33:58.877700 Blob 1 of 12, id: 5, sources: 5, size: 125x126, npix 10197, brick X: 68,193, Y: 57,183, one pixel: 123 57 Blob 2 of 12, id: 0, sources: 2, size: 47x51, npix 1680, brick X: 49,96, Y: 0,51, one pixel: 59 0 Blob 3 of 12, id: 7, sources: 1, size: 39x39, npix 1055, brick X: 5,44, Y: 90,129, one pixel: 22 90 Blob 4 of 12, id: 2, sources: 3, size: 49x26, npix 916, brick X: 190,239, Y: 0,26, one pixel: 213 0 Blob 5 of 12, id: 4, sources: 1, size: 27x36, npix 696, brick X: 0,27, Y: 56,92, one pixel: 7 56 Blob 3 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 875 MB, VmSize: 779 MB, VmRSS: 137 MB, VmData: 180 MB, maxrss: 0.1401 MB Blob 6 of 12, id: 9, sources: 2, size: 28x36, npix 584, brick X: 183,211, Y: 116,152, one pixel: 194 116 Blob 5 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 875 MB, VmSize: 779 MB, VmRSS: 137 MB, VmData: 180 MB, maxrss: 0.1401 MB Blob 7 of 12, id: 3, sources: 1, size: 23x25, npix 362, brick X: 199,222, Y: 44,69, one pixel: 210 44 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (275.38594, 49.12181), pm (-23.8, 51.7), parallax 5.116 with NanoMaggies: g=5.58, r=4.15, z=2.93 Reset brightness to NanoMaggies: g=5.58, r=4.15, z=2.93 Blob 4 finished, total: Wall: 2.12 s, CPU: 2.12 s, VmPeak: 874 MB, VmSize: 779 MB, VmRSS: 138 MB, VmData: 180 MB, maxrss: 0.141392 MB Blob 8 of 12, id: 11, sources: 1, size: 21x25, npix 347, brick X: 218,239, Y: 204,229, one pixel: 230 204 Blob 9 of 12, id: 6, sources: 1, size: 23x23, npix 326, brick X: 173,196, Y: 79,102, one pixel: 183 79 Blob 6 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 875 MB, VmSize: 779 MB, VmRSS: 137 MB, VmData: 180 MB, maxrss: 0.1401 MB Blob 10 of 12, id: 8, sources: 1, size: 23x22, npix 304, brick X: 209,232, Y: 109,131, one pixel: 220 109 Measuring 1 iterative sources Blob 7 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 874 MB, VmSize: 779 MB, VmRSS: 138 MB, VmData: 180 MB, maxrss: 0.141652 MB Blob 11 of 12, id: 1, sources: 2, size: 26x16, npix 291, brick X: 97,123, Y: 0,16, one pixel: 101 0 Blob 9 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 874 MB, VmSize: 779 MB, VmRSS: 138 MB, VmData: 180 MB, maxrss: 0.141652 MB Blob 12 of 12, id: 10, sources: 1, size: 18x18, npix 180, brick X: 9,27, Y: 138,156, one pixel: 17 138 Blob 2 finished, total: Wall: 3.12 s, CPU: 3.11 s, VmPeak: 874 MB, VmSize: 779 MB, VmRSS: 138 MB, VmData: 180 MB, maxrss: 0.141768 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.03569, 49.15487), pm (-2.8, -6.0), parallax 0.537 with NanoMaggies: g=20.6, r=19, z=18.7 Reset brightness to NanoMaggies: g=20.2, r=19.1, z=18.5 Blob 11 finished, total: Wall: 0.13 s, CPU: 0.13 s, VmPeak: 874 MB, VmSize: 779 MB, VmRSS: 138 MB, VmData: 180 MB, maxrss: 0.141768 MB Blob 8 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 875 MB, VmSize: 779 MB, VmRSS: 137 MB, VmData: 180 MB, maxrss: 0.1401 MB Blob 12 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 874 MB, VmSize: 779 MB, VmRSS: 138 MB, VmData: 180 MB, maxrss: 0.141768 MB Blob 10 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 874 MB, VmSize: 779 MB, VmRSS: 138 MB, VmData: 180 MB, maxrss: 0.141652 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.53193, ee1=-0.00653973, ee2=-0.138432 Measuring 5 iterative sources Blob 1 finished, total: Wall: 9.61 s, CPU: 9.60 s, VmPeak: 878 MB, VmSize: 779 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14456 MB Old catalog: 23 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/blobs-custom-276034p49164.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/all-models-custom-276034p49164.fits Stage fitblobs : Wall: 10.15 s, CPU: 0.55 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 244 MB, VmData: 272 MB, maxrss: 0.566484 MB Stage fitblobs finished: 2020-06-07T16:34:09.024283 Resources for stage fitblobs : 19.734 s worker CPU, 19.753 s worker Wall, Wall: 10.148 s, Cores in use: 2.00, Total efficiency (on 4 cores): 50.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T16:34:09.026190 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-resid.jpg Stage coadds : Wall: 1.07 s, CPU: 0.48 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 245 MB, VmData: 272 MB, maxrss: 0.566484 MB Stage coadds finished: 2020-06-07T16:34:10.097883 Resources for stage coadds : 1.772 s worker CPU, 1.831 s worker Wall, Wall: 1.073 s, Cores in use: 2.10, Total efficiency (on 4 cores): 52.4 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T16:34:10.099591 Cut to 1 unWISE tiles Reading WISE tile 2767p484 band 1 Reading WISE tile 2767p484 band 2 Reading WISE tile 2767p484 band 4 Reading WISE tile 2767p484 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 874 MB, VmSize: 860 MB, VmRSS: 147 MB, VmData: 178 MB, maxrss: 0.18936 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 874 MB, VmSize: 854 MB, VmRSS: 140 MB, VmData: 172 MB, maxrss: 0.204372 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 875 MB, VmSize: 854 MB, VmRSS: 140 MB, VmData: 172 MB, maxrss: 0.202984 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 878 MB, VmSize: 858 MB, VmRSS: 145 MB, VmData: 176 MB, maxrss: 0.209068 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.25 s, CPU: 0.37 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 245 MB, VmData: 272 MB, maxrss: 0.566484 MB Stage wise_forced finished: 2020-06-07T16:34:12.352730 Resources for stage wise_forced : 4.678 s worker CPU, 6.265 s worker Wall, Wall: 2.254 s, Cores in use: 2.24, Total efficiency (on 4 cores): 56.0 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T16:34:12.354465 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/tractor-i/cus/tractor-custom-276034p49164.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/tractor/cus/tractor-custom-276034p49164.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/tractor/cus/brick-custom-276034p49164.sha256sum Stage writecat : Wall: 0.66 s, CPU: 0.43 s, VmPeak: 1141 MB, VmSize: 1013 MB, VmRSS: 247 MB, VmData: 272 MB, maxrss: 0.566484 MB Stage writecat finished: 2020-06-07T16:34:13.015805 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.662 s, Cores in use: 0.66, Total efficiency (on 4 cores): 16.4 % Stage writecat finished All done: 30.004 s worker CPU, 71.268 s worker Wall, Wall: 44.291 s, Cores in use: 0.91, Total efficiency (on 4 cores): 22.7 % Finished galaxy PGC2335227 in 0.885 minutes. Started working on galaxy PGC2335227 at Fri Aug 7 09:19:50 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.0340095033787 49.164145118808655 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:19:51.294959 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.0340095033787', '49.164145118808655', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.0340095033787 49.164145118808655 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 276.0340095033787 49.164145118808655 Starting process 19926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 19927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 19931 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 19932 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 19933 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19934 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19935 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19936 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19937 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19938 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19939 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19940 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19941 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:19:52.535741 Keeping 9 CCDs: k4m_170805_073638_ooi_zd_ls9-CCD3 z expnum 3135802 exptime 98.104 propid 2016A-0453 seeing 0.89 MJD 57970.317 object MzLS_646258_z mosaic/CP/V4.3/CP20170804/k4m_170805_073638_ooi_zd_ls9.fits.fz k4m_170901_060524_ooi_zd_ls9-CCD1 z expnum 137620 exptime 131.104 propid 2016A-0453 seeing 0.90 MJD 57997.254 object MzLS_647078_z mosaic/CP/V4.3/CP20170831/k4m_170901_060524_ooi_zd_ls9.fits.fz k4m_160516_101827_ooi_zd_ls9-CCD4 z expnum 89302 exptime 80.103 propid 2016A-0453 seeing 0.96 MJD 57524.429 object MzLS_645435_z mosaic/CP/V4.3/CP20160515/k4m_160516_101827_ooi_zd_ls9.fits.fz ksb_160611_105048_ooi_r_ls9-CCD3 r expnum 75500183 exptime 65.6 propid BASS seeing 1.06 MJD 57550.452 object 26051 90prime/CP/V2.3/CP20160610/ksb_160611_105048_ooi_r_ls9.fits.fz ksb_170604_105818_ooi_g_ls9-CCD3 g expnum 79080200 exptime 101.086 propid BASS seeing 1.23 MJD 57908.457 object 26051 90prime/CP/V2.3/CP20170603/ksb_170604_105818_ooi_g_ls9.fits.fz ksb_160612_105059_ooi_r_ls9-CCD2 r expnum 75510133 exptime 82.9 propid BASS seeing 1.26 MJD 57551.452 object 26042 90prime/CP/V2.3/CP20160611/ksb_160612_105059_ooi_r_ls9.fits.fz ksb_160706_095320_ooi_g_ls9-CCD2 g expnum 75750117 exptime 173.2 propid BASS seeing 2.18 MJD 57575.412 object 26042 90prime/CP/V2.3/CP20160705/ksb_160706_095320_ooi_g_ls9.fits.fz ksb_170624_101848_ooi_r_ls9-CCD3 r expnum 79280162 exptime 127.3 propid BASS seeing 1.67 MJD 57928.430 object 26053 90prime/CP/V2.3/CP20170623/ksb_170624_101848_ooi_r_ls9.fits.fz ksb_160709_101757_ooi_g_ls9-CCD3 g expnum 75780123 exptime 166.2 propid BASS seeing 2.08 MJD 57578.429 object 26053 90prime/CP/V2.3/CP20160708/ksb_160709_101757_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1066 1312 and amp range 0 2005 and image y 1500 1745 and amp range 0 2039 Range in image: x 0 247 , y 0 246 (with image size 247 x 246) dzp 0.009508088 -> scaling image by 1.0087957299815176 mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2227 2470 and amp range 2048 4095 and image y 442 683 and amp range 0 2021 Range in image: x 0 244 , y 0 242 (with image size 244 x 242) dzp -0.0006399284 -> scaling image by 0.9994107778325068 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3836 4046 and amp range 2006 4053 and image y 3306 3552 and amp range 2040 4078 Range in image: x 0 211 , y 0 247 (with image size 211 x 247) dzp 0.0056365696 -> scaling image by 1.005204971477435 Faked up EXPNUM 75750117 Faked up EXPNUM 75750117 Faked up EXPNUM 75750117 90prime get_fwhm: self.fwhm = 4.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 515 655 and amp range 0 2015 and image y 1439 1580 and amp range 0 2047 Range in image: x 0 141 , y 0 142 (with image size 141 x 142) dzp -0.008523628 -> scaling image by 0.992180183483648 Faked up EXPNUM 75500183 Faked up EXPNUM 75500183 Faked up EXPNUM 75500183 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2753 2892 and amp range 2016 4031 and image y 2974 3113 and amp range 2048 4095 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 79080200 Faked up EXPNUM 79080200 Faked up EXPNUM 79080200 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2754 2894 and amp range 2016 4031 and image y 2985 3124 and amp range 2048 4095 Range in image: x 0 141 , y 0 140 (with image size 141 x 140) dzp -0.02530836 -> scaling image by 0.9769597156943128 Faked up EXPNUM 75780123 Faked up EXPNUM 75780123 Faked up EXPNUM 75780123 90prime get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 761 901 and amp range 0 2015 and image y 985 1124 and amp range 0 2047 Range in image: x 0 141 , y 0 140 (with image size 141 x 140) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 75510133 Faked up EXPNUM 75510133 Faked up EXPNUM 75510133 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 507 647 and amp range 0 2015 and image y 1427 1568 and amp range 0 2047 Range in image: x 0 141 , y 0 142 (with image size 141 x 142) dzp -0.006045583 -> scaling image by 0.9944472857505693 Faked up EXPNUM 79280162 Faked up EXPNUM 79280162 Faked up EXPNUM 79280162 90prime get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 696 835 and amp range 0 2015 and image y 954 1093 and amp range 0 2047 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp -0.043123975 -> scaling image by 0.961059796099719 Stage tims : Wall: 57.68 s, CPU: 1.35 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.176008 MB Stage tims finished: 2020-08-07T09:20:50.212970 Resources for stage tims : 4.161 s worker CPU, 334.121 s worker Wall, Wall: 57.679 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:20:50.353060 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01597.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01486.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01598.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/reference-custom-276034p49164.fits Stage refs : Wall: 5.08 s, CPU: 4.52 s, VmPeak: 1015 MB, VmSize: 1010 MB, VmRSS: 233 MB, VmData: 264 MB, maxrss: 0.238684 MB Stage refs finished: 2020-08-07T09:20:55.435753 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.084 s, Cores in use: 0.89, Total efficiency (on 16 cores): 5.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:20:55.555925 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outlier-mask-custom-276034p49164.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outliers-pre-custom-276034p49164.jpg Image ksb_160709_101757_ooi_g_ls9-CCD3 g : masking 83 positive outlier pixels and 0 negative outlier pixels Image ksb_160611_105048_ooi_r_ls9-CCD3 r : masking 99 positive outlier pixels and 0 negative outlier pixels Image ksb_170624_101848_ooi_r_ls9-CCD3 r : masking 112 positive outlier pixels and 0 negative outlier pixels Image k4m_170805_073638_ooi_zd_ls9-CCD3 z : masking 216 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outlier-mask-custom-276034p49164.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outliers-post-custom-276034p49164.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outliers-masked-pos-custom-276034p49164.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/outliers-masked-neg-custom-276034p49164.jpg Stage outliers : Wall: 0.79 s, CPU: 0.51 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 246 MB, VmData: 275 MB, maxrss: 0.251636 MB Stage outliers finished: 2020-08-07T09:20:56.347974 Resources for stage outliers : 0.584 s worker CPU, 0.743 s worker Wall, Wall: 0.793 s, Cores in use: 1.38, Total efficiency (on 16 cores): 8.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:20:56.477288 Stage halos : Wall: 0.24 s, CPU: 0.20 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 246 MB, VmData: 275 MB, maxrss: 0.251636 MB Stage halos finished: 2020-08-07T09:20:56.717211 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.241 s, Cores in use: 0.84, Total efficiency (on 16 cores): 5.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:20:56.816543 PSF sigmas in coadd pixels: ['1.99', '3.54', '3.38'] Using average PSF sigma 2.9702007700352056 Gaussian PSF norm 0.0949749911251065 vs pixelized 0.07129386 average tim pixel scale / coadd scale: 1.729134903893671 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.73', '2.04', '2.71'] Using average PSF sigma 2.1608971638640697 Gaussian PSF norm 0.130545218204388 vs pixelized 0.11328823 average tim pixel scale / coadd scale: 1.7292396776833152 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.44', '1.46', '1.56'] Using average PSF sigma 1.4884562908605137 Gaussian PSF norm 0.18952171689958874 vs pixelized 0.15674102 average tim pixel scale / coadd scale: 0.9908973490854881 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.13 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 248 MB, VmData: 276 MB, maxrss: 0.253872 MB Stage fit_on_coadds finished: 2020-08-07T09:20:56.967077 Resources for stage fit_on_coadds : 0.110 s worker CPU, 0.110 s worker Wall, Wall: 0.152 s, Cores in use: 1.59, Total efficiency (on 16 cores): 9.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:20:56.990604 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 21 potential peaks Of 21 potential peaks: 7 in veto map, 2 cut by saddle test, 0 cut by aper test, 12 kept SED z : 12 new peaks Found 14 potential peaks Of 14 potential peaks: 12 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 7 potential peaks Of 7 potential peaks: 7 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 19 potential peaks Of 19 potential peaks: 17 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 21 potential peaks Of 21 potential peaks: 19 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 13 new sources Median coadd sky for g : 2.5912997e-05 Median coadd sky for r : -0.00022271185 Median coadd sky for z : -0.00018125295 Stage srcs : Wall: 0.44 s, CPU: 0.41 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 248 MB, VmData: 276 MB, maxrss: 0.25446 MB Stage srcs finished: 2020-08-07T09:20:57.432369 Resources for stage srcs : 0.063 s worker CPU, 0.063 s worker Wall, Wall: 0.443 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:20:57.448832 Blob 1 of 12, id: 4, sources: 4, size: 125x126, npix 10239, brick X: 64,189, Y: 55,181, one pixel: 119 55 Blob 2 of 12, id: 0, sources: 2, size: 47x49, npix 1629, brick X: 45,92, Y: 0,49, one pixel: 54 0 Blob 3 of 12, id: 6, sources: 1, size: 39x39, npix 1073, brick X: 1,40, Y: 88,127, one pixel: 19 88 Blob 4 of 12, id: 1, sources: 2, size: 52x24, npix 924, brick X: 187,239, Y: 0,24, one pixel: 208 0 Blob 5 of 12, id: 8, sources: 2, size: 28x36, npix 586, brick X: 179,207, Y: 114,150, one pixel: 190 114 Blob 6 of 12, id: 3, sources: 1, size: 23x36, npix 582, brick X: 0,23, Y: 54,90, one pixel: 5 54 Blob 7 of 12, id: 10, sources: 1, size: 24x25, npix 398, brick X: 215,239, Y: 202,227, one pixel: 226 202 Blob 8 of 12, id: 2, sources: 1, size: 24x24, npix 364, brick X: 195,219, Y: 43,67, one pixel: 204 43 Blob 9 of 12, id: 5, sources: 1, size: 23x23, npix 326, brick X: 169,192, Y: 77,100, one pixel: 179 77 Blob 10 of 12, id: 7, sources: 1, size: 22x22, npix 303, brick X: 206,228, Y: 107,129, one pixel: 216 107 Blob 11 of 12, id: 9, sources: 1, size: 19x18, npix 189, brick X: 5,24, Y: 136,154, one pixel: 13 136 Blob 12 of 12, id: 11, sources: 1, size: 17x10, npix 96, brick X: 184,201, Y: 229,239, one pixel: 192 229 Blob 11 finished, total: Wall: 0.09 s, CPU: 0.08 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 138 MB, maxrss: 0.088208 MB Blob 12 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145248 MB Blob 9 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 815 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14622 MB Blob 10 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145432 MB Blob 7 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145008 MB Blob 8 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093304 MB Blob 6 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09268 MB Blob 5 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146288 MB Blob 3 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093448 MB Blob 4 finished, total: Wall: 1.45 s, CPU: 1.44 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093212 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.11 s, CPU: 2.11 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146424 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.38208, ee1=-0.0122436, ee2=-0.145813 Measuring 4 iterative sources Blob 1 finished, total: Wall: 5.10 s, CPU: 5.10 s, VmPeak: 812 MB, VmSize: 728 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148964 MB Old catalog: 22 New catalog: 21 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/blobs-custom-276034p49164.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/metrics/cus/all-models-custom-276034p49164.fits Stage fitblobs : Wall: 5.49 s, CPU: 0.29 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 249 MB, VmData: 276 MB, maxrss: 0.254624 MB Stage fitblobs finished: 2020-08-07T09:21:02.938037 Resources for stage fitblobs : 12.904 s worker CPU, 12.973 s worker Wall, Wall: 5.491 s, Cores in use: 2.40, Total efficiency (on 16 cores): 15.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:21:03.015756 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-resid.jpg Stage coadds : Wall: 1.70 s, CPU: 0.51 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 249 MB, VmData: 276 MB, maxrss: 0.254948 MB Stage coadds finished: 2020-08-07T09:21:04.720422 Resources for stage coadds : 8.813 s worker CPU, 9.352 s worker Wall, Wall: 1.706 s, Cores in use: 5.46, Total efficiency (on 16 cores): 34.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:21:04.735372 Cut to 1 unWISE tiles Reading WISE tile 2767p484 band 1 Reading WISE tile 2767p484 band 2 Reading WISE tile 2767p484 band 3 Reading WISE tile 2767p484 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 811 MB, VmSize: 802 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.187752 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.206644 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 807 MB, VmSize: 800 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.207052 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p484/unwise-2767p484-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 800 MB, VmSize: 797 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.204256 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/tmp-legacysurvey-custom-276034p49164-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 17.88 s, CPU: 0.45 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 249 MB, VmData: 276 MB, maxrss: 0.25546 MB Stage wise_forced finished: 2020-08-07T09:21:22.612472 Resources for stage wise_forced : 2.911 s worker CPU, 18.852 s worker Wall, Wall: 17.879 s, Cores in use: 0.19, Total efficiency (on 16 cores): 1.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:21:22.625791 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/coadd/cus/custom-276034p49164/legacysurvey-custom-276034p49164-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/tractor-i/cus/tractor-custom-276034p49164.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/tractor/cus/tractor-custom-276034p49164.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/tractor/cus/brick-custom-276034p49164.sha256sum Stage writecat : Wall: 0.79 s, CPU: 0.49 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 251 MB, VmData: 276 MB, maxrss: 0.388344 MB Stage writecat finished: 2020-08-07T09:21:23.410887 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.787 s, Cores in use: 0.63, Total efficiency (on 16 cores): 3.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2335227/PGC2335227-largegalaxy-writecat.p All done: 29.550 s worker CPU, 376.217 s worker Wall, Wall: 90.892 s, Cores in use: 0.42, Total efficiency (on 16 cores): 2.6 % Finished galaxy PGC2335227 in 1.564 minutes.