Started working on galaxy PGC2040782 at Sun Jun 7 19:31:53 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.53270150000003 33.904098499999996 --width 275 --height 275 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T19:31:56.024589 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.53270150000003', '33.904098499999996', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.53270150000003 33.904098499999996 --width 275 --height 275 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 277.53270150000003 33.904098499999996 Starting process 58517 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057464 MB Starting process 58518 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057588 MB Starting process 58519 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057588 MB Starting process 58520 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057528 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T19:31:56.522618 Keeping 10 CCDs: k4m_160429_111219_ooi_zd_ls9.fits.fz k4m_160429_111219_ooi_zd_ls9-CCD3 z exptime 87.103 propid 2016A-0453 seeing 1.13 MJD 57507.467 object MzLS_574258_z k4m_170929_040652_ooi_zd_ls9.fits.fz k4m_170929_040652_ooi_zd_ls9-CCD1 z exptime 135.103 propid 2016A-0453 seeing 0.94 MJD 58025.171 object MzLS_573220_z k4m_160416_120722_ooi_zd_ls9.fits.fz k4m_160416_120722_ooi_zd_ls9-CCD1 z exptime 171.102 propid 2016A-0453 seeing 2.00 MJD 57494.505 object MzLS_574259_z k4m_170616_112323_ooi_zd_ls9.fits.fz k4m_170616_112323_ooi_zd_ls9-CCD4 z exptime 131.104 propid 2016A-0453 seeing 0.97 MJD 57920.475 object MzLS_572178_z ksb_160602_085337_ooi_g_ls9.fits.fz ksb_160602_085337_ooi_g_ls9-CCD4 g exptime 126.7 propid BASS seeing 1.26 MJD 57541.371 object 60732 ksb_160510_110400_ooi_r_ls9.fits.fz ksb_160510_110400_ooi_r_ls9-CCD4 r exptime 63.5 propid BASS seeing 1.11 MJD 57518.461 object 60732 ksb_180509_110749_ooi_r_ls9.fits.fz ksb_180509_110749_ooi_r_ls9-CCD1 r exptime 109.421 propid NOTBASS seeing 1.23 MJD 58247.464 object 60733 ksb_160628_065420_ooi_g_ls9.fits.fz ksb_160628_065420_ooi_g_ls9-CCD1 g exptime 110.8 propid BASS seeing 1.59 MJD 57567.288 object 60733 ksb_160504_105239_ooi_g_ls9.fits.fz ksb_160504_105239_ooi_g_ls9-CCD2 g exptime 107.6 propid BASS seeing 1.59 MJD 57512.453 object 60731 ksb_160430_105803_ooi_r_ls9.fits.fz ksb_160430_105803_ooi_r_ls9-CCD2 r exptime 105.6 propid BASS seeing 1.17 MJD 57508.457 object 60731 mosaic get_fwhm: self.fwhm = 4.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 873 1157 and amp range 0 2005 and image y 3859 4072 and amp range 2040 4078 Range in image: x 0 285 , y 0 214 (with image size 285 x 214) dzp 0.0022078273 -> scaling image by 1.0020355530120029 mosaic get_fwhm: self.fwhm = 3.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2087 2366 and amp range 2048 4095 and image y 242 519 and amp range 0 2021 Range in image: x 0 280 , y 0 278 (with image size 280 x 278) dzp -0.03444113 -> scaling image by 0.9687763957004109 mosaic get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3570 3847 and amp range 2006 4053 and image y 2502 2779 and amp range 2040 4078 Range in image: x 0 278 , y 0 278 (with image size 278 x 278) dzp 0.0036595785 -> scaling image by 1.003376283213225 mosaic get_fwhm: self.fwhm = 7.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 859 1145 and amp range 0 2005 and image y 152 440 and amp range 0 2039 Range in image: x 0 287 , y 0 289 (with image size 287 x 289) dzp -0.011066288 -> scaling image by 0.989859339076806 Faked up EXPNUM 75180256 Faked up EXPNUM 75180256 Faked up EXPNUM 75180256 90prime get_fwhm: self.fwhm = 2.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2603 2764 and amp range 2016 4031 and image y 21 182 and amp range 0 2047 Range in image: x 0 162 , y 0 162 (with image size 162 x 162) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Faked up EXPNUM 75670097 Faked up EXPNUM 75670097 Faked up EXPNUM 75670097 90prime get_fwhm: self.fwhm = 3.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2736 2898 and amp range 2016 4031 and image y 493 656 and amp range 0 2047 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp -0.0032519526 -> scaling image by 0.9970093219958882 Faked up EXPNUM 82470198 Faked up EXPNUM 82470198 Faked up EXPNUM 82470198 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2740 2903 and amp range 2016 4031 and image y 486 649 and amp range 0 2047 Range in image: x 0 164 , y 0 164 (with image size 164 x 164) dzp -0.03177219 -> scaling image by 0.9711607558798585 Faked up EXPNUM 75410139 Faked up EXPNUM 75410139 Faked up EXPNUM 75410139 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2605 2766 and amp range 2016 4031 and image y 15 172 and amp range 0 2047 Range in image: x 0 162 , y 0 158 (with image size 162 x 158) dzp 0.010226944 -> scaling image by 1.0094638657706572 Faked up EXPNUM 75120209 Faked up EXPNUM 75120209 Faked up EXPNUM 75120209 90prime get_fwhm: self.fwhm = 3.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 599 759 and amp range 0 2015 and image y 2489 2650 and amp range 2048 4095 Range in image: x 0 161 , y 0 162 (with image size 161 x 162) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75080190 Faked up EXPNUM 75080190 Faked up EXPNUM 75080190 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 600 760 and amp range 0 2015 and image y 2492 2653 and amp range 2048 4095 Range in image: x 0 161 , y 0 162 (with image size 161 x 162) dzp 0.016961161 -> scaling image by 1.0157444649385616 Stage tims : Wall: 6.23 s, CPU: 0.89 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.566584 MB Stage tims finished: 2020-06-07T19:32:02.756150 Resources for stage tims : 3.681 s worker CPU, 14.327 s worker Wall, Wall: 6.235 s, Cores in use: 0.73, Total efficiency (on 4 cores): 18.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T19:32:02.917329 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02722.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02850.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02723.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02594.fits Matched 15 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/reference-custom-277532p33904.fits Stage refs : Wall: 11.43 s, CPU: 10.00 s, VmPeak: 1056 MB, VmSize: 1050 MB, VmRSS: 283 MB, VmData: 314 MB, maxrss: 0.566584 MB Stage refs finished: 2020-06-07T19:32:14.347576 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.431 s, Cores in use: 0.87, Total efficiency (on 4 cores): 21.9 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T19:32:14.349148 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outlier-mask-custom-277532p33904.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outliers-pre-custom-277532p33904.jpg Image ksb_160504_105239_ooi_g_ls9-CCD2 g : masking 89 positive outlier pixels and 0 negative outlier pixels Image k4m_160429_111219_ooi_zd_ls9-CCD3 z : masking 0 positive outlier pixels and 290 negative outlier pixels Image k4m_160416_120722_ooi_zd_ls9-CCD1 z : masking 3235 positive outlier pixels and 0 negative outlier pixels Image k4m_170929_040652_ooi_zd_ls9-CCD1 z : masking 1552 positive outlier pixels and 0 negative outlier pixels Image k4m_170616_112323_ooi_zd_ls9-CCD4 z : masking 988 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outlier-mask-custom-277532p33904.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outliers-post-custom-277532p33904.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outliers-masked-pos-custom-277532p33904.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outliers-masked-neg-custom-277532p33904.jpg Stage outliers : Wall: 1.14 s, CPU: 0.80 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 299 MB, VmData: 328 MB, maxrss: 0.566584 MB Stage outliers finished: 2020-06-07T19:32:15.491162 Resources for stage outliers : 1.183 s worker CPU, 1.191 s worker Wall, Wall: 1.143 s, Cores in use: 1.74, Total efficiency (on 4 cores): 43.4 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T19:32:15.492974 Stage halos : Wall: 0.26 s, CPU: 0.25 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 299 MB, VmData: 328 MB, maxrss: 0.566584 MB Stage halos finished: 2020-06-07T19:32:15.748360 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.257 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T19:32:15.750265 PSF sigmas in coadd pixels: ['2.04', '2.58', '2.58'] Using average PSF sigma 2.4013814432767218 Gaussian PSF norm 0.1174718795981681 vs pixelized 0.09452291 average tim pixel scale / coadd scale: 1.729337119973684 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.80', '1.99', '1.91'] Using average PSF sigma 1.9017858474779878 Gaussian PSF norm 0.14833152331424282 vs pixelized 0.12827744 average tim pixel scale / coadd scale: 1.7300218153560092 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.83', '1.52', '3.25', '1.58'] Using average PSF sigma 2.0473193178938094 Gaussian PSF norm 0.13778739315764613 vs pixelized 0.11486411 average tim pixel scale / coadd scale: 0.9909565259483891 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.20 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 301 MB, VmData: 328 MB, maxrss: 0.566584 MB Stage fit_on_coadds finished: 2020-06-07T19:32:15.996841 Resources for stage fit_on_coadds : 0.317 s worker CPU, 0.343 s worker Wall, Wall: 0.248 s, Cores in use: 2.10, Total efficiency (on 4 cores): 52.4 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T19:32:15.999584 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 46 potential peaks Of 46 potential peaks: 14 in veto map, 7 cut by saddle test, 0 cut by aper test, 25 kept SED z : 25 new peaks Found 76 potential peaks Of 76 potential peaks: 68 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 41 potential peaks Of 41 potential peaks: 36 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 61 potential peaks Of 61 potential peaks: 53 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 61 potential peaks Of 61 potential peaks: 50 in veto map, 7 cut by saddle test, 0 cut by aper test, 4 kept SED Red : 4 new peaks Adding 34 new sources Median coadd sky for g : 0.00025327946 Median coadd sky for r : 0.0007283152 Median coadd sky for z : -0.00018168977 Stage srcs : Wall: 0.86 s, CPU: 0.80 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 301 MB, VmData: 328 MB, maxrss: 0.566584 MB Stage srcs finished: 2020-06-07T19:32:16.858975 Resources for stage srcs : 0.143 s worker CPU, 0.143 s worker Wall, Wall: 0.860 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T19:32:16.874139 Blob 1 of 14, id: 8, sources: 25, size: 275x200, npix 30422, brick X: 0,275, Y: 52,252, one pixel: 146 52 Blob 2 of 14, id: 11, sources: 6, size: 119x59, npix 4811, brick X: 119,238, Y: 216,275, one pixel: 188 216 Blob 3 of 14, id: 1, sources: 4, size: 79x46, npix 2044, brick X: 188,267, Y: 0,46, one pixel: 193 0 Blob 4 of 14, id: 4, sources: 2, size: 38x44, npix 1010, brick X: 91,129, Y: 11,55, one pixel: 103 11 Blob 5 of 14, id: 6, sources: 2, size: 45x35, npix 969, brick X: 164,209, Y: 18,53, one pixel: 181 18 Blob 4 finished, total: Wall: 1.75 s, CPU: 1.75 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.140576 MB Blob 6 of 14, id: 13, sources: 1, size: 30x30, npix 566, brick X: 51,81, Y: 227,257, one pixel: 64 227 Blob 5 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 179 MB, maxrss: 0.14256 MB Blob 7 of 14, id: 7, sources: 1, size: 30x28, npix 534, brick X: 64,94, Y: 41,69, one pixel: 76 41 Blob 3 finished, total: Wall: 2.88 s, CPU: 2.88 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142892 MB Blob 8 of 14, id: 2, sources: 1, size: 24x24, npix 374, brick X: 69,93, Y: 2,26, one pixel: 79 2 Measuring 3 iterative sources Blob 6 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 179 MB, maxrss: 0.14256 MB Blob 9 of 14, id: 9, sources: 1, size: 20x19, npix 227, brick X: 20,40, Y: 85,104, one pixel: 28 85 Blob 10 of 14, id: 10, sources: 1, size: 19x19, npix 217, brick X: 7,26, Y: 196,215, one pixel: 15 196 Blob 7 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142968 MB Blob 11 of 14, id: 0, sources: 1, size: 20x17, npix 210, brick X: 165,185, Y: 0,17, one pixel: 172 0 Blob 9 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142968 MB Blob 12 of 14, id: 5, sources: 1, size: 19x19, npix 199, brick X: 124,143, Y: 17,36, one pixel: 133 17 Blob 10 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142968 MB Blob 13 of 14, id: 3, sources: 1, size: 18x17, npix 162, brick X: 9,27, Y: 9,26, one pixel: 17 9 Blob 11 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142968 MB Blob 14 of 14, id: 12, sources: 1, size: 18x17, npix 162, brick X: 1,19, Y: 226,243, one pixel: 9 226 Blob 12 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142968 MB Blob 8 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 179 MB, maxrss: 0.14256 MB Blob 2 finished, total: Wall: 4.13 s, CPU: 4.13 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14286 MB Blob 13 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142968 MB Blob 14 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 179 MB, maxrss: 0.14256 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.98954, ee1=-0.217396, ee2=-0.0858484 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.51737, 33.91065), pm (-4.7, -4.7), parallax 0.303 with NanoMaggies: g=19.5, r=18.9, z=18.7 Reset brightness to NanoMaggies: g=19.5, r=18.9, z=18.7 Measuring 7 iterative sources Blob 1 finished, total: Wall: 21.12 s, CPU: 21.12 s, VmPeak: 811 MB, VmSize: 754 MB, VmRSS: 191 MB, VmData: 220 MB, maxrss: 0.195604 MB Old catalog: 58 New catalog: 53 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/blobs-custom-277532p33904.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/all-models-custom-277532p33904.fits Stage fitblobs : Wall: 21.80 s, CPU: 0.65 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 301 MB, VmData: 328 MB, maxrss: 0.566584 MB Stage fitblobs finished: 2020-06-07T19:32:38.675632 Resources for stage fitblobs : 34.224 s worker CPU, 34.272 s worker Wall, Wall: 21.804 s, Cores in use: 1.60, Total efficiency (on 4 cores): 40.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T19:32:38.678960 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/tmp-legacysurvey-custom-277532p33904-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/tmp-legacysurvey-custom-277532p33904-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/tmp-legacysurvey-custom-277532p33904-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/tmp-legacysurvey-custom-277532p33904-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-resid.jpg Stage coadds : Wall: 1.55 s, CPU: 0.71 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 302 MB, VmData: 328 MB, maxrss: 0.566584 MB Stage coadds finished: 2020-06-07T19:32:40.230633 Resources for stage coadds : 2.451 s worker CPU, 2.556 s worker Wall, Wall: 1.553 s, Cores in use: 2.04, Total efficiency (on 4 cores): 51.0 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T19:32:40.232136 Cut to 1 unWISE tiles Reading WISE tile 2771p333 band 1 Reading WISE tile 2771p333 band 2 Reading WISE tile 2771p333 band 3 Reading WISE tile 2771p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 811 MB, VmSize: 795 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.19164 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.11 s, VmPeak: 810 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.206572 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 809 MB, VmRSS: 169 MB, VmData: 191 MB, maxrss: 0.221104 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 792 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.21246 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/tmp-legacysurvey-custom-277532p33904-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/tmp-legacysurvey-custom-277532p33904-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.42 s, CPU: 0.54 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 302 MB, VmData: 328 MB, maxrss: 0.566584 MB Stage wise_forced finished: 2020-06-07T19:32:42.654177 Resources for stage wise_forced : 4.105 s worker CPU, 5.757 s worker Wall, Wall: 2.423 s, Cores in use: 1.92, Total efficiency (on 4 cores): 48.0 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T19:32:42.655815 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33904/legacysurvey-custom-277532p33904-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/tractor-i/cus/tractor-custom-277532p33904.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/tractor/cus/tractor-custom-277532p33904.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/tractor/cus/brick-custom-277532p33904.sha256sum Stage writecat : Wall: 0.89 s, CPU: 0.63 s, VmPeak: 1192 MB, VmSize: 1064 MB, VmRSS: 304 MB, VmData: 328 MB, maxrss: 0.566584 MB Stage writecat finished: 2020-06-07T19:32:43.547355 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.892 s, Cores in use: 0.70, Total efficiency (on 4 cores): 17.6 % Stage writecat finished All done: 46.106 s worker CPU, 58.592 s worker Wall, Wall: 47.029 s, Cores in use: 1.31, Total efficiency (on 4 cores): 32.8 % Finished galaxy PGC2040782 in 0.844 minutes. Started working on galaxy PGC2040782 at Fri Aug 7 09:41:11 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.5322876134735 33.90398704872927 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:41:12.577331 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.5322876134735', '33.90398704872927', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.5322876134735 33.90398704872927 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 277.5322876134735 33.90398704872927 Starting process 31508 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 31509 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 31510 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 31511 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 31512 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 31513 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059428 MB Starting process 31514 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059428 MB Starting process 31515 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 31516 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 31517 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 31518 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 31519 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 31520 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 31521 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 31523 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 31522 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:41:13.098331 Keeping 10 CCDs: k4m_160429_111219_ooi_zd_ls9-CCD3 z expnum 85814 exptime 87.103 propid 2016A-0453 seeing 1.13 MJD 57507.467 object MzLS_574258_z mosaic/CP/V4.3/CP20160428/k4m_160429_111219_ooi_zd_ls9.fits.fz k4m_170929_040652_ooi_zd_ls9-CCD1 z expnum 141283 exptime 135.103 propid 2016A-0453 seeing 0.94 MJD 58025.171 object MzLS_573220_z mosaic/CP/V4.3/CP20170928/k4m_170929_040652_ooi_zd_ls9.fits.fz k4m_160416_120722_ooi_zd_ls9-CCD1 z expnum 82616 exptime 171.102 propid 2016A-0453 seeing 2.00 MJD 57494.505 object MzLS_574259_z mosaic/CP/V4.3/CP20160415/k4m_160416_120722_ooi_zd_ls9.fits.fz k4m_170616_112323_ooi_zd_ls9-CCD4 z expnum 133766 exptime 131.104 propid 2016A-0453 seeing 0.97 MJD 57920.475 object MzLS_572178_z mosaic/CP/V4.3/CP20170615/k4m_170616_112323_ooi_zd_ls9.fits.fz ksb_160602_085337_ooi_g_ls9-CCD4 g expnum 75410139 exptime 126.7 propid BASS seeing 1.26 MJD 57541.371 object 60732 90prime/CP/V2.3/CP20160601/ksb_160602_085337_ooi_g_ls9.fits.fz ksb_160510_110400_ooi_r_ls9-CCD4 r expnum 75180256 exptime 63.5 propid BASS seeing 1.11 MJD 57518.461 object 60732 90prime/CP/V2.3/CP20160509/ksb_160510_110400_ooi_r_ls9.fits.fz ksb_180509_110749_ooi_r_ls9-CCD1 r expnum 82470198 exptime 109.421 propid NOTBASS seeing 1.23 MJD 58247.464 object 60733 90prime/CP/V2.3/CP20180508/ksb_180509_110749_ooi_r_ls9.fits.fz ksb_160628_065420_ooi_g_ls9-CCD1 g expnum 75670097 exptime 110.8 propid BASS seeing 1.59 MJD 57567.288 object 60733 90prime/CP/V2.3/CP20160627/ksb_160628_065420_ooi_g_ls9.fits.fz ksb_160504_105239_ooi_g_ls9-CCD2 g expnum 75120209 exptime 107.6 propid BASS seeing 1.59 MJD 57512.453 object 60731 90prime/CP/V2.3/CP20160503/ksb_160504_105239_ooi_g_ls9.fits.fz ksb_160430_105803_ooi_r_ls9-CCD2 r expnum 75080190 exptime 105.6 propid BASS seeing 1.17 MJD 57508.457 object 60731 90prime/CP/V2.3/CP20160429/ksb_160430_105803_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3569 3845 and amp range 2006 4053 and image y 2497 2774 and amp range 2040 4078 Range in image: x 0 277 , y 0 278 (with image size 277 x 278) dzp 0.0036595785 -> scaling image by 1.003376283213225 mosaic get_fwhm: self.fwhm = 3.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2085 2364 and amp range 2048 4095 and image y 237 514 and amp range 0 2021 Range in image: x 0 280 , y 0 278 (with image size 280 x 278) dzp -0.03444113 -> scaling image by 0.9687763957004109 mosaic get_fwhm: self.fwhm = 4.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 872 1156 and amp range 0 2005 and image y 3854 4072 and amp range 2040 4078 Range in image: x 0 285 , y 0 219 (with image size 285 x 219) dzp 0.0022078273 -> scaling image by 1.0020355530120029 Faked up EXPNUM 75180256 Faked up EXPNUM 75180256 Faked up EXPNUM 75180256 90prime get_fwhm: self.fwhm = 2.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2604 2765 and amp range 2016 4031 and image y 24 184 and amp range 0 2047 Range in image: x 0 162 , y 0 161 (with image size 162 x 161) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Faked up EXPNUM 82470198 Faked up EXPNUM 82470198 Faked up EXPNUM 82470198 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2741 2904 and amp range 2016 4031 and image y 489 652 and amp range 0 2047 Range in image: x 0 164 , y 0 164 (with image size 164 x 164) dzp -0.03177219 -> scaling image by 0.9711607558798585 Faked up EXPNUM 75120209 Faked up EXPNUM 75120209 Faked up EXPNUM 75120209 90prime get_fwhm: self.fwhm = 3.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 599 760 and amp range 0 2015 and image y 2492 2653 and amp range 2048 4095 Range in image: x 0 162 , y 0 162 (with image size 162 x 162) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75410139 Faked up EXPNUM 75410139 Faked up EXPNUM 75410139 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2606 2767 and amp range 2016 4031 and image y 15 174 and amp range 0 2047 Range in image: x 0 162 , y 0 160 (with image size 162 x 160) dzp 0.010226944 -> scaling image by 1.0094638657706572 Faked up EXPNUM 75080190 Faked up EXPNUM 75080190 Faked up EXPNUM 75080190 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 601 761 and amp range 0 2015 and image y 2494 2655 and amp range 2048 4095 Range in image: x 0 161 , y 0 162 (with image size 161 x 162) dzp 0.016961161 -> scaling image by 1.0157444649385616 mosaic get_fwhm: self.fwhm = 7.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 857 1143 and amp range 0 2005 and image y 147 435 and amp range 0 2039 Range in image: x 0 287 , y 0 289 (with image size 287 x 289) dzp -0.011066288 -> scaling image by 0.989859339076806 Faked up EXPNUM 75670097 Faked up EXPNUM 75670097 Faked up EXPNUM 75670097 90prime get_fwhm: self.fwhm = 3.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2737 2899 and amp range 2016 4031 and image y 496 658 and amp range 0 2047 Range in image: x 0 163 , y 0 163 (with image size 163 x 163) dzp -0.0032519526 -> scaling image by 0.9970093219958882 Stage tims : Wall: 149.57 s, CPU: 1.04 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178204 MB Stage tims finished: 2020-08-07T09:43:42.672445 Resources for stage tims : 5.090 s worker CPU, 710.614 s worker Wall, Wall: 149.576 s, Cores in use: 0.04, Total efficiency (on 16 cores): 0.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:43:44.056928 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02722.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02850.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02723.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02594.fits Matched 15 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/reference-custom-277532p33903.fits Stage refs : Wall: 16.69 s, CPU: 9.34 s, VmPeak: 1065 MB, VmSize: 1060 MB, VmRSS: 286 MB, VmData: 317 MB, maxrss: 0.292768 MB Stage refs finished: 2020-08-07T09:44:00.744390 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 16.689 s, Cores in use: 0.56, Total efficiency (on 16 cores): 3.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:44:00.791385 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outlier-mask-custom-277532p33903.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outliers-pre-custom-277532p33903.jpg Image ksb_160504_105239_ooi_g_ls9-CCD2 g : masking 84 positive outlier pixels and 0 negative outlier pixels Image k4m_160429_111219_ooi_zd_ls9-CCD3 z : masking 0 positive outlier pixels and 624 negative outlier pixels Image k4m_170929_040652_ooi_zd_ls9-CCD1 z : masking 1577 positive outlier pixels and 0 negative outlier pixels Image k4m_170616_112323_ooi_zd_ls9-CCD4 z : masking 685 positive outlier pixels and 0 negative outlier pixels Image k4m_160416_120722_ooi_zd_ls9-CCD1 z : masking 3638 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outlier-mask-custom-277532p33903.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outliers-post-custom-277532p33903.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outliers-masked-pos-custom-277532p33903.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/outliers-masked-neg-custom-277532p33903.jpg Stage outliers : Wall: 1.48 s, CPU: 0.66 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 302 MB, VmData: 331 MB, maxrss: 0.309684 MB Stage outliers finished: 2020-08-07T09:44:02.272902 Resources for stage outliers : 1.009 s worker CPU, 1.107 s worker Wall, Wall: 1.483 s, Cores in use: 1.13, Total efficiency (on 16 cores): 7.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:44:02.335978 Stage halos : Wall: 0.42 s, CPU: 0.40 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 303 MB, VmData: 332 MB, maxrss: 0.309812 MB Stage halos finished: 2020-08-07T09:44:02.754052 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.419 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:44:02.869784 PSF sigmas in coadd pixels: ['2.04', '2.58', '2.58'] Using average PSF sigma 2.4013814432767218 Gaussian PSF norm 0.1174718795981681 vs pixelized 0.09451959 average tim pixel scale / coadd scale: 1.729337119973684 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.80', '1.99', '1.91'] Using average PSF sigma 1.9017858474779878 Gaussian PSF norm 0.14833152331424282 vs pixelized 0.1282754 average tim pixel scale / coadd scale: 1.7300218153560092 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.83', '1.52', '3.25', '1.58'] Using average PSF sigma 2.0473193178938094 Gaussian PSF norm 0.13778739315764613 vs pixelized 0.11486027 average tim pixel scale / coadd scale: 0.9909565259483891 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.17 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 304 MB, VmData: 332 MB, maxrss: 0.31128 MB Stage fit_on_coadds finished: 2020-08-07T09:44:03.099775 Resources for stage fit_on_coadds : 0.234 s worker CPU, 0.234 s worker Wall, Wall: 0.232 s, Cores in use: 1.75, Total efficiency (on 16 cores): 11.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T09:44:03.121333 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 46 potential peaks Of 46 potential peaks: 15 in veto map, 6 cut by saddle test, 0 cut by aper test, 25 kept SED z : 25 new peaks Found 130 potential peaks Of 130 potential peaks: 120 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 45 potential peaks Of 45 potential peaks: 41 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 59 potential peaks Of 59 potential peaks: 50 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 57 potential peaks Of 57 potential peaks: 48 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 33 new sources Median coadd sky for g : 0.00025748488 Median coadd sky for r : 0.00075100304 Median coadd sky for z : -8.884749e-05 Stage srcs : Wall: 0.65 s, CPU: 0.61 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 304 MB, VmData: 332 MB, maxrss: 0.311772 MB Stage srcs finished: 2020-08-07T09:44:03.771254 Resources for stage srcs : 0.092 s worker CPU, 0.092 s worker Wall, Wall: 0.651 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:44:03.826670 Blob 1 of 13, id: 6, sources: 26, size: 275x234, npix 31262, brick X: 0,275, Y: 20,254, one pixel: 173 20 Blob 2 of 13, id: 11, sources: 6, size: 118x57, npix 4664, brick X: 114,232, Y: 218,275, one pixel: 182 218 Blob 3 of 13, id: 1, sources: 4, size: 79x48, npix 2122, brick X: 183,262, Y: 0,48, one pixel: 189 0 Blob 4 of 13, id: 4, sources: 2, size: 38x44, npix 1014, brick X: 86,124, Y: 12,56, one pixel: 99 12 Blob 5 of 13, id: 12, sources: 1, size: 29x30, npix 562, brick X: 47,76, Y: 228,258, one pixel: 62 228 Blob 6 of 13, id: 7, sources: 1, size: 29x28, npix 531, brick X: 60,89, Y: 42,70, one pixel: 73 42 Blob 7 of 13, id: 2, sources: 1, size: 24x24, npix 373, brick X: 64,88, Y: 3,27, one pixel: 75 3 Blob 8 of 13, id: 0, sources: 1, size: 21x19, npix 236, brick X: 160,181, Y: 0,19, one pixel: 168 0 Blob 9 of 13, id: 9, sources: 1, size: 20x20, npix 229, brick X: 15,35, Y: 86,106, one pixel: 24 86 Blob 10 of 13, id: 10, sources: 1, size: 19x20, npix 227, brick X: 2,21, Y: 197,217, one pixel: 11 197 Blob 11 of 13, id: 5, sources: 1, size: 19x19, npix 190, brick X: 120,139, Y: 19,38, one pixel: 128 19 Blob 12 of 13, id: 3, sources: 1, size: 17x18, npix 162, brick X: 5,22, Y: 10,28, one pixel: 13 10 Blob 13 of 13, id: 8, sources: 1, size: 14x17, npix 136, brick X: 261,275, Y: 66,83, one pixel: 269 66 Blob 11 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 87 MB, VmData: 138 MB, maxrss: 0.089256 MB Blob 10 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146892 MB Blob 9 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146772 MB Blob 12 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.096684 MB Blob 13 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14702 MB Blob 7 finished, total: Wall: 0.50 s, CPU: 0.49 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146508 MB Blob 8 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094216 MB Blob 5 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09236 MB Blob 6 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147392 MB Blob 4 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14726 MB Blob 3 finished, total: Wall: 1.97 s, CPU: 1.96 s, VmPeak: 815 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147816 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.77 s, CPU: 2.77 s, VmPeak: 674 MB, VmSize: 673 MB, VmRSS: 99 MB, VmData: 144 MB, maxrss: 0.101744 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.73917, ee1=-0.227796, ee2=-0.0890225 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.51737, 33.91065), pm (-4.7, -4.7), parallax 0.303 with NanoMaggies: g=19.5, r=18.9, z=18.7 Reset brightness to NanoMaggies: g=19.5, r=18.9, z=18.7 Measuring 7 iterative sources Blob 1 finished, total: Wall: 26.16 s, CPU: 26.15 s, VmPeak: 815 MB, VmSize: 759 MB, VmRSS: 186 MB, VmData: 214 MB, maxrss: 0.190312 MB Old catalog: 56 New catalog: 50 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/blobs-custom-277532p33903.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/metrics/cus/all-models-custom-277532p33903.fits Stage fitblobs : Wall: 26.70 s, CPU: 0.42 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 305 MB, VmData: 332 MB, maxrss: 0.312448 MB Stage fitblobs finished: 2020-08-07T09:44:30.522679 Resources for stage fitblobs : 35.279 s worker CPU, 35.370 s worker Wall, Wall: 26.698 s, Cores in use: 1.34, Total efficiency (on 16 cores): 8.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:44:30.543394 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/tmp-legacysurvey-custom-277532p33903-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/tmp-legacysurvey-custom-277532p33903-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/tmp-legacysurvey-custom-277532p33903-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/tmp-legacysurvey-custom-277532p33903-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-resid.jpg Stage coadds : Wall: 2.88 s, CPU: 0.60 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 305 MB, VmData: 332 MB, maxrss: 0.312772 MB Stage coadds finished: 2020-08-07T09:44:33.426606 Resources for stage coadds : 9.193 s worker CPU, 9.692 s worker Wall, Wall: 2.885 s, Cores in use: 3.39, Total efficiency (on 16 cores): 21.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:44:33.471225 Cut to 1 unWISE tiles Reading WISE tile 2771p333 band 1 Reading WISE tile 2771p333 band 2 Reading WISE tile 2771p333 band 3 Reading WISE tile 2771p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 814 MB, VmSize: 803 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.188468 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 815 MB, VmSize: 810 MB, VmRSS: 160 MB, VmData: 181 MB, maxrss: 0.224812 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 815 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203976 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2771p333/unwise-2771p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 801 MB, VmSize: 799 MB, VmRSS: 142 MB, VmData: 173 MB, maxrss: 0.201972 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/tmp-legacysurvey-custom-277532p33903-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/tmp-legacysurvey-custom-277532p33903-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 30.11 s, CPU: 0.61 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 306 MB, VmData: 332 MB, maxrss: 0.313284 MB Stage wise_forced finished: 2020-08-07T09:45:03.586281 Resources for stage wise_forced : 3.025 s worker CPU, 63.394 s worker Wall, Wall: 30.117 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:45:03.622761 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/coadd/cus/custom-277532p33903/legacysurvey-custom-277532p33903-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/tractor-i/cus/tractor-custom-277532p33903.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/tractor/cus/tractor-custom-277532p33903.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/tractor/cus/brick-custom-277532p33903.sha256sum Stage writecat : Wall: 1.40 s, CPU: 0.60 s, VmPeak: 1202 MB, VmSize: 1074 MB, VmRSS: 308 MB, VmData: 332 MB, maxrss: 0.446168 MB Stage writecat finished: 2020-08-07T09:45:05.018798 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.398 s, Cores in use: 0.43, Total efficiency (on 16 cores): 2.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2040782/PGC2040782-largegalaxy-writecat.p All done: 53.925 s worker CPU, 820.507 s worker Wall, Wall: 232.081 s, Cores in use: 0.30, Total efficiency (on 16 cores): 1.8 % Finished galaxy PGC2040782 in 3.912 minutes.