Started working on galaxy PGC2318077 at Sun Jun 7 18:30:38 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.6512305 48.46447020000001 --width 293 --height 293 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/PGC2318077-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/PGC2318077-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T18:30:40.498085 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.6512305', '48.46447020000001', '--width', '293', '--height', '293', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/PGC2318077-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/PGC2318077-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.6512305 48.46447020000001 --width 293 --height 293 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/PGC2318077-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/PGC2318077-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 167.6512305 48.46447020000001 Starting process 28513 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057396 MB Starting process 28520 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB Starting process 28536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB Starting process 28532 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057396 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T18:30:41.405595 Keeping 11 CCDs: k4m_170314_102153_ooi_zd_ls9.fits.fz k4m_170314_102153_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 0.71 MJD 57826.432 object MzLS_642821_z k4m_160425_053034_ooi_zd_ls9.fits.fz k4m_160425_053034_ooi_zd_ls9-CCD3 z exptime 80.103 propid 2016A seeing 1.00 MJD 57503.230 object MzLS_643654_z k4m_161215_125343_ooi_zd_ls9.fits.fz k4m_161215_125343_ooi_zd_ls9-CCD4 z exptime 80.103 propid 2016A-0453 seeing 0.84 MJD 57737.537 object MzLS_641984_z ksb_170319_064409_ooi_r_ls9.fits.fz ksb_170319_064409_ooi_r_ls9-CCD3 r exptime 54.567 propid BASS seeing 1.07 MJD 57831.281 object 24151 ksb_160311_073434_ooi_g_ls9.fits.fz ksb_160311_073434_ooi_g_ls9-CCD3 g exptime 87.1 propid 2015A-0801 seeing 1.44 MJD 57458.316 object 24151 ksb_160503_035609_ooi_g_ls9.fits.fz ksb_160503_035609_ooi_g_ls9-CCD3 g exptime 146.9 propid BASS seeing 1.99 MJD 57511.164 object 24152 ksb_170320_072521_ooi_r_ls9.fits.fz ksb_170320_072521_ooi_r_ls9-CCD3 r exptime 50.0 propid BASS seeing 1.12 MJD 57832.309 object 24152 ksb_170419_071359_ooi_r_ls9.fits.fz ksb_170419_071359_ooi_r_ls9-CCD2 r exptime 67.133 propid BASS seeing 1.26 MJD 57862.301 object 25343 ksb_170401_063610_ooi_g_ls9.fits.fz ksb_170401_063610_ooi_g_ls9-CCD2 g exptime 177.52 propid BASS seeing 2.12 MJD 57844.275 object 25343 ksb_160503_035241_ooi_g_ls9.fits.fz ksb_160503_035241_ooi_g_ls9-CCD1 g exptime 152.6 propid BASS seeing 1.91 MJD 57511.162 object 24142 ksb_170320_071800_ooi_r_ls9.fits.fz ksb_170320_071800_ooi_r_ls9-CCD1 r exptime 50.0 propid BASS seeing 1.07 MJD 57832.304 object 24142 Faked up EXPNUM 78310185 Faked up EXPNUM 78310185 Faked up EXPNUM 78310185 90prime get_fwhm: self.fwhm = 2.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 338 510 and amp range 0 2015 and image y 1902 2073 and amp range 0 2047 Range in image: x 0 173 , y 0 146 (with image size 173 x 172) dzp -0.043123975 -> scaling image by 0.961059796099719 Found overlap: image x 338 510 and amp range 0 2015 and image y 1902 2073 and amp range 2048 4095 Range in image: x 0 173 , y 146 172 (with image size 173 x 172) dzp -0.07725406 -> scaling image by 0.9313188157188347 mosaic get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3371 3678 and amp range 2048 4095 and image y 3270 3575 and amp range 2022 4060 Range in image: x 0 308 , y 0 306 (with image size 308 x 306) dzp -0.02499645 -> scaling image by 0.9772404160512723 mosaic get_fwhm: self.fwhm = 3.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2214 2512 and amp range 2006 4053 and image y 3292 3596 and amp range 2040 4078 Range in image: x 0 299 , y 0 305 (with image size 299 x 305) dzp -0.0026360443 -> scaling image by 0.99757505842151 mosaic get_fwhm: self.fwhm = 2.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 619 916 and amp range 0 2047 and image y 852 1151 and amp range 0 2039 Range in image: x 0 298 , y 0 300 (with image size 298 x 300) dzp -0.0096683735 -> scaling image by 0.9911346301237048 Faked up EXPNUM 74580114 Faked up EXPNUM 74580114 Faked up EXPNUM 74580114 90prime get_fwhm: self.fwhm = 3.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 342 514 and amp range 0 2015 and image y 1907 2078 and amp range 0 2047 Range in image: x 0 173 , y 0 141 (with image size 173 x 172) dzp -0.03470582 -> scaling image by 0.9685402452207784 Found overlap: image x 342 514 and amp range 0 2015 and image y 1907 2078 and amp range 2048 4095 Range in image: x 0 173 , y 141 172 (with image size 173 x 172) dzp -0.0045482004 -> scaling image by 0.9958197144381092 Faked up EXPNUM 78320188 Faked up EXPNUM 78320188 Faked up EXPNUM 78320188 90prime get_fwhm: self.fwhm = 2.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2328 2499 and amp range 2016 4031 and image y 3877 4049 and amp range 2048 4095 Range in image: x 0 172 , y 0 173 (with image size 172 x 173) dzp -0.035697103 -> scaling image by 0.9676563679910417 Faked up EXPNUM 75110037 Faked up EXPNUM 75110037 Faked up EXPNUM 75110037 90prime get_fwhm: self.fwhm = 4.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2318 2490 and amp range 2016 4031 and image y 3872 4044 and amp range 2048 4095 Range in image: x 0 173 , y 0 173 (with image size 173 x 173) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Faked up EXPNUM 78440068 Faked up EXPNUM 78440068 Faked up EXPNUM 78440068 90prime get_fwhm: self.fwhm = 4.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2080 2252 and amp range 2016 4031 and image y 1310 1482 and amp range 0 2047 Range in image: x 0 173 , y 0 173 (with image size 173 x 173) dzp 0.01918938 -> scaling image by 1.017831182878158 Faked up EXPNUM 75110036 Faked up EXPNUM 75110036 Faked up EXPNUM 75110036 90prime get_fwhm: self.fwhm = 4.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2267 2440 and amp range 2016 4031 and image y 382 555 and amp range 0 2047 Range in image: x 0 174 , y 0 174 (with image size 174 x 174) dzp -0.0032519526 -> scaling image by 0.9970093219958882 Faked up EXPNUM 78620154 Faked up EXPNUM 78620154 Faked up EXPNUM 78620154 90prime get_fwhm: self.fwhm = 2.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2083 2254 and amp range 2016 4031 and image y 1316 1489 and amp range 0 2047 Range in image: x 0 172 , y 0 174 (with image size 172 x 174) dzp 0.032776505 -> scaling image by 1.0306485625912574 Faked up EXPNUM 78320183 Faked up EXPNUM 78320183 Faked up EXPNUM 78320183 90prime get_fwhm: self.fwhm = 2.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2279 2452 and amp range 2016 4031 and image y 386 559 and amp range 0 2047 Range in image: x 0 174 , y 0 174 (with image size 174 x 174) dzp -0.006547878 -> scaling image by 0.9939873303458991 Stage tims : Wall: 7.97 s, CPU: 1.02 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.852524 MB Stage tims finished: 2020-06-07T18:30:49.379996 Resources for stage tims : 3.751 s worker CPU, 21.235 s worker Wall, Wall: 7.976 s, Cores in use: 0.60, Total efficiency (on 4 cores): 15.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/PGC2318077-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/PGC2318077-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T18:30:49.404339 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01563.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01564.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01677.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01454.fits Matched 5 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/metrics/cus/reference-custom-167651p48464.fits Stage refs : Wall: 1.87 s, CPU: 1.22 s, VmPeak: 972 MB, VmSize: 952 MB, VmRSS: 184 MB, VmData: 217 MB, maxrss: 0.852524 MB Stage refs finished: 2020-06-07T18:30:51.274452 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.871 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.3 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T18:30:51.276106 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/metrics/cus/outlier-mask-custom-167651p48464.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/metrics/cus/outliers-pre-custom-167651p48464.jpg Image ksb_160503_035241_ooi_g_ls9-CCD1 g : masking 74 positive outlier pixels and 0 negative outlier pixels Image ksb_170419_071359_ooi_r_ls9-CCD2 r : masking 64 positive outlier pixels and 0 negative outlier pixels Image k4m_160425_053034_ooi_zd_ls9-CCD3 z : masking 479 positive outlier pixels and 0 negative outlier pixels Image k4m_170314_102153_ooi_zd_ls9-CCD2 z : masking 247 positive outlier pixels and 0 negative outlier pixels Image k4m_161215_125343_ooi_zd_ls9-CCD4 z : masking 687 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/metrics/cus/outlier-mask-custom-167651p48464.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/metrics/cus/outliers-post-custom-167651p48464.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/metrics/cus/outliers-masked-pos-custom-167651p48464.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/metrics/cus/outliers-masked-neg-custom-167651p48464.jpg Stage outliers : Wall: 1.18 s, CPU: 0.81 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 203 MB, VmData: 233 MB, maxrss: 0.852524 MB Stage outliers finished: 2020-06-07T18:30:52.453791 Resources for stage outliers : 1.404 s worker CPU, 1.415 s worker Wall, Wall: 1.179 s, Cores in use: 1.88, Total efficiency (on 4 cores): 46.9 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T18:30:52.455632 Stage halos : Wall: 0.23 s, CPU: 0.22 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 203 MB, VmData: 233 MB, maxrss: 0.852524 MB Stage halos finished: 2020-06-07T18:30:52.684697 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.230 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T18:30:52.686654 PSF sigmas in coadd pixels: ['2.33', '3.23', '3.44', '3.10'] Using average PSF sigma 3.0249645584613933 Gaussian PSF norm 0.0932555692214 vs pixelized 0.07365388 average tim pixel scale / coadd scale: 1.729582175336963 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.74', '1.82', '2.05', '1.74'] Using average PSF sigma 1.8395721572889088 Gaussian PSF norm 0.15334804381341513 vs pixelized 0.1430231 average tim pixel scale / coadd scale: 1.7291792261392902 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.16', '1.63', '1.37'] Using average PSF sigma 1.3872623803285438 Gaussian PSF norm 0.20334638621647766 vs pixelized 0.17370929 average tim pixel scale / coadd scale: 0.990910412484197 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.32 s, CPU: 0.27 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.852524 MB Stage fit_on_coadds finished: 2020-06-07T18:30:53.006249 Resources for stage fit_on_coadds : 0.324 s worker CPU, 0.343 s worker Wall, Wall: 0.321 s, Cores in use: 1.86, Total efficiency (on 4 cores): 46.5 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T18:30:53.009637 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 27 potential peaks Of 27 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 12 kept SED z : 12 new peaks Found 34 potential peaks Of 34 potential peaks: 30 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 24 potential peaks Of 24 potential peaks: 21 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 53 potential peaks Of 53 potential peaks: 46 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 89 potential peaks Of 89 potential peaks: 82 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 17 new sources Median coadd sky for g : 0.00021354147 Median coadd sky for r : 0.00028285276 Median coadd sky for z : 0.000300981 Stage srcs : Wall: 0.64 s, CPU: 0.57 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.852524 MB Stage srcs finished: 2020-06-07T18:30:53.646751 Resources for stage srcs : 0.153 s worker CPU, 0.167 s worker Wall, Wall: 0.638 s, Cores in use: 1.14, Total efficiency (on 4 cores): 28.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/PGC2318077-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/PGC2318077-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T18:30:53.662589 Blob 1 of 7, id: 2, sources: 11, size: 228x211, npix 25082, brick X: 35,263, Y: 28,239, one pixel: 162 28 Blob 2 of 7, id: 1, sources: 1, size: 36x35, npix 933, brick X: 82,118, Y: 23,58, one pixel: 94 23 Blob 3 of 7, id: 4, sources: 1, size: 28x40, npix 863, brick X: 265,293, Y: 114,154, one pixel: 283 114 Blob 4 of 7, id: 0, sources: 2, size: 34x36, npix 612, brick X: 124,158, Y: 0,36, one pixel: 143 0 Blob 5 of 7, id: 6, sources: 1, size: 30x29, npix 541, brick X: 197,227, Y: 254,283, one pixel: 212 254 Blob 3 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14106 MB Blob 6 of 7, id: 5, sources: 2, size: 36x24, npix 500, brick X: 2,38, Y: 134,158, one pixel: 23 134 Blob 2 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141048 MB Blob 7 of 7, id: 3, sources: 1, size: 21x20, npix 249, brick X: 55,76, Y: 99,119, one pixel: 64 99 Blob 6 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142932 MB Blob 7 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142932 MB Blob 5 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143112 MB Blob 4 finished, total: Wall: 1.24 s, CPU: 1.24 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142948 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.41837, ee1=0.200557, ee2=0.176936 Measuring 9 iterative sources Blob 1 finished, total: Wall: 15.32 s, CPU: 15.32 s, VmPeak: 804 MB, VmSize: 728 MB, VmRSS: 161 MB, VmData: 193 MB, maxrss: 0.164608 MB Old catalog: 21 New catalog: 23 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/metrics/cus/blobs-custom-167651p48464.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/metrics/cus/all-models-custom-167651p48464.fits Stage fitblobs : Wall: 15.72 s, CPU: 0.36 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 207 MB, VmData: 234 MB, maxrss: 0.852524 MB Stage fitblobs finished: 2020-06-07T18:31:09.383074 Resources for stage fitblobs : 19.049 s worker CPU, 19.074 s worker Wall, Wall: 15.722 s, Cores in use: 1.23, Total efficiency (on 4 cores): 30.9 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T18:31:09.385391 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/tmp-legacysurvey-custom-167651p48464-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/tmp-legacysurvey-custom-167651p48464-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/tmp-legacysurvey-custom-167651p48464-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/tmp-legacysurvey-custom-167651p48464-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-resid.jpg Stage coadds : Wall: 1.47 s, CPU: 0.63 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 207 MB, VmData: 234 MB, maxrss: 0.852524 MB Stage coadds finished: 2020-06-07T18:31:10.857700 Resources for stage coadds : 2.285 s worker CPU, 2.375 s worker Wall, Wall: 1.473 s, Cores in use: 1.98, Total efficiency (on 4 cores): 49.5 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T18:31:10.859468 Cut to 2 unWISE tiles Reading WISE tile 1664p484 band 2 Reading WISE tile 1664p484 band 1 Reading WISE tile 1664p484 band 3 Reading WISE tile 1664p484 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1687p484 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1687p484 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1687p484 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1664p484/unwise-1664p484-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1687p484 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 804 MB, VmSize: 797 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.189528 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208736 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 802 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208924 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1687p484/unwise-1687p484-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 796 MB, VmRSS: 153 MB, VmData: 178 MB, maxrss: 0.217584 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/tmp-legacysurvey-custom-167651p48464-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/tmp-legacysurvey-custom-167651p48464-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.88 s, CPU: 0.39 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 208 MB, VmData: 234 MB, maxrss: 0.852524 MB Stage wise_forced finished: 2020-06-07T18:31:14.735671 Resources for stage wise_forced : 9.095 s worker CPU, 11.566 s worker Wall, Wall: 3.878 s, Cores in use: 2.45, Total efficiency (on 4 cores): 61.2 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T18:31:14.737746 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/coadd/cus/custom-167651p48464/legacysurvey-custom-167651p48464-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/tractor-i/cus/tractor-custom-167651p48464.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/tractor/cus/tractor-custom-167651p48464.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2318077/tractor/cus/brick-custom-167651p48464.sha256sum Stage writecat : Wall: 1.02 s, CPU: 0.58 s, VmPeak: 1094 MB, VmSize: 966 MB, VmRSS: 210 MB, VmData: 234 MB, maxrss: 0.852524 MB Stage writecat finished: 2020-06-07T18:31:15.760924 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.024 s, Cores in use: 0.57, Total efficiency (on 4 cores): 14.3 % Stage writecat finished All done: 36.063 s worker CPU, 56.178 s worker Wall, Wall: 34.361 s, Cores in use: 1.23, Total efficiency (on 4 cores): 30.7 % Finished galaxy PGC2318077 in 0.627 minutes.