Started working on galaxy PGC2318167 at Sun Jun 7 18:01:25 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.45094350000002 48.4688037 --width 255 --height 255 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/PGC2318167-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/PGC2318167-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T18:01:27.754292 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '228.45094350000002', '48.4688037', '--width', '255', '--height', '255', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/PGC2318167-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/PGC2318167-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.45094350000002 48.4688037 --width 255 --height 255 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/PGC2318167-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/PGC2318167-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 228.45094350000002 48.4688037 Starting process 15222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 15224 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 15227 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 15230 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T18:01:28.223080 Keeping 9 CCDs: k4m_160520_070211_ooi_zd_ls9.fits.fz k4m_160520_070211_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 1.08 MJD 57528.293 object MzLS_642891_z k4m_170504_083453_ooi_zd_ls9.fits.fz k4m_170504_083453_ooi_zd_ls9-CCD4 z exptime 87.105 propid 2016A-0453 seeing 1.08 MJD 57877.358 object MzLS_642055_z k4m_160509_072821_ooi_zd_ls9.fits.fz k4m_160509_072821_ooi_zd_ls9-CCD1 z exptime 80.102 propid 2016A-0453 seeing 1.04 MJD 57517.311 object MzLS_643725_z ksb_170330_104122_ooi_g_ls9.fits.fz ksb_170330_104122_ooi_g_ls9-CCD4 g exptime 80.416 propid BASS seeing 1.26 MJD 57842.445 object 25743 ksb_170421_101239_ooi_r_ls9.fits.fz ksb_170421_101239_ooi_r_ls9-CCD4 r exptime 121.374 propid BASS seeing 1.64 MJD 57864.425 object 25743 ksb_160510_073254_ooi_r_ls9.fits.fz ksb_160510_073254_ooi_r_ls9-CCD1 r exptime 53.8 propid BASS seeing 1.20 MJD 57518.315 object 24551 ksb_160314_100513_ooi_g_ls9.fits.fz ksb_160314_100513_ooi_g_ls9-CCD1 g exptime 61.2 propid 2015A-0801 seeing 2.00 MJD 57461.420 object 24551 ksb_160602_042942_ooi_g_ls9.fits.fz ksb_160602_042942_ooi_g_ls9-CCD3 g exptime 76.3 propid BASS seeing 1.25 MJD 57541.187 object 24552 ksb_160611_061154_ooi_r_ls9.fits.fz ksb_160611_061154_ooi_r_ls9-CCD3 r exptime 119.2 propid BASS seeing 1.27 MJD 57550.258 object 24552 Faked up EXPNUM 78420215 Faked up EXPNUM 78420215 Faked up EXPNUM 78420215 90prime get_fwhm: self.fwhm = 2.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2104 2253 and amp range 2016 4031 and image y 542 690 and amp range 0 2047 Range in image: x 0 150 , y 0 149 (with image size 150 x 149) dzp 0.016679538 -> scaling image by 1.0154810312115594 mosaic get_fwhm: self.fwhm = 4.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 708 964 and amp range 0 2047 and image y 0 177 and amp range 0 2021 Range in image: x 0 257 , y 0 178 (with image size 257 x 178) dzp 0.005139143 -> scaling image by 1.0047445456970268 mosaic get_fwhm: self.fwhm = 4.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3436 3700 and amp range 2048 4095 and image y 1400 1659 and amp range 0 2021 Range in image: x 0 265 , y 0 260 (with image size 265 x 260) dzp -0.03444113 -> scaling image by 0.9687763957004109 mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2286 2544 and amp range 2006 4053 and image y 1714 1973 and amp range 0 2039 Range in image: x 0 259 , y 0 260 (with image size 259 x 260) dzp 0.001388291 -> scaling image by 1.0012794811153327 Faked up EXPNUM 78640209 Faked up EXPNUM 78640209 Faked up EXPNUM 78640209 90prime get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2106 2254 and amp range 2016 4031 and image y 558 706 and amp range 0 2047 Range in image: x 0 149 , y 0 149 (with image size 149 x 149) dzp 0.02499258 -> scaling image by 1.0232859986636875 Faked up EXPNUM 75410055 Faked up EXPNUM 75410055 Faked up EXPNUM 75410055 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2330 2478 and amp range 2016 4031 and image y 1406 1554 and amp range 0 2047 Range in image: x 0 149 , y 0 149 (with image size 149 x 149) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Faked up EXPNUM 74610184 Faked up EXPNUM 74610184 Faked up EXPNUM 74610184 90prime get_fwhm: self.fwhm = 4.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 299 449 and amp range 0 2015 and image y 3871 4020 and amp range 2048 4095 Range in image: x 0 151 , y 0 150 (with image size 151 x 150) dzp -0.0051191514 -> scaling image by 0.9952961850385206 Faked up EXPNUM 75180146 Faked up EXPNUM 75180146 Faked up EXPNUM 75180146 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 285 435 and amp range 0 2015 and image y 3871 4020 and amp range 2048 4095 Range in image: x 0 151 , y 0 150 (with image size 151 x 150) dzp -0.00015519658 -> scaling image by 0.9998570688798908 Faked up EXPNUM 75500062 Faked up EXPNUM 75500062 Faked up EXPNUM 75500062 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2310 2458 and amp range 2016 4031 and image y 1384 1532 and amp range 0 2047 Range in image: x 0 149 , y 0 149 (with image size 149 x 149) dzp 0.004245165 -> scaling image by 1.0039175950705865 Stage tims : Wall: 7.18 s, CPU: 0.86 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.566628 MB Stage tims finished: 2020-06-07T18:01:35.407664 Resources for stage tims : 3.138 s worker CPU, 16.638 s worker Wall, Wall: 7.186 s, Cores in use: 0.56, Total efficiency (on 4 cores): 13.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/PGC2318167-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/PGC2318167-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T18:01:35.567238 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01472.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01697.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01582.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01583.fits Matched 12 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/metrics/cus/reference-custom-228450p48468.fits Stage refs : Wall: 3.23 s, CPU: 1.58 s, VmPeak: 972 MB, VmSize: 956 MB, VmRSS: 186 MB, VmData: 219 MB, maxrss: 0.566628 MB Stage refs finished: 2020-06-07T18:01:38.797161 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.231 s, Cores in use: 0.49, Total efficiency (on 4 cores): 12.2 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T18:01:38.798484 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/metrics/cus/outlier-mask-custom-228450p48468.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/metrics/cus/outliers-pre-custom-228450p48468.jpg Image ksb_170421_101239_ooi_r_ls9-CCD4 r : masking 84 positive outlier pixels and 0 negative outlier pixels Image k4m_160520_070211_ooi_zd_ls9-CCD4 z : masking 0 positive outlier pixels and 137 negative outlier pixels Image k4m_160509_072821_ooi_zd_ls9-CCD1 z : masking 261 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/metrics/cus/outlier-mask-custom-228450p48468.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/metrics/cus/outliers-post-custom-228450p48468.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/metrics/cus/outliers-masked-pos-custom-228450p48468.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/metrics/cus/outliers-masked-neg-custom-228450p48468.jpg Stage outliers : Wall: 2.02 s, CPU: 0.58 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 198 MB, VmData: 230 MB, maxrss: 0.566628 MB Stage outliers finished: 2020-06-07T18:01:40.822981 Resources for stage outliers : 0.696 s worker CPU, 0.697 s worker Wall, Wall: 2.026 s, Cores in use: 0.63, Total efficiency (on 4 cores): 15.8 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T18:01:40.824608 Stage halos : Wall: 0.26 s, CPU: 0.25 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 199 MB, VmData: 230 MB, maxrss: 0.566628 MB Stage halos finished: 2020-06-07T18:01:41.087420 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.264 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.7 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T18:01:41.089190 PSF sigmas in coadd pixels: ['2.05', '3.25', '2.04'] Using average PSF sigma 2.4460337497316345 Gaussian PSF norm 0.1153274323401417 vs pixelized 0.10716031 average tim pixel scale / coadd scale: 1.729651974542564 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.66', '1.95', '2.07'] Using average PSF sigma 2.2251923740728077 Gaussian PSF norm 0.12677321523332172 vs pixelized 0.10348582 average tim pixel scale / coadd scale: 1.7295423353034007 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.75', '1.75', '1.68'] Using average PSF sigma 1.7273752633070967 Gaussian PSF norm 0.16330834287495913 vs pixelized 0.13223231 average tim pixel scale / coadd scale: 0.9908865184615586 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.19 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 201 MB, VmData: 230 MB, maxrss: 0.566628 MB Stage fit_on_coadds finished: 2020-06-07T18:01:41.333851 Resources for stage fit_on_coadds : 0.165 s worker CPU, 0.179 s worker Wall, Wall: 0.246 s, Cores in use: 1.44, Total efficiency (on 4 cores): 36.1 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T18:01:41.336341 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 15 potential peaks Of 15 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 11 kept SED z : 11 new peaks Found 22 potential peaks Of 22 potential peaks: 17 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 14 potential peaks Of 14 potential peaks: 12 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 28 potential peaks Of 28 potential peaks: 16 in veto map, 4 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 32 potential peaks Of 32 potential peaks: 26 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 21 new sources Median coadd sky for g : 8.886677e-05 Median coadd sky for r : 0.0004561022 Median coadd sky for z : -0.00016216922 Stage srcs : Wall: 0.57 s, CPU: 0.52 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 201 MB, VmData: 230 MB, maxrss: 0.566628 MB Stage srcs finished: 2020-06-07T18:01:41.906455 Resources for stage srcs : 0.114 s worker CPU, 0.114 s worker Wall, Wall: 0.571 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/PGC2318167-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/PGC2318167-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T18:01:41.921623 Blob 1 of 14, id: 3, sources: 5, size: 136x113, npix 8417, brick X: 60,196, Y: 70,183, one pixel: 175 70 Blob 2 of 14, id: 9, sources: 2, size: 64x55, npix 2230, brick X: 2,66, Y: 161,216, one pixel: 24 161 Blob 3 of 14, id: 1, sources: 2, size: 34x62, npix 1366, brick X: 34,68, Y: 27,89, one pixel: 46 27 Blob 4 of 14, id: 0, sources: 2, size: 38x42, npix 996, brick X: 186,224, Y: 24,66, one pixel: 195 24 Blob 5 of 14, id: 8, sources: 2, size: 30x42, npix 709, brick X: 180,210, Y: 152,194, one pixel: 194 152 Blob 2 finished, total: Wall: 0.70 s, CPU: 0.65 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.1411 MB Blob 6 of 14, id: 7, sources: 1, size: 30x31, npix 635, brick X: 223,253, Y: 126,157, one pixel: 235 126 Blob 5 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.1411 MB Blob 7 of 14, id: 12, sources: 2, size: 25x38, npix 561, brick X: 225,250, Y: 186,224, one pixel: 235 186 Blob 6 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.1411 MB Blob 8 of 14, id: 13, sources: 1, size: 24x24, npix 326, brick X: 165,189, Y: 224,248, one pixel: 175 224 Blob 7 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.1411 MB Blob 9 of 14, id: 10, sources: 1, size: 22x21, npix 278, brick X: 228,250, Y: 161,182, one pixel: 236 161 Blob 10 of 14, id: 11, sources: 1, size: 21x21, npix 270, brick X: 144,165, Y: 164,185, one pixel: 153 164 Measuring 1 iterative sources Blob 4 finished, total: Wall: 2.91 s, CPU: 2.91 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14212 MB Blob 11 of 14, id: 5, sources: 1, size: 20x20, npix 247, brick X: 44,64, Y: 110,130, one pixel: 53 110 Blob 9 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14212 MB Blob 12 of 14, id: 4, sources: 1, size: 20x20, npix 229, brick X: 208,228, Y: 99,119, one pixel: 217 99 Blob 3 finished, total: Wall: 3.03 s, CPU: 2.98 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143872 MB Blob 13 of 14, id: 6, sources: 1, size: 15x18, npix 168, brick X: 0,15, Y: 118,136, one pixel: 5 118 Blob 8 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.1411 MB Blob 14 of 14, id: 2, sources: 1, size: 13x17, npix 129, brick X: 242,255, Y: 57,74, one pixel: 250 57 Blob 12 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141444 MB Blob 11 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143872 MB Blob 13 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141444 MB Blob 14 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143872 MB Blob 10 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14212 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.265344, ee1=-0.0921872, ee2=0.0997435 Measuring 1 iterative sources Blob 1 finished, total: Wall: 5.73 s, CPU: 5.73 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 178 MB, maxrss: 0.145264 MB Old catalog: 25 New catalog: 20 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/metrics/cus/blobs-custom-228450p48468.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/metrics/cus/all-models-custom-228450p48468.fits Stage fitblobs : Wall: 6.07 s, CPU: 0.36 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.566628 MB Stage fitblobs finished: 2020-06-07T18:01:47.995860 Resources for stage fitblobs : 16.457 s worker CPU, 16.597 s worker Wall, Wall: 6.076 s, Cores in use: 2.77, Total efficiency (on 4 cores): 69.2 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T18:01:47.997794 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/tmp-legacysurvey-custom-228450p48468-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/tmp-legacysurvey-custom-228450p48468-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/tmp-legacysurvey-custom-228450p48468-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/tmp-legacysurvey-custom-228450p48468-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-resid.jpg Stage coadds : Wall: 1.24 s, CPU: 0.57 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.566628 MB Stage coadds finished: 2020-06-07T18:01:49.237380 Resources for stage coadds : 1.935 s worker CPU, 2.039 s worker Wall, Wall: 1.241 s, Cores in use: 2.02, Total efficiency (on 4 cores): 50.4 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T18:01:49.239069 Cut to 1 unWISE tiles Reading WISE tile 2294p484 band 1 Reading WISE tile 2294p484 band 2 Reading WISE tile 2294p484 band 3 Reading WISE tile 2294p484 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.186652 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 802 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207536 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207292 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p484/unwise-2294p484-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208864 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/tmp-legacysurvey-custom-228450p48468-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/tmp-legacysurvey-custom-228450p48468-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.43 s, CPU: 0.36 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 203 MB, VmData: 230 MB, maxrss: 0.566628 MB Stage wise_forced finished: 2020-06-07T18:01:51.669114 Resources for stage wise_forced : 4.342 s worker CPU, 6.279 s worker Wall, Wall: 2.431 s, Cores in use: 1.94, Total efficiency (on 4 cores): 48.4 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T18:01:51.670913 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/coadd/cus/custom-228450p48468/legacysurvey-custom-228450p48468-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/tractor-i/cus/tractor-custom-228450p48468.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/tractor/cus/tractor-custom-228450p48468.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2318167/tractor/cus/brick-custom-228450p48468.sha256sum Stage writecat : Wall: 0.71 s, CPU: 0.48 s, VmPeak: 1098 MB, VmSize: 970 MB, VmRSS: 205 MB, VmData: 230 MB, maxrss: 0.566628 MB Stage writecat finished: 2020-06-07T18:01:52.381758 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.712 s, Cores in use: 0.68, Total efficiency (on 4 cores): 16.9 % Stage writecat finished All done: 26.849 s worker CPU, 42.545 s worker Wall, Wall: 24.163 s, Cores in use: 1.35, Total efficiency (on 4 cores): 33.8 % Finished galaxy PGC2318167 in 0.454 minutes.