Started working on galaxy PGC3137915 at Sun Jun 7 19:04:04 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.77246050000002 62.423472600000004 --width 323 --height 323 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/PGC3137915-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/PGC3137915-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T19:04:05.133780 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '206.77246050000002', '62.423472600000004', '--width', '323', '--height', '323', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/PGC3137915-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/PGC3137915-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.77246050000002 62.423472600000004 --width 323 --height 323 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/PGC3137915-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/PGC3137915-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 206.77246050000002 62.423472600000004 Starting process 25539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 25541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 25540 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 25542 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T19:04:05.804374 Keeping 9 CCDs: k4m_170511_080314_ooi_zd_ls9.fits.fz k4m_170511_080314_ooi_zd_ls9-CCD3 z exptime 80.106 propid 2016A-0453 seeing 0.85 MJD 57884.336 object MzLS_694179_z k4m_170410_084919_ooi_zd_ls9.fits.fz k4m_170410_084919_ooi_zd_ls9-CCD3 z exptime 120.103 propid 2016A-0453 seeing 1.14 MJD 57853.368 object MzLS_694761_z k4m_170615_072659_ooi_zd_ls9.fits.fz k4m_170615_072659_ooi_zd_ls9-CCD2 z exptime 250.104 propid 2016A-0453 seeing 1.53 MJD 57919.310 object MzLS_693594_z k4m_170414_083929_ooi_zd_ls9.fits.fz k4m_170414_083929_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 0.95 MJD 57857.361 object MzLS_694762_z ksb_170301_101811_ooi_g_ls9.fits.fz ksb_170301_101811_ooi_g_ls9-CCD1 g exptime 98.976 propid BASS seeing 1.59 MJD 57813.429 object 39362 ksb_170531_071626_ooi_r_ls9.fits.fz ksb_170531_071626_ooi_r_ls9-CCD1 r exptime 119.612 propid 2015A-0801 seeing 1.70 MJD 57904.303 object 39362 ksb_180224_094528_ooi_r_ls9.fits.fz ksb_180224_094528_ooi_r_ls9-CCD4 r exptime 250.0 propid BASS seeing 1.69 MJD 58173.407 object 40293 ksb_160606_050824_ooi_g_ls9.fits.fz ksb_160606_050824_ooi_g_ls9-CCD3 g exptime 108.0 propid BASS seeing 1.68 MJD 57545.214 object 39371 ksb_170418_073024_ooi_r_ls9.fits.fz ksb_170418_073024_ooi_r_ls9-CCD3 r exptime 77.107 propid BASS seeing 1.33 MJD 57861.313 object 39371 mosaic get_fwhm: self.fwhm = 3.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 541 876 and amp range 0 2005 and image y 348 688 and amp range 0 2039 Range in image: x 0 336 , y 0 341 (with image size 336 x 341) dzp 0.007397243 -> scaling image by 1.006836374469654 mosaic get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3280 3605 and amp range 2006 4053 and image y 832 1158 and amp range 0 2039 Range in image: x 0 326 , y 0 327 (with image size 326 x 327) dzp -0.016180232 -> scaling image by 0.9852079488029655 mosaic get_fwhm: self.fwhm = 5.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1710 2040 and amp range 0 2047 and image y 1235 1564 and amp range 0 2039 Range in image: x 0 331 , y 0 330 (with image size 331 x 330) dzp -0.0096683735 -> scaling image by 0.9911346301237048 Faked up EXPNUM 78130101 Faked up EXPNUM 78130101 Faked up EXPNUM 78130101 90prime get_fwhm: self.fwhm = 3.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2583 2774 and amp range 2016 4031 and image y 1537 1727 and amp range 0 2047 Range in image: x 0 192 , y 0 191 (with image size 192 x 191) dzp -0.011406615 -> scaling image by 0.9895491130016149 Faked up EXPNUM 79040073 Faked up EXPNUM 79040073 Faked up EXPNUM 79040073 90prime get_fwhm: self.fwhm = 3.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2608 2799 and amp range 2016 4031 and image y 1531 1721 and amp range 0 2047 Range in image: x 0 192 , y 0 191 (with image size 192 x 191) dzp -0.006547878 -> scaling image by 0.9939873303458991 Faked up EXPNUM 81730108 Faked up EXPNUM 81730108 Faked up EXPNUM 81730108 90prime get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2453 2641 and amp range 2016 4031 and image y 3329 3519 and amp range 2048 4095 Range in image: x 0 189 , y 0 191 (with image size 189 x 191) dzp 0.044050463 -> scaling image by 1.0414062625929388 Faked up EXPNUM 75450058 Faked up EXPNUM 75450058 Faked up EXPNUM 75450058 90prime get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 621 812 and amp range 0 2015 and image y 2980 3169 and amp range 2048 4095 Range in image: x 0 192 , y 0 190 (with image size 192 x 190) dzp -0.0045482004 -> scaling image by 0.9958197144381092 Faked up EXPNUM 78610068 Faked up EXPNUM 78610068 Faked up EXPNUM 78610068 90prime get_fwhm: self.fwhm = 2.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 649 840 and amp range 0 2015 and image y 2991 3180 and amp range 2048 4095 Range in image: x 0 192 , y 0 190 (with image size 192 x 190) dzp -0.07725406 -> scaling image by 0.9313188157188347 Stage tims : Wall: 6.24 s, CPU: 1.01 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.566556 MB Stage tims finished: 2020-06-07T19:04:12.044781 Resources for stage tims : 3.639 s worker CPU, 13.594 s worker Wall, Wall: 6.242 s, Cores in use: 0.74, Total efficiency (on 4 cores): 18.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/PGC3137915-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/PGC3137915-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T19:04:12.161634 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00653.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00727.fits Matched 7 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/metrics/cus/reference-custom-206772p62423.fits Stage refs : Wall: 1.75 s, CPU: 1.44 s, VmPeak: 972 MB, VmSize: 954 MB, VmRSS: 186 MB, VmData: 218 MB, maxrss: 0.566556 MB Stage refs finished: 2020-06-07T19:04:13.915888 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.755 s, Cores in use: 0.82, Total efficiency (on 4 cores): 20.5 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T19:04:13.917359 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/metrics/cus/outlier-mask-custom-206772p62423.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/metrics/cus/outliers-pre-custom-206772p62423.jpg Image ksb_160606_050824_ooi_g_ls9-CCD3 g : masking 96 positive outlier pixels and 0 negative outlier pixels Image ksb_170531_071626_ooi_r_ls9-CCD1 r : masking 84 positive outlier pixels and 0 negative outlier pixels Image k4m_170615_072659_ooi_zd_ls9-CCD2 z : masking 1011 positive outlier pixels and 0 negative outlier pixels Image k4m_170511_080314_ooi_zd_ls9-CCD3 z : masking 1954 positive outlier pixels and 0 negative outlier pixels Image k4m_170414_083929_ooi_zd_ls9-CCD1 z : masking 219 positive outlier pixels and 358 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/metrics/cus/outlier-mask-custom-206772p62423.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/metrics/cus/outliers-post-custom-206772p62423.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/metrics/cus/outliers-masked-pos-custom-206772p62423.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/metrics/cus/outliers-masked-neg-custom-206772p62423.jpg Stage outliers : Wall: 2.19 s, CPU: 0.90 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 204 MB, VmData: 234 MB, maxrss: 0.566556 MB Stage outliers finished: 2020-06-07T19:04:16.107704 Resources for stage outliers : 1.195 s worker CPU, 1.247 s worker Wall, Wall: 2.191 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.9 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T19:04:16.109267 Stage halos : Wall: 0.58 s, CPU: 0.47 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 204 MB, VmData: 234 MB, maxrss: 0.566556 MB Stage halos finished: 2020-06-07T19:04:16.694303 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.586 s, Cores in use: 0.80, Total efficiency (on 4 cores): 20.1 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T19:04:16.695912 PSF sigmas in coadd pixels: ['2.58', '2.73'] Using average PSF sigma 2.656243418451834 Gaussian PSF norm 0.10620065533688716 vs pixelized 0.091100365 average tim pixel scale / coadd scale: 1.7291483338673435 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.76', '2.75', '2.16'] Using average PSF sigma 2.5546032377130543 Gaussian PSF norm 0.11042606836528422 vs pixelized 0.08711553 average tim pixel scale / coadd scale: 1.7300173498064506 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.39', '2.49', '1.55'] Using average PSF sigma 1.8089099620870834 Gaussian PSF norm 0.15594739245529002 vs pixelized 0.09763861 average tim pixel scale / coadd scale: 0.9908825194619538 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.27 s, CPU: 0.22 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.566556 MB Stage fit_on_coadds finished: 2020-06-07T19:04:16.970266 Resources for stage fit_on_coadds : 0.284 s worker CPU, 0.298 s worker Wall, Wall: 0.275 s, Cores in use: 1.82, Total efficiency (on 4 cores): 45.5 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T19:04:16.972750 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 15 potential peaks Of 15 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 12 kept SED z : 12 new peaks Found 14 potential peaks Of 14 potential peaks: 10 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 10 potential peaks Of 10 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 23 potential peaks Of 23 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 24 potential peaks Of 24 potential peaks: 20 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 18 new sources Median coadd sky for g : 7.913521e-05 Median coadd sky for r : 6.970985e-05 Median coadd sky for z : 1.2901159e-05 Stage srcs : Wall: 0.68 s, CPU: 0.61 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.566556 MB Stage srcs finished: 2020-06-07T19:04:17.648170 Resources for stage srcs : 0.179 s worker CPU, 0.190 s worker Wall, Wall: 0.676 s, Cores in use: 1.17, Total efficiency (on 4 cores): 29.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/PGC3137915-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/PGC3137915-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T19:04:17.665181 Blob 1 of 14, id: 6, sources: 5, size: 210x114, npix 10943, brick X: 54,264, Y: 99,213, one pixel: 101 99 Blob 2 of 14, id: 1, sources: 2, size: 63x37, npix 1197, brick X: 232,295, Y: 27,64, one pixel: 271 27 Blob 3 of 14, id: 12, sources: 1, size: 39x34, npix 932, brick X: 11,50, Y: 229,263, one pixel: 28 229 Blob 4 of 14, id: 3, sources: 1, size: 39x35, npix 927, brick X: 68,107, Y: 62,97, one pixel: 82 62 Blob 5 of 14, id: 4, sources: 1, size: 26x26, npix 440, brick X: 46,72, Y: 88,114, one pixel: 56 88 Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143492 MB Blob 6 of 14, id: 13, sources: 1, size: 30x21, npix 429, brick X: 102,132, Y: 302,323, one pixel: 113 302 Blob 2 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143236 MB Blob 7 of 14, id: 7, sources: 1, size: 26x23, npix 373, brick X: 165,191, Y: 103,126, one pixel: 175 103 Blob 3 finished, total: Wall: 1.42 s, CPU: 1.42 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14294 MB Blob 8 of 14, id: 8, sources: 1, size: 24x24, npix 359, brick X: 292,316, Y: 137,161, one pixel: 301 137 Blob 7 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14294 MB Blob 9 of 14, id: 9, sources: 1, size: 23x23, npix 328, brick X: 87,110, Y: 177,200, one pixel: 96 177 Blob 10 of 14, id: 5, sources: 1, size: 22x23, npix 323, brick X: 185,207, Y: 89,112, one pixel: 194 89 Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143816 MB Blob 11 of 14, id: 2, sources: 1, size: 22x23, npix 295, brick X: 116,138, Y: 39,62, one pixel: 126 39 Blob 5 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144044 MB Blob 12 of 14, id: 0, sources: 1, size: 21x19, npix 245, brick X: 288,309, Y: 0,19, one pixel: 295 0 Blob 8 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14294 MB Blob 13 of 14, id: 10, sources: 1, size: 17x18, npix 162, brick X: 45,62, Y: 184,202, one pixel: 53 184 Blob 9 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143816 MB Blob 14 of 14, id: 11, sources: 1, size: 17x18, npix 162, brick X: 175,192, Y: 218,236, one pixel: 183 218 Blob 12 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143816 MB Blob 13 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143816 MB Blob 14 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143816 MB Blob 10 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144044 MB Blob 11 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14294 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.96761, ee1=-0.445304, ee2=-0.423987 Measuring 1 iterative sources Blob 1 finished, total: Wall: 6.47 s, CPU: 6.47 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 178 MB, maxrss: 0.145668 MB Old catalog: 20 New catalog: 20 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/metrics/cus/blobs-custom-206772p62423.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/metrics/cus/all-models-custom-206772p62423.fits Stage fitblobs : Wall: 6.91 s, CPU: 0.44 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.566556 MB Stage fitblobs finished: 2020-06-07T19:04:24.577728 Resources for stage fitblobs : 14.375 s worker CPU, 14.463 s worker Wall, Wall: 6.914 s, Cores in use: 2.14, Total efficiency (on 4 cores): 53.6 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T19:04:24.579504 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/tmp-legacysurvey-custom-206772p62423-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/tmp-legacysurvey-custom-206772p62423-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/tmp-legacysurvey-custom-206772p62423-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/tmp-legacysurvey-custom-206772p62423-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-resid.jpg Stage coadds : Wall: 1.58 s, CPU: 0.84 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.566556 MB Stage coadds finished: 2020-06-07T19:04:26.161453 Resources for stage coadds : 1.899 s worker CPU, 2.076 s worker Wall, Wall: 1.583 s, Cores in use: 1.73, Total efficiency (on 4 cores): 43.2 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T19:04:26.163110 Cut to 2 unWISE tiles Reading WISE tile 2052p620 band 1 Reading WISE tile 2052p620 band 2 Reading WISE tile 2052p620 band 4 Reading WISE tile 2052p620 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2084p620 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2084p620 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2084p620 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2084p620 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 796 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.188036 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.205096 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.208828 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2084p620/unwise-2084p620-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 802 MB, VmSize: 794 MB, VmRSS: 149 MB, VmData: 176 MB, maxrss: 0.209176 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/tmp-legacysurvey-custom-206772p62423-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/tmp-legacysurvey-custom-206772p62423-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.98 s, CPU: 0.56 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.566556 MB Stage wise_forced finished: 2020-06-07T19:04:30.140921 Resources for stage wise_forced : 8.601 s worker CPU, 11.141 s worker Wall, Wall: 3.979 s, Cores in use: 2.30, Total efficiency (on 4 cores): 57.6 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T19:04:30.142608 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/coadd/cus/custom-206772p62423/legacysurvey-custom-206772p62423-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/tractor-i/cus/tractor-custom-206772p62423.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/tractor/cus/tractor-custom-206772p62423.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC3137915/tractor/cus/brick-custom-206772p62423.sha256sum Stage writecat : Wall: 0.93 s, CPU: 0.71 s, VmPeak: 1096 MB, VmSize: 968 MB, VmRSS: 211 MB, VmData: 235 MB, maxrss: 0.566556 MB Stage writecat finished: 2020-06-07T19:04:31.072149 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.931 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.2 % Stage writecat finished All done: 30.174 s worker CPU, 43.011 s worker Wall, Wall: 25.274 s, Cores in use: 1.48, Total efficiency (on 4 cores): 37.0 % Finished galaxy PGC3137915 in 0.456 minutes.