Started working on galaxy PGC2350590 at Sun Jun 7 20:16:11 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.87941700000005 49.6929722 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/PGC2350590-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/PGC2350590-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T20:16:12.670366 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.87941700000005', '49.6929722', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/PGC2350590-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/PGC2350590-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.87941700000005 49.6929722 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/PGC2350590-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/PGC2350590-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 276.87941700000005 49.6929722 Starting process 20836 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 20837 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 20838 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 20839 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T20:16:12.984760 Keeping 9 CCDs: k4m_160523_095919_ooi_zd_ls9.fits.fz k4m_160523_095919_ooi_zd_ls9-CCD3 z exptime 83.106 propid 2016A-0453 seeing 0.91 MJD 57531.416 object MzLS_648710_z k4m_160516_102412_ooi_zd_ls9.fits.fz k4m_160516_102412_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 0.96 MJD 57524.433 object MzLS_647896_z k4m_170831_065611_ooi_zd_ls9.fits.fz k4m_170831_065611_ooi_zd_ls9-CCD1 z exptime 250.101 propid 2016A-0453 seeing 1.37 MJD 57996.289 object MzLS_649520_z ksb_160611_110505_ooi_r_ls9.fits.fz ksb_160611_110505_ooi_r_ls9-CCD2 r exptime 69.6 propid BASS seeing 1.18 MJD 57550.462 object 27211 ksb_180515_104449_ooi_g_ls9.fits.fz ksb_180515_104449_ooi_g_ls9-CCD2 g exptime 109.824 propid NOTBASS seeing 1.41 MJD 58253.448 object 27211 ksb_180518_105049_ooi_r_ls9.fits.fz ksb_180518_105049_ooi_r_ls9-CCD2 r exptime 76.715 propid NOTBASS seeing 1.26 MJD 58256.452 object 27213 ksb_170621_072913_ooi_g_ls9.fits.fz ksb_170621_072913_ooi_g_ls9-CCD2 g exptime 139.3 propid BASS seeing 1.30 MJD 57925.312 object 27213 ksb_160612_105317_ooi_r_ls9.fits.fz ksb_160612_105317_ooi_r_ls9-CCD3 r exptime 86.0 propid BASS seeing 1.32 MJD 57551.454 object 26052 ksb_160706_094923_ooi_g_ls9.fits.fz ksb_160706_094923_ooi_g_ls9-CCD3 g exptime 182.7 propid BASS seeing 1.79 MJD 57575.409 object 26052 mosaic get_fwhm: self.fwhm = 5.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 270 516 and amp range 0 2005 and image y 3973 4072 and amp range 2040 4078 Range in image: x 0 247 , y 0 100 (with image size 247 x 100) dzp 0.014419514 -> scaling image by 1.0133694453441033 mosaic get_fwhm: self.fwhm = 3.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3016 3257 and amp range 2006 4053 and image y 1802 2045 and amp range 0 2039 Range in image: x 0 242 , y 0 238 (with image size 242 x 244) dzp -0.00064781494 -> scaling image by 0.9994035183523652 Found overlap: image x 3016 3257 and amp range 2006 4053 and image y 1802 2045 and amp range 2040 4078 Range in image: x 0 242 , y 238 244 (with image size 242 x 244) dzp -0.0026360443 -> scaling image by 0.99757505842151 Faked up EXPNUM 75500190 Faked up EXPNUM 75500190 Faked up EXPNUM 75500190 90prime get_fwhm: self.fwhm = 2.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2271 2411 and amp range 2016 4031 and image y 3308 3448 and amp range 2048 4095 Range in image: x 0 141 , y 0 141 (with image size 141 x 141) dzp 0.0002007609 -> scaling image by 1.0001849247187462 mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1420 1662 and amp range 0 2047 and image y 268 508 and amp range 0 2021 Range in image: x 0 243 , y 0 241 (with image size 243 x 241) dzp 0.005139143 -> scaling image by 1.0047445456970268 Faked up EXPNUM 82560210 Faked up EXPNUM 82560210 Faked up EXPNUM 82560210 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 270 410 and amp range 0 2015 and image y 1315 1456 and amp range 0 2047 Range in image: x 0 141 , y 0 142 (with image size 141 x 142) dzp -0.003875085 -> scaling image by 0.9964372765054066 Faked up EXPNUM 82530168 Faked up EXPNUM 82530168 Faked up EXPNUM 82530168 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2286 2426 and amp range 2016 4031 and image y 3307 3447 and amp range 2048 4095 Range in image: x 0 141 , y 0 141 (with image size 141 x 141) dzp 0.013237011 -> scaling image by 1.012266359574015 Faked up EXPNUM 79250044 Faked up EXPNUM 79250044 Faked up EXPNUM 79250044 90prime get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 269 409 and amp range 0 2015 and image y 1324 1465 and amp range 0 2047 Range in image: x 0 141 , y 0 142 (with image size 141 x 142) dzp 0.0003063402 -> scaling image by 1.0002821895558327 Faked up EXPNUM 75510134 Faked up EXPNUM 75510134 Faked up EXPNUM 75510134 90prime get_fwhm: self.fwhm = 2.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 537 677 and amp range 0 2015 and image y 591 730 and amp range 0 2047 Range in image: x 0 141 , y 0 140 (with image size 141 x 140) dzp -0.024507914 -> scaling image by 0.9776802328037623 Faked up EXPNUM 75750116 Faked up EXPNUM 75750116 Faked up EXPNUM 75750116 90prime get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 543 683 and amp range 0 2015 and image y 602 741 and amp range 0 2047 Range in image: x 0 141 , y 0 140 (with image size 141 x 140) dzp -0.03470582 -> scaling image by 0.9685402452207784 Stage tims : Wall: 4.10 s, CPU: 0.75 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 203 MB, maxrss: 0.566592 MB Stage tims finished: 2020-06-07T20:16:17.087117 Resources for stage tims : 2.926 s worker CPU, 10.654 s worker Wall, Wall: 4.103 s, Cores in use: 0.90, Total efficiency (on 4 cores): 22.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/PGC2350590-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/PGC2350590-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T20:16:17.102301 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01379.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01486.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01598.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01487.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/metrics/cus/reference-custom-276879p49692.fits Stage refs : Wall: 6.65 s, CPU: 4.35 s, VmPeak: 1014 MB, VmSize: 1007 MB, VmRSS: 238 MB, VmData: 270 MB, maxrss: 0.566592 MB Stage refs finished: 2020-06-07T20:16:23.756809 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.655 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.3 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T20:16:23.758234 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/metrics/cus/outlier-mask-custom-276879p49692.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/metrics/cus/outliers-pre-custom-276879p49692.jpg Image ksb_160706_094923_ooi_g_ls9-CCD3 g : masking 506 positive outlier pixels and 0 negative outlier pixels Image ksb_160611_110505_ooi_r_ls9-CCD2 r : masking 63 positive outlier pixels and 0 negative outlier pixels Image k4m_170831_065611_ooi_zd_ls9-CCD1 z : masking 631 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/metrics/cus/outlier-mask-custom-276879p49692.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/metrics/cus/outliers-post-custom-276879p49692.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/metrics/cus/outliers-masked-pos-custom-276879p49692.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/metrics/cus/outliers-masked-neg-custom-276879p49692.jpg Stage outliers : Wall: 1.29 s, CPU: 0.47 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 250 MB, VmData: 280 MB, maxrss: 0.566592 MB Stage outliers finished: 2020-06-07T20:16:25.046574 Resources for stage outliers : 0.631 s worker CPU, 0.636 s worker Wall, Wall: 1.289 s, Cores in use: 0.85, Total efficiency (on 4 cores): 21.4 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T20:16:25.048114 Stage halos : Wall: 0.13 s, CPU: 0.13 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 250 MB, VmData: 280 MB, maxrss: 0.566592 MB Stage halos finished: 2020-06-07T20:16:25.181855 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.135 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T20:16:25.183449 PSF sigmas in coadd pixels: ['2.29', '2.11', '2.91'] Using average PSF sigma 2.435997055695158 Gaussian PSF norm 0.11580259964369172 vs pixelized 0.09098302 average tim pixel scale / coadd scale: 1.7295149421561082 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.92', '2.04', '2.14'] Using average PSF sigma 2.0340626607551564 Gaussian PSF norm 0.13868539903738708 vs pixelized 0.115303576 average tim pixel scale / coadd scale: 1.7298145338764968 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.48', '1.56', '2.23'] Using average PSF sigma 1.758348273219562 Gaussian PSF norm 0.16043169380623234 vs pixelized 0.13433573 average tim pixel scale / coadd scale: 0.9909118121340587 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.14 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 252 MB, VmData: 280 MB, maxrss: 0.566592 MB Stage fit_on_coadds finished: 2020-06-07T20:16:25.345809 Resources for stage fit_on_coadds : 0.158 s worker CPU, 0.160 s worker Wall, Wall: 0.163 s, Cores in use: 1.82, Total efficiency (on 4 cores): 45.5 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T20:16:25.348047 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 23 potential peaks Of 23 potential peaks: 11 in veto map, 2 cut by saddle test, 0 cut by aper test, 10 kept SED z : 10 new peaks Found 14 potential peaks Of 14 potential peaks: 12 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 12 potential peaks Of 12 potential peaks: 10 in veto map, 0 cut by saddle test, 1 cut by aper test, 1 kept SED g : 1 new peaks Found 20 potential peaks Of 20 potential peaks: 14 in veto map, 1 cut by saddle test, 2 cut by aper test, 3 kept SED Flat : 3 new peaks Found 22 potential peaks Of 22 potential peaks: 19 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 15 new sources Median coadd sky for g : 1.887817e-05 Median coadd sky for r : 0.000103665196 Median coadd sky for z : -0.00017943555 Stage srcs : Wall: 0.32 s, CPU: 0.29 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 252 MB, VmData: 280 MB, maxrss: 0.566592 MB Stage srcs finished: 2020-06-07T20:16:25.669061 Resources for stage srcs : 0.080 s worker CPU, 0.080 s worker Wall, Wall: 0.322 s, Cores in use: 1.14, Total efficiency (on 4 cores): 28.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/PGC2350590-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/PGC2350590-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T20:16:25.679375 Blob 1 of 12, id: 5, sources: 7, size: 124x153, npix 13254, brick X: 57,181, Y: 55,208, one pixel: 104 55 Blob 2 of 12, id: 1, sources: 3, size: 42x30, npix 816, brick X: 152,194, Y: 0,30, one pixel: 174 0 Blob 3 of 12, id: 2, sources: 1, size: 25x27, npix 545, brick X: 214,239, Y: 0,27, one pixel: 221 0 Blob 4 of 12, id: 0, sources: 1, size: 29x18, npix 363, brick X: 105,134, Y: 0,18, one pixel: 108 0 Blob 5 of 12, id: 3, sources: 1, size: 23x24, npix 360, brick X: 95,118, Y: 19,43, one pixel: 105 19 Blob 4 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139728 MB Blob 6 of 12, id: 10, sources: 1, size: 24x24, npix 355, brick X: 205,229, Y: 189,213, one pixel: 215 189 Measuring 1 iterative sources Blob 5 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139728 MB Blob 7 of 12, id: 8, sources: 1, size: 24x24, npix 353, brick X: 171,195, Y: 137,161, one pixel: 182 137 Blob 3 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141524 MB Blob 8 of 12, id: 11, sources: 1, size: 19x26, npix 352, brick X: 220,239, Y: 208,234, one pixel: 230 208 Blob 9 of 12, id: 6, sources: 1, size: 17x21, npix 232, brick X: 222,239, Y: 86,107, one pixel: 230 86 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.87247, 49.68123), pm (5.7, -7.5), parallax 1.226 with NanoMaggies: g=20.4, r=19, z=17.8 Reset brightness to NanoMaggies: g=20.4, r=19, z=17.8 Blob 2 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139388 MB Blob 10 of 12, id: 7, sources: 1, size: 19x19, npix 208, brick X: 192,211, Y: 120,139, one pixel: 200 120 Blob 7 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141524 MB Blob 11 of 12, id: 4, sources: 1, size: 18x18, npix 180, brick X: 167,185, Y: 43,61, one pixel: 175 43 Blob 6 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139728 MB Blob 12 of 12, id: 9, sources: 1, size: 17x17, npix 145, brick X: 1,18, Y: 140,157, one pixel: 9 140 Blob 10 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139728 MB Blob 9 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141524 MB Blob 11 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139728 MB Blob 12 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141524 MB Blob 8 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141384 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.48561, ee1=-0.153592, ee2=-0.378325 Measuring 4 iterative sources Blob 1 finished, total: Wall: 8.13 s, CPU: 8.13 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144108 MB Old catalog: 25 New catalog: 24 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/metrics/cus/blobs-custom-276879p49692.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/metrics/cus/all-models-custom-276879p49692.fits Stage fitblobs : Wall: 8.34 s, CPU: 0.20 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 252 MB, VmData: 280 MB, maxrss: 0.566592 MB Stage fitblobs finished: 2020-06-07T20:16:34.015499 Resources for stage fitblobs : 13.858 s worker CPU, 13.882 s worker Wall, Wall: 8.337 s, Cores in use: 1.69, Total efficiency (on 4 cores): 42.2 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T20:16:34.017127 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/tmp-legacysurvey-custom-276879p49692-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/tmp-legacysurvey-custom-276879p49692-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/tmp-legacysurvey-custom-276879p49692-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/tmp-legacysurvey-custom-276879p49692-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-resid.jpg Stage coadds : Wall: 1.00 s, CPU: 0.42 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.566592 MB Stage coadds finished: 2020-06-07T20:16:35.021300 Resources for stage coadds : 1.784 s worker CPU, 1.829 s worker Wall, Wall: 1.005 s, Cores in use: 2.19, Total efficiency (on 4 cores): 54.8 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T20:16:35.022634 Cut to 1 unWISE tiles Reading WISE tile 2763p499 band 1 Reading WISE tile 2763p499 band 2 Reading WISE tile 2763p499 band 4 Reading WISE tile 2763p499 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 807 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.189264 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.206272 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 809 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20836 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2763p499/unwise-2763p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 811 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208572 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/tmp-legacysurvey-custom-276879p49692-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/tmp-legacysurvey-custom-276879p49692-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.10 s, CPU: 0.34 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.566592 MB Stage wise_forced finished: 2020-06-07T20:16:37.125884 Resources for stage wise_forced : 4.524 s worker CPU, 5.750 s worker Wall, Wall: 2.104 s, Cores in use: 2.31, Total efficiency (on 4 cores): 57.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T20:16:37.127432 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/coadd/cus/custom-276879p49692/legacysurvey-custom-276879p49692-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/tractor-i/cus/tractor-custom-276879p49692.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/tractor/cus/tractor-custom-276879p49692.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2350590/tractor/cus/brick-custom-276879p49692.sha256sum Stage writecat : Wall: 0.66 s, CPU: 0.47 s, VmPeak: 1149 MB, VmSize: 1021 MB, VmRSS: 255 MB, VmData: 280 MB, maxrss: 0.566592 MB Stage writecat finished: 2020-06-07T20:16:37.783200 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.657 s, Cores in use: 0.72, Total efficiency (on 4 cores): 17.9 % Stage writecat finished All done: 23.963 s worker CPU, 32.993 s worker Wall, Wall: 24.803 s, Cores in use: 1.27, Total efficiency (on 4 cores): 31.8 % Finished galaxy PGC2350590 in 0.436 minutes.