Started working on galaxy PGC2350635 at Sun Jun 7 19:53:32 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 265.6406535 49.6948256 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/PGC2350635-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/PGC2350635-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T19:53:33.256505 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '265.6406535', '49.6948256', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/PGC2350635-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/PGC2350635-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 265.6406535 49.6948256 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/PGC2350635-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/PGC2350635-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 265.6406535 49.6948256 Starting process 63859 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 63862 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 63868 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 63874 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T19:53:33.560334 Keeping 10 CCDs: k4m_160523_084851_ooi_zd_ls9.fits.fz k4m_160523_084851_ooi_zd_ls9-CCD1 z exptime 119.105 propid 2016A-0453 seeing 1.08 MJD 57531.367 object MzLS_648698_z k4m_170517_105426_ooi_zd_ls9.fits.fz k4m_170517_105426_ooi_zd_ls9-CCD3 z exptime 206.1 propid 2016A-0453 seeing 1.23 MJD 57890.454 object MzLS_649507_z k4m_160516_092423_ooi_zd_ls9.fits.fz k4m_160516_092423_ooi_zd_ls9-CCD4 z exptime 80.102 propid 2016A-0453 seeing 1.06 MJD 57524.392 object MzLS_647883_z ksb_160707_075308_ooi_g_ls9.fits.fz ksb_160707_075308_ooi_g_ls9-CCD3 g exptime 238.3 propid BASS seeing 2.74 MJD 57576.329 object 25982 ksb_180418_095642_ooi_g_ls9.fits.fz ksb_180418_095642_ooi_g_ls9-CCD3 g exptime 90.288 propid BASS seeing 1.44 MJD 58226.414 object 25982 ksb_160604_080829_ooi_r_ls9.fits.fz ksb_160604_080829_ooi_r_ls9-CCD4 r exptime 51.4 propid BASS seeing 1.44 MJD 57543.339 object 27141 ksb_170528_103022_ooi_g_ls9.fits.fz ksb_170528_103022_ooi_g_ls9-CCD4 g exptime 143.317 propid 2015A-0801 seeing 1.61 MJD 57901.438 object 27141 ksb_180510_084130_ooi_g_ls9.fits.fz ksb_180510_084130_ooi_g_ls9-CCD2 g exptime 119.68 propid NOTBASS seeing 1.43 MJD 58248.362 object 27143 ksb_170501_100107_ooi_r_ls9.fits.fz ksb_170501_100107_ooi_r_ls9-CCD2 r exptime 62.87 propid BASS seeing 1.07 MJD 57874.417 object 27143 ksb_160612_101851_ooi_r_ls9.fits.fz ksb_160612_101851_ooi_r_ls9-CCD3 r exptime 76.5 propid BASS seeing 1.64 MJD 57551.430 object 25982 mosaic get_fwhm: self.fwhm = 4.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3020 3267 and amp range 2006 4053 and image y 741 992 and amp range 0 2039 Range in image: x 0 248 , y 0 252 (with image size 248 x 252) dzp 0.001388291 -> scaling image by 1.0012794811153327 Faked up EXPNUM 75760076 Faked up EXPNUM 75760076 Faked up EXPNUM 75760076 90prime get_fwhm: self.fwhm = 6.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 532 676 and amp range 0 2015 and image y 3040 3183 and amp range 2048 4095 Range in image: x 0 145 , y 0 144 (with image size 145 x 144) dzp -0.0045482004 -> scaling image by 0.9958197144381092 mosaic get_fwhm: self.fwhm = 4.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1458 1708 and amp range 0 2047 and image y 2342 2590 and amp range 2022 4060 Range in image: x 0 251 , y 0 249 (with image size 251 x 249) dzp 0.0033053984 -> scaling image by 1.0030490232713904 Faked up EXPNUM 82260150 Faked up EXPNUM 82260150 Faked up EXPNUM 82260150 90prime get_fwhm: self.fwhm = 3.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 520 664 and amp range 0 2015 and image y 3069 3213 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp -0.027600318 -> scaling image by 0.9748995562775561 Faked up EXPNUM 75430134 Faked up EXPNUM 75430134 Faked up EXPNUM 75430134 90prime get_fwhm: self.fwhm = 3.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2283 2427 and amp range 2016 4031 and image y 184 326 and amp range 0 2047 Range in image: x 0 145 , y 0 143 (with image size 145 x 143) dzp 0.0047082007 -> scaling image by 1.0043458289369953 mosaic get_fwhm: self.fwhm = 4.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 302 555 and amp range 0 2005 and image y 2538 2793 and amp range 2040 4078 Range in image: x 0 254 , y 0 256 (with image size 254 x 256) dzp 0.012956044 -> scaling image by 1.012004439021001 Faked up EXPNUM 79010176 Faked up EXPNUM 79010176 Faked up EXPNUM 79010176 90prime get_fwhm: self.fwhm = 3.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2298 2441 and amp range 2016 4031 and image y 185 328 and amp range 0 2047 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.016679538 -> scaling image by 1.0154810312115594 Faked up EXPNUM 82480138 Faked up EXPNUM 82480138 Faked up EXPNUM 82480138 90prime get_fwhm: self.fwhm = 3.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 256 399 and amp range 0 2015 and image y 2624 2768 and amp range 2048 4095 Range in image: x 0 144 , y 0 145 (with image size 144 x 145) dzp 0.0459271 -> scaling image by 1.0432078344950917 Faked up EXPNUM 78740237 Faked up EXPNUM 78740237 Faked up EXPNUM 78740237 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 267 410 and amp range 0 2015 and image y 2643 2786 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.05525464 -> scaling image by 1.0522086198429996 Faked up EXPNUM 75510119 Faked up EXPNUM 75510119 Faked up EXPNUM 75510119 90prime get_fwhm: self.fwhm = 3.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 516 660 and amp range 0 2015 and image y 3038 3181 and amp range 2048 4095 Range in image: x 0 145 , y 0 144 (with image size 145 x 144) dzp -0.011545347 -> scaling image by 0.9894226798649194 Stage tims : Wall: 5.61 s, CPU: 0.93 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.56828 MB Stage tims finished: 2020-06-07T19:53:39.171645 Resources for stage tims : 3.815 s worker CPU, 13.993 s worker Wall, Wall: 5.613 s, Cores in use: 0.85, Total efficiency (on 4 cores): 21.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/PGC2350635-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/PGC2350635-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T19:53:39.220049 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01594.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01483.fits Matched 4 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/metrics/cus/reference-custom-265640p49694.fits Stage refs : Wall: 4.17 s, CPU: 3.72 s, VmPeak: 983 MB, VmSize: 977 MB, VmRSS: 207 MB, VmData: 240 MB, maxrss: 0.56828 MB Stage refs finished: 2020-06-07T19:53:43.388543 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.170 s, Cores in use: 0.89, Total efficiency (on 4 cores): 22.3 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T19:53:43.390256 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/metrics/cus/outlier-mask-custom-265640p49694.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/metrics/cus/outliers-pre-custom-265640p49694.jpg Image ksb_170501_100107_ooi_r_ls9-CCD2 r : masking 102 positive outlier pixels and 0 negative outlier pixels Image ksb_160612_101851_ooi_r_ls9-CCD3 r : masking 90 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/metrics/cus/outlier-mask-custom-265640p49694.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/metrics/cus/outliers-post-custom-265640p49694.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/metrics/cus/outliers-masked-pos-custom-265640p49694.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/metrics/cus/outliers-masked-neg-custom-265640p49694.jpg Stage outliers : Wall: 0.78 s, CPU: 0.54 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 218 MB, VmData: 250 MB, maxrss: 0.56828 MB Stage outliers finished: 2020-06-07T19:53:44.171100 Resources for stage outliers : 0.846 s worker CPU, 0.858 s worker Wall, Wall: 0.782 s, Cores in use: 1.77, Total efficiency (on 4 cores): 44.3 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T19:53:44.173204 Stage halos : Wall: 0.27 s, CPU: 0.26 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 219 MB, VmData: 250 MB, maxrss: 0.56828 MB Stage halos finished: 2020-06-07T19:53:44.440376 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.268 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T19:53:44.442390 PSF sigmas in coadd pixels: ['4.45', '2.33', '2.61', '2.32'] Using average PSF sigma 2.92973009876916 Gaussian PSF norm 0.09628695554323997 vs pixelized 0.07510631 average tim pixel scale / coadd scale: 1.7300618553395517 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.33', '1.73', '2.67'] Using average PSF sigma 2.244677400732655 Gaussian PSF norm 0.12567275443758796 vs pixelized 0.109846964 average tim pixel scale / coadd scale: 1.729552399452406 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.76', '1.99', '1.72'] Using average PSF sigma 1.8258436307884585 Gaussian PSF norm 0.15450106844695155 vs pixelized 0.12255825 average tim pixel scale / coadd scale: 0.9909309740071647 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.20 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 222 MB, VmData: 251 MB, maxrss: 0.56828 MB Stage fit_on_coadds finished: 2020-06-07T19:53:44.658520 Resources for stage fit_on_coadds : 0.194 s worker CPU, 0.200 s worker Wall, Wall: 0.217 s, Cores in use: 1.82, Total efficiency (on 4 cores): 45.5 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T19:53:44.661324 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 37 potential peaks Of 37 potential peaks: 7 in veto map, 3 cut by saddle test, 0 cut by aper test, 27 kept SED z : 27 new peaks Found 27 potential peaks Of 27 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 28 potential peaks Of 28 potential peaks: 24 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 40 potential peaks Of 40 potential peaks: 33 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 45 potential peaks Of 45 potential peaks: 37 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 31 new sources Median coadd sky for g : 0.00015723104 Median coadd sky for r : 0.0003193607 Median coadd sky for z : -0.00018911478 Stage srcs : Wall: 0.47 s, CPU: 0.43 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 222 MB, VmData: 251 MB, maxrss: 0.56828 MB Stage srcs finished: 2020-06-07T19:53:45.130220 Resources for stage srcs : 0.107 s worker CPU, 0.108 s worker Wall, Wall: 0.470 s, Cores in use: 1.14, Total efficiency (on 4 cores): 28.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/PGC2350635-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/PGC2350635-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T19:53:45.142765 Blob 1 of 12, id: 4, sources: 16, size: 182x155, npix 16776, brick X: 31,213, Y: 25,180, one pixel: 95 25 Blob 2 of 12, id: 7, sources: 2, size: 45x50, npix 1570, brick X: 0,45, Y: 140,190, one pixel: 14 140 Blob 3 of 12, id: 5, sources: 2, size: 24x74, npix 1277, brick X: 221,245, Y: 56,130, one pixel: 232 56 Blob 4 of 12, id: 8, sources: 3, size: 50x51, npix 1194, brick X: 187,237, Y: 176,227, one pixel: 198 176 Blob 5 of 12, id: 6, sources: 2, size: 32x52, npix 994, brick X: 4,36, Y: 68,120, one pixel: 16 68 Measuring 2 iterative sources Blob 2 finished, total: Wall: 1.70 s, CPU: 1.69 s, VmPeak: 794 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141868 MB Blob 6 of 12, id: 11, sources: 3, size: 25x49, npix 847, brick X: 0,25, Y: 196,245, one pixel: 4 196 Blob 3 finished, total: Wall: 1.75 s, CPU: 1.75 s, VmPeak: 806 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139532 MB Blob 7 of 12, id: 10, sources: 2, size: 33x40, npix 788, brick X: 107,140, Y: 188,228, one pixel: 120 188 Blob 4 finished, total: Wall: 1.86 s, CPU: 1.85 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142308 MB Blob 8 of 12, id: 0, sources: 1, size: 29x19, npix 382, brick X: 29,58, Y: 0,19, one pixel: 33 0 Blob 9 of 12, id: 1, sources: 1, size: 29x17, npix 364, brick X: 105,134, Y: 0,17, one pixel: 109 0 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (265.65939, 49.70067), pm (-2.1, -2.5), parallax 0.402 with NanoMaggies: g=16.5, r=16, z=15.9 Reset brightness to NanoMaggies: g=16.5, r=16, z=15.9 Blob 6 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141588 MB Blob 10 of 12, id: 9, sources: 1, size: 22x21, npix 280, brick X: 73,95, Y: 187,208, one pixel: 82 187 Blob 5 finished, total: Wall: 1.31 s, CPU: 1.31 s, VmPeak: 794 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1425 MB Blob 11 of 12, id: 3, sources: 1, size: 14x24, npix 241, brick X: 0,14, Y: 23,47, one pixel: 2 23 Blob 7 finished, total: Wall: 1.24 s, CPU: 1.24 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142308 MB Blob 12 of 12, id: 2, sources: 1, size: 19x19, npix 199, brick X: 2,21, Y: 4,23, one pixel: 11 4 Blob 10 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142308 MB Blob 9 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 794 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1425 MB Blob 8 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142012 MB Blob 12 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 794 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1425 MB Blob 11 finished, total: Wall: 0.73 s, CPU: 0.72 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142308 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.71109, ee1=-0.141695, ee2=0.129245 Measuring 7 iterative sources Blob 1 finished, total: Wall: 12.28 s, CPU: 12.28 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144836 MB Old catalog: 40 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/metrics/cus/blobs-custom-265640p49694.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/metrics/cus/all-models-custom-265640p49694.fits Stage fitblobs : Wall: 12.60 s, CPU: 0.32 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 222 MB, VmData: 251 MB, maxrss: 0.56828 MB Stage fitblobs finished: 2020-06-07T19:53:57.741161 Resources for stage fitblobs : 24.389 s worker CPU, 24.411 s worker Wall, Wall: 12.600 s, Cores in use: 1.96, Total efficiency (on 4 cores): 49.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T19:53:57.743269 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/tmp-legacysurvey-custom-265640p49694-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/tmp-legacysurvey-custom-265640p49694-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/tmp-legacysurvey-custom-265640p49694-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/tmp-legacysurvey-custom-265640p49694-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-resid.jpg Stage coadds : Wall: 1.18 s, CPU: 0.50 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 223 MB, VmData: 251 MB, maxrss: 0.56828 MB Stage coadds finished: 2020-06-07T19:53:58.921659 Resources for stage coadds : 2.157 s worker CPU, 2.206 s worker Wall, Wall: 1.179 s, Cores in use: 2.25, Total efficiency (on 4 cores): 56.2 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T19:53:58.923305 Cut to 1 unWISE tiles Reading WISE tile 2647p499 band 1 Reading WISE tile 2647p499 band 2 Reading WISE tile 2647p499 band 3 Reading WISE tile 2647p499 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 807 MB, VmSize: 796 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.194104 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208676 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 794 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.209072 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2647p499/unwise-2647p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 807 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208596 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/tmp-legacysurvey-custom-265640p49694-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/tmp-legacysurvey-custom-265640p49694-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.18 s, CPU: 0.43 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.56828 MB Stage wise_forced finished: 2020-06-07T19:54:04.101848 Resources for stage wise_forced : 4.504 s worker CPU, 5.610 s worker Wall, Wall: 5.180 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T19:54:04.103994 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/coadd/cus/custom-265640p49694/legacysurvey-custom-265640p49694-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/tractor-i/cus/tractor-custom-265640p49694.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/tractor/cus/tractor-custom-265640p49694.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/PGC2350635/tractor/cus/brick-custom-265640p49694.sha256sum Stage writecat : Wall: 2.42 s, CPU: 0.58 s, VmPeak: 1118 MB, VmSize: 990 MB, VmRSS: 226 MB, VmData: 251 MB, maxrss: 0.56828 MB Stage writecat finished: 2020-06-07T19:54:06.524152 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.421 s, Cores in use: 0.24, Total efficiency (on 4 cores): 6.0 % Stage writecat finished All done: 36.014 s worker CPU, 47.390 s worker Wall, Wall: 32.970 s, Cores in use: 1.33, Total efficiency (on 4 cores): 33.3 % Finished galaxy PGC2350635 in 0.576 minutes.