Started working on galaxy DR8-2027p630-2328 at Sun Jun 7 16:36:51 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 202.603467094312 63.0481907463965 --width 349 --height 349 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/DR8-2027p630-2328-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/DR8-2027p630-2328-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T16:36:52.726642 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '202.603467094312', '63.0481907463965', '--width', '349', '--height', '349', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/DR8-2027p630-2328-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/DR8-2027p630-2328-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 202.603467094312 63.0481907463965 --width 349 --height 349 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/DR8-2027p630-2328-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/DR8-2027p630-2328-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 202.603467094312 63.0481907463965 Starting process 27400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 27402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB Starting process 27404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057404 MB Starting process 27407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T16:36:53.565838 Keeping 9 CCDs: k4m_170512_080513_ooi_zd_ls9.fits.fz k4m_170512_080513_ooi_zd_ls9-CCD1 z exptime 83.104 propid 2016A-0453 seeing 0.97 MJD 57885.337 object MzLS_695910_z k4m_170615_064251_ooi_zd_ls9.fits.fz k4m_170615_064251_ooi_zd_ls9-CCD2 z exptime 117.103 propid 2016A-0453 seeing 1.12 MJD 57919.280 object MzLS_695336_z k4m_170416_083259_ooi_zd_ls9.fits.fz k4m_170416_083259_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 1.01 MJD 57859.356 object MzLS_696479_z ksb_170330_083938_ooi_g_ls9.fits.fz ksb_170330_083938_ooi_g_ls9-CCD2 g exptime 106.776 propid BASS seeing 1.77 MJD 57842.361 object 40262 ksb_170531_070119_ooi_r_ls9.fits.fz ksb_170531_070119_ooi_r_ls9-CCD2 r exptime 170.1 propid 2015A-0801 seeing 1.43 MJD 57904.293 object 40262 ksb_180324_114449_ooi_g_ls9.fits.fz ksb_180324_114449_ooi_g_ls9-CCD3 g exptime 108.5 propid BASS seeing 1.41 MJD 58201.489 object 40273 ksb_180118_115128_ooi_r_ls9.fits.fz ksb_180118_115128_ooi_r_ls9-CCD3 r exptime 142.818 propid BASS seeing 2.08 MJD 58136.494 object 40273 ksb_170501_053315_ooi_r_ls9.fits.fz ksb_170501_053315_ooi_r_ls9-CCD1 r exptime 95.357 propid BASS seeing 1.36 MJD 57874.231 object 40261 ksb_160606_052901_ooi_g_ls9.fits.fz ksb_160606_052901_ooi_g_ls9-CCD1 g exptime 108.3 propid BASS seeing 1.37 MJD 57545.228 object 40261 mosaic get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3806 4046 and amp range 2006 4053 and image y 2101 2453 and amp range 2040 4078 Range in image: x 0 241 , y 0 353 (with image size 241 x 353) dzp 0.012593497 -> scaling image by 1.0116665687010755 mosaic get_fwhm: self.fwhm = 3.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1117 1471 and amp range 0 2005 and image y 743 1097 and amp range 0 2039 Range in image: x 0 355 , y 0 355 (with image size 355 x 355) dzp 0.0013971253 -> scaling image by 1.0012876282438632 Faked up EXPNUM 78420162 Faked up EXPNUM 78420162 Faked up EXPNUM 78420162 90prime get_fwhm: self.fwhm = 3.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1403 1607 and amp range 0 2015 and image y 2914 3118 and amp range 2048 4095 Range in image: x 0 205 , y 0 205 (with image size 205 x 205) dzp 0.051889952 -> scaling image by 1.0489528829333021 mosaic get_fwhm: self.fwhm = 4.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2218 2573 and amp range 2048 4095 and image y 2365 2719 and amp range 2040 4078 Range in image: x 0 356 , y 0 355 (with image size 356 x 355) dzp -0.032976374 -> scaling image by 0.9700842429001929 Faked up EXPNUM 79040068 Faked up EXPNUM 79040068 Faked up EXPNUM 79040068 90prime get_fwhm: self.fwhm = 3.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1426 1630 and amp range 0 2015 and image y 2910 3114 and amp range 2048 4095 Range in image: x 0 205 , y 0 205 (with image size 205 x 205) dzp 0.05525464 -> scaling image by 1.0522086198429996 Faked up EXPNUM 81360276 Faked up EXPNUM 81360276 Faked up EXPNUM 81360276 90prime get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1670 1874 and amp range 0 2015 and image y 2462 2665 and amp range 2048 4095 Range in image: x 0 205 , y 0 204 (with image size 205 x 204) dzp -0.038361903 -> scaling image by 0.9652842912941227 Faked up EXPNUM 78740089 Faked up EXPNUM 78740089 Faked up EXPNUM 78740089 90prime get_fwhm: self.fwhm = 3.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3574 3780 and amp range 2016 4031 and image y 952 1159 and amp range 0 2047 Range in image: x 0 207 , y 0 208 (with image size 207 x 208) dzp -0.006547878 -> scaling image by 0.9939873303458991 Faked up EXPNUM 75450065 Faked up EXPNUM 75450065 Faked up EXPNUM 75450065 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3580 3786 and amp range 2016 4031 and image y 947 1153 and amp range 0 2047 Range in image: x 0 207 , y 0 207 (with image size 207 x 207) dzp -0.0032519526 -> scaling image by 0.9970093219958882 Faked up EXPNUM 82010102 Faked up EXPNUM 82010102 Faked up EXPNUM 82010102 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1664 1867 and amp range 0 2015 and image y 2469 2672 and amp range 2048 4095 Range in image: x 0 204 , y 0 204 (with image size 204 x 204) dzp -0.027600318 -> scaling image by 0.9748995562775561 Stage tims : Wall: 8.34 s, CPU: 1.04 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.56648 MB Stage tims finished: 2020-06-07T16:37:01.909468 Resources for stage tims : 3.441 s worker CPU, 19.540 s worker Wall, Wall: 8.345 s, Cores in use: 0.54, Total efficiency (on 4 cores): 13.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/DR8-2027p630-2328-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/DR8-2027p630-2328-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T16:37:01.930967 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00652.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00726.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/metrics/cus/reference-custom-202603p63048.fits Stage refs : Wall: 2.07 s, CPU: 1.49 s, VmPeak: 972 MB, VmSize: 954 MB, VmRSS: 187 MB, VmData: 220 MB, maxrss: 0.56648 MB Stage refs finished: 2020-06-07T16:37:03.998583 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.069 s, Cores in use: 0.72, Total efficiency (on 4 cores): 18.1 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T16:37:04.000092 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/metrics/cus/outlier-mask-custom-202603p63048.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/metrics/cus/outliers-pre-custom-202603p63048.jpg Image ksb_160606_052901_ooi_g_ls9-CCD1 g : masking 104 positive outlier pixels and 0 negative outlier pixels Image ksb_170531_070119_ooi_r_ls9-CCD2 r : masking 239 positive outlier pixels and 0 negative outlier pixels Image k4m_170615_064251_ooi_zd_ls9-CCD2 z : masking 665 positive outlier pixels and 0 negative outlier pixels Image k4m_170512_080513_ooi_zd_ls9-CCD1 z : masking 1015 positive outlier pixels and 0 negative outlier pixels Image k4m_170416_083259_ooi_zd_ls9-CCD3 z : masking 580 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/metrics/cus/outlier-mask-custom-202603p63048.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/metrics/cus/outliers-post-custom-202603p63048.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/metrics/cus/outliers-masked-pos-custom-202603p63048.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/metrics/cus/outliers-masked-neg-custom-202603p63048.jpg Stage outliers : Wall: 1.34 s, CPU: 0.88 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 210 MB, VmData: 240 MB, maxrss: 0.56648 MB Stage outliers finished: 2020-06-07T16:37:05.335337 Resources for stage outliers : 1.468 s worker CPU, 1.481 s worker Wall, Wall: 1.336 s, Cores in use: 1.76, Total efficiency (on 4 cores): 44.0 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T16:37:05.337130 Stage halos : Wall: 0.44 s, CPU: 0.43 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 210 MB, VmData: 240 MB, maxrss: 0.56648 MB Stage halos finished: 2020-06-07T16:37:05.781383 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.445 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T16:37:05.783142 PSF sigmas in coadd pixels: ['2.88', '2.29', '2.23'] Using average PSF sigma 2.4656318170484357 Gaussian PSF norm 0.11441075258007047 vs pixelized 0.09688503 average tim pixel scale / coadd scale: 1.7295829917993821 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.32', '3.38', '2.21'] Using average PSF sigma 2.6377399215602724 Gaussian PSF norm 0.1069456429226024 vs pixelized 0.08988366 average tim pixel scale / coadd scale: 1.7297351537343426 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '1.83', '1.64'] Using average PSF sigma 1.6795759620879538 Gaussian PSF norm 0.16795595920722386 vs pixelized 0.13596855 average tim pixel scale / coadd scale: 0.9908774873874512 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.31 s, CPU: 0.27 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.56648 MB Stage fit_on_coadds finished: 2020-06-07T16:37:06.089532 Resources for stage fit_on_coadds : 0.319 s worker CPU, 0.331 s worker Wall, Wall: 0.307 s, Cores in use: 1.91, Total efficiency (on 4 cores): 47.7 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T16:37:06.092038 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 23 potential peaks Of 23 potential peaks: 3 in veto map, 3 cut by saddle test, 0 cut by aper test, 17 kept SED z : 17 new peaks Found 18 potential peaks Of 18 potential peaks: 15 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 16 potential peaks Of 16 potential peaks: 14 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 31 potential peaks Of 31 potential peaks: 21 in veto map, 2 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 30 potential peaks Of 30 potential peaks: 28 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 29 new sources Median coadd sky for g : 8.8127035e-06 Median coadd sky for r : -0.000104600535 Median coadd sky for z : 8.919752e-05 Stage srcs : Wall: 0.90 s, CPU: 0.82 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.56648 MB Stage srcs finished: 2020-06-07T16:37:06.993261 Resources for stage srcs : 0.206 s worker CPU, 0.220 s worker Wall, Wall: 0.902 s, Cores in use: 1.13, Total efficiency (on 4 cores): 28.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/DR8-2027p630-2328-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/DR8-2027p630-2328-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T16:37:07.008978 Blob 1 of 27, id: 13, sources: 1, size: 93x67, npix 4463, brick X: 128,221, Y: 141,208, one pixel: 189 141 Blob 2 of 27, id: 7, sources: 2, size: 55x39, npix 1476, brick X: 268,323, Y: 73,112, one pixel: 281 73 Blob 3 of 27, id: 12, sources: 1, size: 45x41, npix 1295, brick X: 249,294, Y: 113,154, one pixel: 272 113 Blob 4 of 27, id: 22, sources: 2, size: 39x39, npix 1003, brick X: 221,260, Y: 285,324, one pixel: 240 285 Blob 5 of 27, id: 18, sources: 2, size: 53x32, npix 1001, brick X: 114,167, Y: 254,286, one pixel: 150 254 Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14148 MB Blob 6 of 27, id: 2, sources: 1, size: 35x36, npix 860, brick X: 198,233, Y: 33,69, one pixel: 212 33 Blob 3 finished, total: Wall: 1.62 s, CPU: 1.62 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14142 MB Blob 7 of 27, id: 8, sources: 1, size: 38x31, npix 736, brick X: 218,256, Y: 81,112, one pixel: 232 81 Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.77 s, CPU: 1.77 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144068 MB Blob 8 of 27, id: 6, sources: 1, size: 33x32, npix 720, brick X: 74,107, Y: 58,90, one pixel: 88 58 Blob 6 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14142 MB Blob 9 of 27, id: 25, sources: 1, size: 37x25, npix 701, brick X: 17,54, Y: 324,349, one pixel: 34 324 Measuring 1 iterative sources Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.46591, ee1=-0.230377, ee2=0.269712 Blob 1 finished, total: Wall: 2.32 s, CPU: 2.32 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14378 MB Blob 10 of 27, id: 24, sources: 1, size: 30x31, npix 513, brick X: 313,343, Y: 314,345, one pixel: 329 314 Blob 7 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144068 MB Blob 11 of 27, id: 3, sources: 1, size: 27x26, npix 446, brick X: 275,302, Y: 33,59, one pixel: 285 33 Blob 5 finished, total: Wall: 1.51 s, CPU: 1.50 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143484 MB Blob 12 of 27, id: 14, sources: 1, size: 26x25, npix 416, brick X: 250,276, Y: 183,208, one pixel: 261 183 Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14142 MB Blob 13 of 27, id: 23, sources: 1, size: 26x25, npix 400, brick X: 265,291, Y: 294,319, one pixel: 278 294 Blob 9 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14378 MB Blob 14 of 27, id: 4, sources: 1, size: 26x25, npix 395, brick X: 313,339, Y: 34,59, one pixel: 325 34 Blob 10 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144068 MB Blob 15 of 27, id: 17, sources: 1, size: 25x25, npix 389, brick X: 112,137, Y: 229,254, one pixel: 121 229 Blob 12 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14142 MB Blob 16 of 27, id: 1, sources: 1, size: 22x24, npix 346, brick X: 327,349, Y: 15,39, one pixel: 335 15 Blob 17 of 27, id: 9, sources: 1, size: 22x23, npix 325, brick X: 327,349, Y: 91,114, one pixel: 337 91 Blob 15 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14142 MB Blob 18 of 27, id: 5, sources: 1, size: 22x22, npix 294, brick X: 111,133, Y: 52,74, one pixel: 120 52 Blob 11 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143832 MB Blob 19 of 27, id: 26, sources: 1, size: 21x21, npix 269, brick X: 148,169, Y: 326,347, one pixel: 158 326 Blob 14 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144068 MB Blob 20 of 27, id: 16, sources: 1, size: 21x21, npix 259, brick X: 215,236, Y: 197,218, one pixel: 225 197 Blob 13 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14378 MB Blob 21 of 27, id: 19, sources: 1, size: 20x21, npix 248, brick X: 243,263, Y: 262,283, one pixel: 252 262 Blob 16 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14142 MB Blob 22 of 27, id: 15, sources: 1, size: 20x20, npix 238, brick X: 62,82, Y: 188,208, one pixel: 70 188 Blob 18 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144068 MB Blob 23 of 27, id: 0, sources: 1, size: 19x17, npix 200, brick X: 300,319, Y: 0,17, one pixel: 306 0 Blob 17 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143832 MB Blob 24 of 27, id: 11, sources: 1, size: 20x19, npix 200, brick X: 100,120, Y: 98,117, one pixel: 109 98 Blob 21 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144068 MB Blob 25 of 27, id: 20, sources: 1, size: 19x19, npix 199, brick X: 307,326, Y: 265,284, one pixel: 315 265 Blob 20 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14142 MB Blob 26 of 27, id: 21, sources: 1, size: 19x18, npix 189, brick X: 44,63, Y: 284,302, one pixel: 52 284 Blob 22 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143832 MB Blob 27 of 27, id: 10, sources: 1, size: 18x18, npix 180, brick X: 160,178, Y: 95,113, one pixel: 168 95 Blob 23 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144068 MB Blob 24 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14142 MB Blob 19 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144604 MB Blob 27 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14142 MB Blob 26 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144068 MB Blob 25 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143832 MB Old catalog: 33 New catalog: 26 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/metrics/cus/blobs-custom-202603p63048.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/metrics/cus/all-models-custom-202603p63048.fits Stage fitblobs : Wall: 4.82 s, CPU: 0.48 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.56648 MB Stage fitblobs finished: 2020-06-07T16:37:11.824748 Resources for stage fitblobs : 17.228 s worker CPU, 17.271 s worker Wall, Wall: 4.817 s, Cores in use: 3.68, Total efficiency (on 4 cores): 91.9 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T16:37:11.826563 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/tmp-legacysurvey-custom-202603p63048-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/tmp-legacysurvey-custom-202603p63048-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/tmp-legacysurvey-custom-202603p63048-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/tmp-legacysurvey-custom-202603p63048-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-resid.jpg Stage coadds : Wall: 1.68 s, CPU: 0.92 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 213 MB, VmData: 241 MB, maxrss: 0.56648 MB Stage coadds finished: 2020-06-07T16:37:13.502402 Resources for stage coadds : 2.046 s worker CPU, 2.159 s worker Wall, Wall: 1.677 s, Cores in use: 1.77, Total efficiency (on 4 cores): 44.2 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T16:37:13.503861 Cut to 1 unWISE tiles Reading WISE tile 2014p636 band 2 Reading WISE tile 2014p636 band 4 Reading WISE tile 2014p636 band 3 Reading WISE tile 2014p636 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.20892 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 803 MB, VmSize: 793 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.187156 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 805 MB, VmSize: 795 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.21178 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/201/2014p636/unwise-2014p636-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20874 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/tmp-legacysurvey-custom-202603p63048-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/tmp-legacysurvey-custom-202603p63048-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.79 s, CPU: 0.66 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.56648 MB Stage wise_forced finished: 2020-06-07T16:37:16.297016 Resources for stage wise_forced : 4.050 s worker CPU, 6.520 s worker Wall, Wall: 2.794 s, Cores in use: 1.69, Total efficiency (on 4 cores): 42.2 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T16:37:16.298769 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/coadd/cus/custom-202603p63048/legacysurvey-custom-202603p63048-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/tractor-i/cus/tractor-custom-202603p63048.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/tractor/cus/tractor-custom-202603p63048.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/DR8-2027p630-2328/tractor/cus/brick-custom-202603p63048.sha256sum Stage writecat : Wall: 1.25 s, CPU: 0.77 s, VmPeak: 1096 MB, VmSize: 968 MB, VmRSS: 216 MB, VmData: 241 MB, maxrss: 0.56648 MB Stage writecat finished: 2020-06-07T16:37:17.544433 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.247 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.5 % Stage writecat finished All done: 28.760 s worker CPU, 47.524 s worker Wall, Wall: 23.987 s, Cores in use: 1.52, Total efficiency (on 4 cores): 38.1 % Finished galaxy DR8-2027p630-2328 in 0.445 minutes.