Started working on galaxy PGC2377045 at Sun Jun  7 18:15:14 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.453179 50.5842105 --width 249 --height 249 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/PGC2377045-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/PGC2377045-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T18:15:15.941888
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '166.453179', '50.5842105', '--width', '249', '--height', '249', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/PGC2377045-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/PGC2377045-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.453179 50.5842105 --width 249 --height 249 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/PGC2377045-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/PGC2377045-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 166.453179 50.5842105
Starting process 2119 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 2122 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 2129 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 2131 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T18:15:16.365615
Keeping 12 CCDs:
   k4m_170319_110514_ooi_zd_ls9.fits.fz k4m_170319_110514_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 0.78 MJD 57831.462 object MzLS_652607_z
   k4m_160420_054302_ooi_zd_ls9.fits.fz k4m_160420_054302_ooi_zd_ls9-CCD4 z exptime 85.104 propid 2016A-0453 seeing 0.96 MJD 57498.238 object MzLS_651008_z
   k4m_161215_125146_ooi_zd_ls9.fits.fz k4m_161215_125146_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 0.82 MJD 57737.536 object MzLS_651809_z
   k4m_170319_110306_ooi_zd_ls9.fits.fz k4m_170319_110306_ooi_zd_ls9-CCD3 z exptime 80.105 propid 2016A-0453 seeing 0.77 MJD 57831.460 object MzLS_652606_z
   ksb_170403_054929_ooi_r_ls9.fits.fz ksb_170403_054929_ooi_r_ls9-CCD2 r exptime 136.273 propid BASS seeing 1.89 MJD 57846.243 object 27661
   ksb_160314_071829_ooi_g_ls9.fits.fz ksb_160314_071829_ooi_g_ls9-CCD2 g exptime 51.3 propid 2015A-0801 seeing 1.28 MJD 57461.305 object 27661
   ksb_160504_035220_ooi_g_ls9.fits.fz ksb_160504_035220_ooi_g_ls9-CCD3 g exptime 117.7 propid BASS seeing 1.58 MJD 57512.161 object 26512
   ksb_170321_070656_ooi_r_ls9.fits.fz ksb_170321_070656_ooi_r_ls9-CCD3 r exptime 68.511 propid BASS seeing 1.37 MJD 57833.296 object 26512
   ksb_170422_070359_ooi_r_ls9.fits.fz ksb_170422_070359_ooi_r_ls9-CCD4 r exptime 66.753 propid BASS seeing 0.99 MJD 57865.294 object 27673
   ksb_170401_063241_ooi_g_ls9.fits.fz ksb_170401_063241_ooi_g_ls9-CCD4 g exptime 172.2 propid BASS seeing 2.27 MJD 57844.273 object 27673
   ksb_160504_034934_ooi_g_ls9.fits.fz ksb_160504_034934_ooi_g_ls9-CCD1 g exptime 110.3 propid BASS seeing 1.63 MJD 57512.159 object 26502
   ksb_170321_065821_ooi_r_ls9.fits.fz ksb_170321_065821_ooi_r_ls9-CCD1 r exptime 65.494 propid BASS seeing 1.51 MJD 57833.291 object 26502
mosaic get_fwhm: self.fwhm = 2.97
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1816 2070 and amp range 0 2005 and image y 3755 4016 and amp range 2040 4078
Range in image: x 0 190 , y 0 262 (with image size 255 x 262)
dzp 0.012956044 -> scaling image by 1.012004439021001
Found overlap: image x 1816 2070 and amp range 2006 4053 and image y 3755 4016 and amp range 2040 4078
Range in image: x 190 255 , y 0 262 (with image size 255 x 262)
dzp -0.0021409686 -> scaling image by 0.9980300379995196
mosaic get_fwhm: self.fwhm = 3.71
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2947 3202 and amp range 2048 4095 and image y 918 1170 and amp range 0 2021
Range in image: x 0 256 , y 0 253 (with image size 256 x 253)
dzp -0.0006399284 -> scaling image by 0.9994107778325068
mosaic get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1788 2044 and amp range 0 2005 and image y 57 318 and amp range 0 2039
Range in image: x 0 218 , y 0 262 (with image size 257 x 262)
dzp 0.007397243 -> scaling image by 1.006836374469654
Found overlap: image x 1788 2044 and amp range 2006 4053 and image y 57 318 and amp range 0 2039
Range in image: x 218 257 , y 0 262 (with image size 257 x 262)
dzp 0.000620604 -> scaling image by 1.0005717608254892
mosaic get_fwhm: self.fwhm = 3.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 228 478 and amp range 0 2047 and image y 2465 2716 and amp range 2040 4078
Range in image: x 0 251 , y 0 252 (with image size 251 x 252)
dzp 0.015739892 -> scaling image by 1.0146025667655956
Faked up EXPNUM 75120046
Faked up EXPNUM 75120046
Faked up EXPNUM 75120046
90prime get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1375 1521 and amp range 0 2015 and image y 4021 4080 and amp range 2048 4095
Range in image: x 0 147 , y 0 60 (with image size 147 x 60)
dzp -0.0045482004 -> scaling image by 0.9958197144381092
Faked up EXPNUM 74610107
Faked up EXPNUM 74610107
Faked up EXPNUM 74610107
90prime get_fwhm: self.fwhm = 2.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3114 3260 and amp range 2016 4031 and image y 830 978 and amp range 0 2047
Range in image: x 0 147 , y 0 149 (with image size 147 x 149)
dzp -0.008960029 -> scaling image by 0.9917814665476246
Faked up EXPNUM 78460087
Faked up EXPNUM 78460087
Faked up EXPNUM 78460087
90prime get_fwhm: self.fwhm = 4.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3117 3264 and amp range 2016 4031 and image y 845 993 and amp range 0 2047
Range in image: x 0 148 , y 0 149 (with image size 148 x 149)
dzp 0.032776505 -> scaling image by 1.0306485625912574
Faked up EXPNUM 78330151
Faked up EXPNUM 78330151
Faked up EXPNUM 78330151
90prime get_fwhm: self.fwhm = 3.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1377 1523 and amp range 0 2015 and image y 4018 4080 and amp range 2048 4095
Range in image: x 0 147 , y 0 63 (with image size 147 x 63)
dzp -0.07725406 -> scaling image by 0.9313188157188347
Faked up EXPNUM 78650125
Faked up EXPNUM 78650125
Faked up EXPNUM 78650125
90prime get_fwhm: self.fwhm = 2.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1190 1334 and amp range 0 2015 and image y 2439 2584 and amp range 2048 4095
Range in image: x 0 145 , y 0 146 (with image size 145 x 146)
dzp 0.01103811 -> scaling image by 1.0102183288830229
Faked up EXPNUM 75120045
Faked up EXPNUM 75120045
Faked up EXPNUM 75120045
90prime get_fwhm: self.fwhm = 3.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1327 1475 and amp range 0 2015 and image y 555 702 and amp range 0 2047
Range in image: x 0 149 , y 0 148 (with image size 149 x 148)
dzp -0.011813398 -> scaling image by 0.989178436928226
Faked up EXPNUM 78440067
Faked up EXPNUM 78440067
Faked up EXPNUM 78440067
90prime get_fwhm: self.fwhm = 5.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1192 1336 and amp range 0 2015 and image y 2427 2572 and amp range 2048 4095
Range in image: x 0 145 , y 0 146 (with image size 145 x 146)
dzp 0.019393893 -> scaling image by 1.0180229229717446
Faked up EXPNUM 78330146
Faked up EXPNUM 78330146
Faked up EXPNUM 78330146
90prime get_fwhm: self.fwhm = 3.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1332 1479 and amp range 0 2015 and image y 551 698 and amp range 0 2047
Range in image: x 0 148 , y 0 148 (with image size 148 x 148)
dzp -0.024106435 -> scaling image by 0.9780418215011345
Stage tims : Wall: 7.39 s, CPU: 1.03 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.566548 MB
Stage tims finished: 2020-06-07T18:15:23.756161
Resources for stage tims : 3.882 s worker CPU, 20.311 s worker Wall, Wall: 7.392 s, Cores in use: 0.66, Total efficiency (on 4 cores): 16.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/PGC2377045-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/PGC2377045-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T18:15:23.904014
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01347.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01348.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01453.fits
Matched 17 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/metrics/cus/reference-custom-166453p50584.fits
Stage refs : Wall: 2.70 s, CPU: 1.37 s, VmPeak: 973 MB, VmSize: 953 MB, VmRSS: 184 MB, VmData: 216 MB, maxrss: 0.566548 MB
Stage refs finished: 2020-06-07T18:15:26.606262
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.703 s, Cores in use: 0.51, Total efficiency (on 4 cores): 12.7 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T18:15:26.607829
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/metrics/cus/outlier-mask-custom-166453p50584.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/metrics/cus/outliers-pre-custom-166453p50584.jpg
Image ksb_170401_063241_ooi_g_ls9-CCD4 g : masking 281 positive outlier pixels and 0 negative outlier pixels
Image k4m_170319_110306_ooi_zd_ls9-CCD3 z : masking 311 positive outlier pixels and 0 negative outlier pixels
Image k4m_160420_054302_ooi_zd_ls9-CCD4 z : masking 329 positive outlier pixels and 0 negative outlier pixels
Image k4m_161215_125146_ooi_zd_ls9-CCD2 z : masking 115 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/metrics/cus/outlier-mask-custom-166453p50584.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/metrics/cus/outliers-post-custom-166453p50584.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/metrics/cus/outliers-masked-pos-custom-166453p50584.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/metrics/cus/outliers-masked-neg-custom-166453p50584.jpg
Stage outliers : Wall: 1.04 s, CPU: 0.77 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.566548 MB
Stage outliers finished: 2020-06-07T18:15:27.646993
Resources for stage outliers : 1.003 s worker CPU, 1.007 s worker Wall, Wall: 1.040 s, Cores in use: 1.71, Total efficiency (on 4 cores): 42.7 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T18:15:27.648762
Stage halos : Wall: 0.30 s, CPU: 0.29 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.566548 MB
Stage halos finished: 2020-06-07T18:15:27.950542
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.303 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.1 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T18:15:27.952183
PSF sigmas in coadd pixels: ['2.08', '2.57', '3.69', '2.64']
Using average PSF sigma 2.745680968604459
Gaussian PSF norm 0.10274128531300483 vs pixelized 0.079617165
average tim pixel scale / coadd scale: 1.7297765767052484
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['3.07', '2.23', '1.61', '2.45']
Using average PSF sigma 2.3402849163741277
Gaussian PSF norm 0.12053865313584805 vs pixelized 0.10899918
average tim pixel scale / coadd scale: 1.729486949158875
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.27', '1.56', '1.33', '1.25']
Using average PSF sigma 1.353580089967883
Gaussian PSF norm 0.20840642815643926 vs pixelized 0.17148952
average tim pixel scale / coadd scale: 0.9909431292997133
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.19 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 200 MB, VmData: 229 MB, maxrss: 0.566548 MB
Stage fit_on_coadds finished: 2020-06-07T18:15:28.169647
Resources for stage fit_on_coadds : 0.231 s worker CPU, 0.232 s worker Wall, Wall: 0.219 s, Cores in use: 1.94, Total efficiency (on 4 cores): 48.5 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T18:15:28.172643
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 16 potential peaks
Of 16 potential peaks: 5 in veto map, 0 cut by saddle test, 0 cut by aper test, 11 kept
SED z : 11 new peaks
Found 17 potential peaks
Of 17 potential peaks: 16 in veto map, 0 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 14 potential peaks
Of 14 potential peaks: 12 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 19 potential peaks
Of 19 potential peaks: 17 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 21 potential peaks
Of 21 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 17 new sources
Median coadd sky for g : 7.753636e-05
Median coadd sky for r : 0.00027856888
Median coadd sky for z : 8.189367e-05
Stage srcs : Wall: 0.47 s, CPU: 0.43 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 200 MB, VmData: 229 MB, maxrss: 0.566548 MB
Stage srcs finished: 2020-06-07T18:15:28.645859
Resources for stage srcs : 0.101 s worker CPU, 0.105 s worker Wall, Wall: 0.474 s, Cores in use: 1.13, Total efficiency (on 4 cores): 28.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/PGC2377045-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/PGC2377045-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T18:15:28.657705
Blob 1 of 14, id: 7, sources: 1, size: 90x103, npix 6278, brick X: 80,170, Y: 72,175, one pixel: 137 72
Blob 2 of 14, id: 12, sources: 4, size: 86x64, npix 3144, brick X: 25,111, Y: 185,249, one pixel: 78 185
Blob 3 of 14, id: 10, sources: 3, size: 55x62, npix 2229, brick X: 113,168, Y: 169,231, one pixel: 133 169
Blob 4 of 14, id: 0, sources: 3, size: 46x34, npix 928, brick X: 35,81, Y: 0,34, one pixel: 37 0
Blob 5 of 14, id: 9, sources: 2, size: 27x49, npix 876, brick X: 222,249, Y: 163,212, one pixel: 241 163
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.62846, ee1=0.141661, ee2=0.370175
Blob 1 finished, total: Wall: 2.57 s, CPU: 2.26 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144344 MB
Blob 6 of 14, id: 13, sources: 1, size: 34x34, npix 753, brick X: 198,232, Y: 213,247, one pixel: 212 213
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 3.22 s, CPU: 2.78 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143416 MB
Blob 7 of 14, id: 1, sources: 2, size: 39x21, npix 610, brick X: 197,236, Y: 0,21, one pixel: 201 0
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (166.43809, 50.58882), pm (-6.4, -8.1), parallax 0.716 with NanoMaggies: g=17.4, r=15.8, z=16.4
Reset brightness to NanoMaggies: g=16.6, r=16, z=15.8
Blob 5 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144344 MB
Blob 8 of 14, id: 2, sources: 1, size: 26x27, npix 452, brick X: 147,173, Y: 6,33, one pixel: 161 6
Blob 2 finished, total: Wall: 3.39 s, CPU: 3.38 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143164 MB
Blob 9 of 14, id: 5, sources: 1, size: 28x26, npix 449, brick X: 174,202, Y: 51,77, one pixel: 182 51
Blob 6 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143416 MB
Blob 10 of 14, id: 6, sources: 1, size: 23x25, npix 361, brick X: 225,248, Y: 71,96, one pixel: 237 71
Blob 8 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14334 MB
Blob 11 of 14, id: 11, sources: 1, size: 24x22, npix 317, brick X: 168,192, Y: 176,198, one pixel: 178 176
Blob 12 of 14, id: 8, sources: 1, size: 21x21, npix 248, brick X: 24,45, Y: 112,133, one pixel: 34 112
Blob 3 finished, total: Wall: 4.14 s, CPU: 3.79 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142452 MB
Blob 13 of 14, id: 4, sources: 1, size: 19x18, npix 189, brick X: 187,206, Y: 22,40, one pixel: 195 22
Blob 7 finished, total: Wall: 0.91 s, CPU: 0.90 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144344 MB
Blob 14 of 14, id: 3, sources: 1, size: 17x18, npix 162, brick X: 102,119, Y: 9,27, one pixel: 110 9
Blob 10 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14334 MB
Blob 11 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 179 MB, maxrss: 0.142564 MB
Blob 12 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144344 MB
Blob 14 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 179 MB, maxrss: 0.142564 MB
Blob 9 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143416 MB
Blob 13 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14334 MB
Old catalog: 24
New catalog: 20
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/metrics/cus/blobs-custom-166453p50584.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/metrics/cus/all-models-custom-166453p50584.fits
Stage fitblobs : Wall: 5.25 s, CPU: 0.34 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 200 MB, VmData: 229 MB, maxrss: 0.566548 MB
Stage fitblobs finished: 2020-06-07T18:15:33.910716
Resources for stage fitblobs : 18.065 s worker CPU, 19.199 s worker Wall, Wall: 5.254 s, Cores in use: 3.50, Total efficiency (on 4 cores): 87.6 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T18:15:33.912490
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/tmp-legacysurvey-custom-166453p50584-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/tmp-legacysurvey-custom-166453p50584-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/tmp-legacysurvey-custom-166453p50584-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/tmp-legacysurvey-custom-166453p50584-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-resid.jpg
Stage coadds : Wall: 1.39 s, CPU: 0.60 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.566548 MB
Stage coadds finished: 2020-06-07T18:15:35.303455
Resources for stage coadds : 1.951 s worker CPU, 2.193 s worker Wall, Wall: 1.392 s, Cores in use: 1.83, Total efficiency (on 4 cores): 45.8 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T18:15:35.305163
Cut to 1 unWISE tiles
Reading WISE tile 1672p499 band 1
Reading WISE tile 1672p499 band 2
Reading WISE tile 1672p499 band 3
Reading WISE tile 1672p499 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 794 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.18742 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208732 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208676 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1672p499/unwise-1672p499-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 173 MB, maxrss: 0.209128 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/tmp-legacysurvey-custom-166453p50584-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/tmp-legacysurvey-custom-166453p50584-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.68 s, CPU: 0.52 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 202 MB, VmData: 229 MB, maxrss: 0.566548 MB
Stage wise_forced finished: 2020-06-07T18:15:37.984768
Resources for stage wise_forced : 5.082 s worker CPU, 6.899 s worker Wall, Wall: 2.681 s, Cores in use: 2.09, Total efficiency (on 4 cores): 52.2 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T18:15:37.986612
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/coadd/cus/custom-166453p50584/legacysurvey-custom-166453p50584-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/tractor-i/cus/tractor-custom-166453p50584.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/tractor/cus/tractor-custom-166453p50584.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2377045/tractor/cus/brick-custom-166453p50584.sha256sum
Stage writecat : Wall: 0.79 s, CPU: 0.52 s, VmPeak: 1094 MB, VmSize: 966 MB, VmRSS: 204 MB, VmData: 229 MB, maxrss: 0.566548 MB
Stage writecat finished: 2020-06-07T18:15:38.772044
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.786 s, Cores in use: 0.66, Total efficiency (on 4 cores): 16.4 %
Stage writecat finished
All done: 30.318 s worker CPU, 49.948 s worker Wall, Wall: 22.411 s, Cores in use: 1.62, Total efficiency (on 4 cores): 40.6 %
Finished galaxy PGC2377045 in 0.407 minutes.