Started working on galaxy PGC2616326 at Sun Jun  7 17:52:58 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.1904965 61.3490782 --width 249 --height 249 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/PGC2616326-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/PGC2616326-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:53:00.881792
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '206.1904965', '61.3490782', '--width', '249', '--height', '249', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/PGC2616326-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/PGC2616326-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.1904965 61.3490782 --width 249 --height 249 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/PGC2616326-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/PGC2616326-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 206.1904965 61.3490782
Starting process 53572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 53574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 53576 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057464 MB
Starting process 53579 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:53:01.498163
Keeping 9 CCDs:
   k4m_170410_084641_ooi_zd_ls9.fits.fz k4m_170410_084641_ooi_zd_ls9-CCD1 z exptime 120.103 propid 2016A-0453 seeing 1.09 MJD 57853.366 object MzLS_691214_z
   k4m_170502_073311_ooi_zd_ls9.fits.fz k4m_170502_073311_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 0.91 MJD 57875.315 object MzLS_690610_z
   k4m_170611_074652_ooi_zd_ls9.fits.fz k4m_170611_074652_ooi_zd_ls9-CCD2 z exptime 250.106 propid 2016A-0453 seeing 1.83 MJD 57915.324 object MzLS_690002_z
   ksb_180217_105825_ooi_g_ls9.fits.fz ksb_180217_105825_ooi_g_ls9-CCD4 g exptime 159.13 propid BASS seeing 1.56 MJD 58166.457 object 39373
   ksb_180222_084414_ooi_r_ls9.fits.fz ksb_180222_084414_ooi_r_ls9-CCD4 r exptime 128.685 propid BASS seeing 1.58 MJD 58171.364 object 39373
   ksb_170418_072326_ooi_r_ls9.fits.fz ksb_170418_072326_ooi_r_ls9-CCD3 r exptime 51.073 propid BASS seeing 1.44 MJD 57861.308 object 38431
   ksb_160602_054546_ooi_g_ls9.fits.fz ksb_160602_054546_ooi_g_ls9-CCD3 g exptime 99.4 propid BASS seeing 1.35 MJD 57541.240 object 38431
   ksb_170301_101554_ooi_g_ls9.fits.fz ksb_170301_101554_ooi_g_ls9-CCD1 g exptime 98.899 propid BASS seeing 1.60 MJD 57813.428 object 38422
   ksb_170531_071331_ooi_r_ls9.fits.fz ksb_170531_071331_ooi_r_ls9-CCD1 r exptime 137.361 propid 2015A-0801 seeing 1.57 MJD 57904.301 object 38422
mosaic get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 416 668 and amp range 0 2047 and image y 838 1092 and amp range 0 2039
Range in image: x 0 253 , y 0 255 (with image size 253 x 255)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
Faked up EXPNUM 81660057
Faked up EXPNUM 81660057
Faked up EXPNUM 81660057
90prime get_fwhm: self.fwhm = 3.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3060 3205 and amp range 2016 4031 and image y 3232 3379 and amp range 2048 4095
Range in image: x 0 146 , y 0 148 (with image size 146 x 148)
dzp 0.016666532 -> scaling image by 1.0154688660729452
mosaic get_fwhm: self.fwhm = 4.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1964 2216 and amp range 0 2005 and image y 1068 1324 and amp range 0 2039
Range in image: x 0 42 , y 0 257 (with image size 253 x 257)
dzp 0.007397243 -> scaling image by 1.006836374469654
Found overlap: image x 1964 2216 and amp range 2006 4053 and image y 1068 1324 and amp range 0 2039
Range in image: x 42 253 , y 0 257 (with image size 253 x 257)
dzp 0.000620604 -> scaling image by 1.0005717608254892
mosaic get_fwhm: self.fwhm = 7.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3097 3351 and amp range 2048 4095 and image y 3448 3701 and amp range 2040 4078
Range in image: x 0 255 , y 0 254 (with image size 255 x 254)
dzp -0.032976374 -> scaling image by 0.9700842429001929
Faked up EXPNUM 75410082
Faked up EXPNUM 75410082
Faked up EXPNUM 75410082
90prime get_fwhm: self.fwhm = 2.99
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1328 1474 and amp range 0 2015 and image y 2389 2534 and amp range 2048 4095
Range in image: x 0 147 , y 0 146 (with image size 147 x 146)
dzp -0.0045482004 -> scaling image by 0.9958197144381092
Faked up EXPNUM 81710079
Faked up EXPNUM 81710079
Faked up EXPNUM 81710079
90prime get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3062 3207 and amp range 2016 4031 and image y 3228 3375 and amp range 2048 4095
Range in image: x 0 146 , y 0 148 (with image size 146 x 148)
dzp 0.044050463 -> scaling image by 1.0414062625929388
Faked up EXPNUM 78610066
Faked up EXPNUM 78610066
Faked up EXPNUM 78610066
90prime get_fwhm: self.fwhm = 3.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1309 1455 and amp range 0 2015 and image y 2384 2529 and amp range 2048 4095
Range in image: x 0 147 , y 0 146 (with image size 147 x 146)
dzp -0.07725406 -> scaling image by 0.9313188157188347
Faked up EXPNUM 78130100
Faked up EXPNUM 78130100
Faked up EXPNUM 78130100
90prime get_fwhm: self.fwhm = 3.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3186 3334 and amp range 2016 4031 and image y 939 1087 and amp range 0 2047
Range in image: x 0 149 , y 0 149 (with image size 149 x 149)
dzp -0.011406615 -> scaling image by 0.9895491130016149
Faked up EXPNUM 79040072
Faked up EXPNUM 79040072
Faked up EXPNUM 79040072
90prime get_fwhm: self.fwhm = 3.47
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3211 3359 and amp range 2016 4031 and image y 930 1078 and amp range 0 2047
Range in image: x 0 149 , y 0 149 (with image size 149 x 149)
dzp -0.006547878 -> scaling image by 0.9939873303458991
Stage tims : Wall: 7.35 s, CPU: 1.00 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.566536 MB
Stage tims finished: 2020-06-07T17:53:08.843531
Resources for stage tims : 3.372 s worker CPU, 15.910 s worker Wall, Wall: 7.347 s, Cores in use: 0.60, Total efficiency (on 4 cores): 14.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/PGC2616326-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/PGC2616326-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:53:08.865909
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00805.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00727.fits
Matched 17 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/metrics/cus/reference-custom-206190p61349.fits
Stage refs : Wall: 2.99 s, CPU: 1.52 s, VmPeak: 972 MB, VmSize: 953 MB, VmRSS: 183 MB, VmData: 216 MB, maxrss: 0.566536 MB
Stage refs finished: 2020-06-07T17:53:11.854450
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.990 s, Cores in use: 0.51, Total efficiency (on 4 cores): 12.7 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:53:11.855942
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/metrics/cus/outlier-mask-custom-206190p61349.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/metrics/cus/outliers-pre-custom-206190p61349.jpg
Image k4m_170410_084641_ooi_zd_ls9-CCD1 z : masking 804 positive outlier pixels and 0 negative outlier pixels
Image k4m_170502_073311_ooi_zd_ls9-CCD2 z : masking 2157 positive outlier pixels and 0 negative outlier pixels
Image k4m_170611_074652_ooi_zd_ls9-CCD2 z : masking 1262 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/metrics/cus/outlier-mask-custom-206190p61349.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/metrics/cus/outliers-post-custom-206190p61349.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/metrics/cus/outliers-masked-pos-custom-206190p61349.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/metrics/cus/outliers-masked-neg-custom-206190p61349.jpg
Stage outliers : Wall: 1.38 s, CPU: 1.07 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 196 MB, VmData: 227 MB, maxrss: 0.566536 MB
Stage outliers finished: 2020-06-07T17:53:13.233267
Resources for stage outliers : 0.770 s worker CPU, 0.788 s worker Wall, Wall: 1.378 s, Cores in use: 1.33, Total efficiency (on 4 cores): 33.3 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:53:13.235025
Stage halos : Wall: 0.73 s, CPU: 0.69 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 196 MB, VmData: 227 MB, maxrss: 0.566536 MB
Stage halos finished: 2020-06-07T17:53:13.962009
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.728 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T17:53:13.963879
PSF sigmas in coadd pixels: ['2.53', '2.20', '2.60']
Using average PSF sigma 2.4417964281297464
Gaussian PSF norm 0.11552756344636969 vs pixelized 0.09004296
average tim pixel scale / coadd scale: 1.7300762684006272
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.57', '2.33', '2.55']
Using average PSF sigma 2.4857837123441864
Gaussian PSF norm 0.11348324086806905 vs pixelized 0.08965784
average tim pixel scale / coadd scale: 1.7299642964116944
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.77', '1.47', '2.96']
Using average PSF sigma 2.0676239936820804
Gaussian PSF norm 0.13643428042809475 vs pixelized 0.10320039
average tim pixel scale / coadd scale: 0.9909262085326357
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.16 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 198 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage fit_on_coadds finished: 2020-06-07T17:53:14.153687
Resources for stage fit_on_coadds : 0.193 s worker CPU, 0.193 s worker Wall, Wall: 0.191 s, Cores in use: 1.87, Total efficiency (on 4 cores): 46.8 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:53:14.156175
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 12 potential peaks
Of 12 potential peaks: 1 in veto map, 0 cut by saddle test, 0 cut by aper test, 11 kept
SED z : 11 new peaks
Found 11 potential peaks
Of 11 potential peaks: 9 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 9 potential peaks
Of 9 potential peaks: 8 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 16 potential peaks
Of 16 potential peaks: 12 in veto map, 0 cut by saddle test, 0 cut by aper test, 4 kept
SED Flat : 4 new peaks
Found 16 potential peaks
Of 16 potential peaks: 15 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 17 new sources
Median coadd sky for g : -5.0787872e-05
Median coadd sky for r : 6.3282336e-05
Median coadd sky for z : 0.00014297718
Stage srcs : Wall: 0.68 s, CPU: 0.64 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 198 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage srcs finished: 2020-06-07T17:53:14.840738
Resources for stage srcs : 0.094 s worker CPU, 0.104 s worker Wall, Wall: 0.685 s, Cores in use: 1.07, Total efficiency (on 4 cores): 26.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/PGC2616326-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/PGC2616326-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:53:14.851699
Blob 1 of 15, id: 4, sources: 2, size: 59x100, npix 4089, brick X: 97,156, Y: 75,175, one pixel: 127 75
Blob 2 of 15, id: 2, sources: 3, size: 45x46, npix 1292, brick X: 204,249, Y: 23,69, one pixel: 241 23
Blob 3 of 15, id: 10, sources: 1, size: 29x31, npix 615, brick X: 114,143, Y: 195,226, one pixel: 128 195
Blob 4 of 15, id: 6, sources: 1, size: 30x30, npix 596, brick X: 172,202, Y: 134,164, one pixel: 187 134
Blob 5 of 15, id: 0, sources: 1, size: 30x30, npix 589, brick X: 168,198, Y: 5,35, one pixel: 179 5
Blob 4 finished, total: Wall: 0.67 s, CPU: 0.62 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.139852 MB
Blob 6 of 15, id: 8, sources: 1, size: 23x30, npix 502, brick X: 226,249, Y: 161,191, one pixel: 237 161
Blob 3 finished, total: Wall: 0.70 s, CPU: 0.65 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139544 MB
Blob 7 of 15, id: 14, sources: 1, size: 27x27, npix 496, brick X: 24,51, Y: 221,248, one pixel: 34 221
Blob 6 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14154 MB
Blob 8 of 15, id: 9, sources: 1, size: 31x22, npix 410, brick X: 8,39, Y: 194,216, one pixel: 29 194
Blob 7 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14154 MB
Blob 9 of 15, id: 1, sources: 1, size: 18x25, npix 302, brick X: 0,18, Y: 9,34, one pixel: 6 9
Blob 10 of 15, id: 3, sources: 1, size: 20x21, npix 239, brick X: 65,85, Y: 27,48, one pixel: 74 27
Measuring 1 iterative sources
Blob 8 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14154 MB
Blob 11 of 15, id: 7, sources: 1, size: 20x21, npix 239, brick X: 37,57, Y: 154,175, one pixel: 47 154
Blob 5 finished, total: Wall: 1.86 s, CPU: 1.86 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141876 MB
Blob 12 of 15, id: 5, sources: 1, size: 20x19, npix 216, brick X: 160,180, Y: 107,126, one pixel: 171 107
Blob 9 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14154 MB
Blob 13 of 15, id: 13, sources: 1, size: 20x20, npix 210, brick X: 162,182, Y: 209,229, one pixel: 171 209
Blob 11 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14154 MB
Blob 14 of 15, id: 11, sources: 1, size: 18x18, npix 171, brick X: 78,96, Y: 207,225, one pixel: 86 207
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.56693, ee1=1.31812, ee2=0.306092
Blob 1 finished, total: Wall: 2.90 s, CPU: 2.90 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142512 MB
Blob 15 of 15, id: 12, sources: 1, size: 17x18, npix 162, brick X: 197,214, Y: 208,226, one pixel: 205 208
Blob 10 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141876 MB
Blob 12 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14154 MB
Blob 13 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142512 MB
Blob 2 finished, total: Wall: 3.00 s, CPU: 2.99 s, VmPeak: 803 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141648 MB
Blob 14 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141876 MB
Blob 15 finished, total: Wall: 0.13 s, CPU: 0.13 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141724 MB
Old catalog: 20
New catalog: 15
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/metrics/cus/blobs-custom-206190p61349.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/metrics/cus/all-models-custom-206190p61349.fits
Stage fitblobs : Wall: 3.94 s, CPU: 0.82 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage fitblobs finished: 2020-06-07T17:53:18.796734
Resources for stage fitblobs : 11.982 s worker CPU, 12.175 s worker Wall, Wall: 3.946 s, Cores in use: 3.25, Total efficiency (on 4 cores): 81.1 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:53:18.798474
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/tmp-legacysurvey-custom-206190p61349-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/tmp-legacysurvey-custom-206190p61349-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/tmp-legacysurvey-custom-206190p61349-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/tmp-legacysurvey-custom-206190p61349-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-resid.jpg
Stage coadds : Wall: 1.45 s, CPU: 0.82 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage coadds finished: 2020-06-07T17:53:20.244084
Resources for stage coadds : 1.734 s worker CPU, 1.799 s worker Wall, Wall: 1.447 s, Cores in use: 1.77, Total efficiency (on 4 cores): 44.2 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:53:20.245737
Cut to 2 unWISE tiles
Reading WISE tile 2052p620 band 4
Reading WISE tile 2052p620 band 2
Reading WISE tile 2052p620 band 3
Reading WISE tile 2052p620 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2070p605 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2070p605 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2070p605 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2052p620/unwise-2052p620-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2070p605 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 797 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.189216 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.2087 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.202608 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2070p605/unwise-2070p605-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20846 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/tmp-legacysurvey-custom-206190p61349-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/tmp-legacysurvey-custom-206190p61349-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.46 s, CPU: 0.64 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage wise_forced finished: 2020-06-07T17:53:24.704015
Resources for stage wise_forced : 8.368 s worker CPU, 11.435 s worker Wall, Wall: 4.459 s, Cores in use: 2.02, Total efficiency (on 4 cores): 50.5 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:53:24.705895
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/coadd/cus/custom-206190p61349/legacysurvey-custom-206190p61349-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/tractor-i/cus/tractor-custom-206190p61349.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/tractor/cus/tractor-custom-206190p61349.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2616326/tractor/cus/brick-custom-206190p61349.sha256sum
Stage writecat : Wall: 1.00 s, CPU: 0.71 s, VmPeak: 1095 MB, VmSize: 967 MB, VmRSS: 202 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage writecat finished: 2020-06-07T17:53:25.708853
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.004 s, Cores in use: 0.71, Total efficiency (on 4 cores): 17.8 %
Stage writecat finished
All done: 26.515 s worker CPU, 42.405 s worker Wall, Wall: 24.216 s, Cores in use: 1.43, Total efficiency (on 4 cores): 35.8 %
Finished galaxy PGC2616326 in 0.456 minutes.