Started working on galaxy PGC099822 at Sun Jun  7 16:57:41 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.15217500000003 39.204831299999995 --width 301 --height 301 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/PGC099822-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/PGC099822-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T16:57:42.077253
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.15217500000003', '39.204831299999995', '--width', '301', '--height', '301', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/PGC099822-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/PGC099822-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.15217500000003 39.204831299999995 --width 301 --height 301 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/PGC099822-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/PGC099822-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 216.15217500000003 39.204831299999995
Starting process 38254 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 38256 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 38258 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 38260 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T16:57:42.523379
Keeping 9 CCDs:
   k4m_160316_104046_ooi_zd_ls9.fits.fz k4m_160316_104046_ooi_zd_ls9-CCD2 z exptime 80.102 propid 2016A-0453 seeing 0.99 MJD 57463.445 object MzLS_599348_z
   k4m_160509_063944_ooi_zd_ls9.fits.fz k4m_160509_063944_ooi_zd_ls9-CCD3 z exptime 106.105 propid 2016A-0453 seeing 0.99 MJD 57517.278 object MzLS_601292_z
   k4m_160309_103906_ooi_zd_ls9.fits.fz k4m_160309_103906_ooi_zd_ls9-CCD1 z exptime 80.103 propid 2016A-0453 seeing 1.27 MJD 57456.444 object MzLS_600322_z
   ksb_160601_074330_ooi_g_ls9.fits.fz ksb_160601_074330_ooi_g_ls9-CCD3 g exptime 131.2 propid BASS seeing 1.39 MJD 57540.322 object 13153
   ksb_170307_113049_ooi_r_ls9.fits.fz ksb_170307_113049_ooi_r_ls9-CCD3 r exptime 66.708 propid BASS seeing 1.26 MJD 57819.480 object 13153
   ksb_160216_115529_ooi_r_ls9.fits.fz ksb_160216_115529_ooi_r_ls9-CCD1 r exptime 70.0 propid 2015A-0801 seeing 1.38 MJD 57434.497 object 13141
   ksb_160210_122920_ooi_g_ls9.fits.fz ksb_160210_122920_ooi_g_ls9-CCD1 g exptime 75.6 propid 2015A-0801 seeing 1.48 MJD 57428.520 object 13141
   ksb_170527_045859_ooi_g_ls9.fits.fz ksb_170527_045859_ooi_g_ls9-CCD2 g exptime 90.221 propid 2015A-0801 seeing 1.64 MJD 57900.208 object 13142
   ksb_160512_072137_ooi_r_ls9.fits.fz ksb_160512_072137_ooi_r_ls9-CCD2 r exptime 57.7 propid BASS seeing 1.36 MJD 57520.307 object 13142
mosaic get_fwhm: self.fwhm = 4.89
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3893 4046 and amp range 2006 4053 and image y 535 843 and amp range 0 2039
Range in image: x 0 154 , y 0 309 (with image size 154 x 309)
dzp 0.001388291 -> scaling image by 1.0012794811153327
mosaic get_fwhm: self.fwhm = 3.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1199 1508 and amp range 0 2005 and image y 3038 3351 and amp range 2040 4078
Range in image: x 0 310 , y 0 314 (with image size 310 x 314)
dzp 0.0022078273 -> scaling image by 1.0020355530120029
Faked up EXPNUM 75400076
Faked up EXPNUM 75400076
Faked up EXPNUM 75400076
90prime get_fwhm: self.fwhm = 3.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 415 592 and amp range 0 2015 and image y 2762 2938 and amp range 2048 4095
Range in image: x 0 178 , y 0 177 (with image size 178 x 177)
dzp -0.0045482004 -> scaling image by 0.9958197144381092
mosaic get_fwhm: self.fwhm = 3.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2288 2593 and amp range 2048 4095 and image y 2959 3263 and amp range 2040 4078
Range in image: x 0 306 , y 0 305 (with image size 306 x 305)
dzp -0.009154885 -> scaling image by 0.9916034885139223
Faked up EXPNUM 74280274
Faked up EXPNUM 74280274
Faked up EXPNUM 74280274
90prime get_fwhm: self.fwhm = 3.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2363 2540 and amp range 2016 4031 and image y 1216 1393 and amp range 0 2047
Range in image: x 0 178 , y 0 178 (with image size 178 x 178)
dzp -0.0032519526 -> scaling image by 0.9970093219958882
Faked up EXPNUM 78190167
Faked up EXPNUM 78190167
Faked up EXPNUM 78190167
90prime get_fwhm: self.fwhm = 2.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 400 577 and amp range 0 2015 and image y 2782 2958 and amp range 2048 4095
Range in image: x 0 178 , y 0 177 (with image size 178 x 177)
dzp -0.07725406 -> scaling image by 0.9313188157188347
Faked up EXPNUM 74340206
Faked up EXPNUM 74340206
Faked up EXPNUM 74340206
90prime get_fwhm: self.fwhm = 3.05
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2335 2512 and amp range 2016 4031 and image y 1209 1386 and amp range 0 2047
Range in image: x 0 178 , y 0 178 (with image size 178 x 178)
dzp -0.0041296566 -> scaling image by 0.9962036700684744
Faked up EXPNUM 79000047
Faked up EXPNUM 79000047
Faked up EXPNUM 79000047
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 190 366 and amp range 0 2015 and image y 3191 3366 and amp range 2048 4095
Range in image: x 0 177 , y 0 176 (with image size 177 x 176)
dzp 0.051889952 -> scaling image by 1.0489528829333021
Faked up EXPNUM 75200103
Faked up EXPNUM 75200103
Faked up EXPNUM 75200103
90prime get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 193 369 and amp range 0 2015 and image y 3193 3369 and amp range 2048 4095
Range in image: x 0 177 , y 0 177 (with image size 177 x 177)
dzp 0.016961161 -> scaling image by 1.0157444649385616
Stage tims : Wall: 5.80 s, CPU: 1.03 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.566544 MB
Stage tims finished: 2020-06-07T16:57:48.318624
Resources for stage tims : 3.419 s worker CPU, 14.322 s worker Wall, Wall: 5.797 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/PGC099822-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/PGC099822-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T16:57:48.338530
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02316.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02317.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02189.fits
Matched 3 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/metrics/cus/reference-custom-216152p39204.fits
Stage refs : Wall: 2.14 s, CPU: 1.72 s, VmPeak: 972 MB, VmSize: 954 MB, VmRSS: 185 MB, VmData: 218 MB, maxrss: 0.566544 MB
Stage refs finished: 2020-06-07T16:57:50.474649
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.137 s, Cores in use: 0.80, Total efficiency (on 4 cores): 20.1 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T16:57:50.476192
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/metrics/cus/outlier-mask-custom-216152p39204.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/metrics/cus/outliers-pre-custom-216152p39204.jpg
Image ksb_160601_074330_ooi_g_ls9-CCD3 g : masking 94 positive outlier pixels and 0 negative outlier pixels
Image ksb_170527_045859_ooi_g_ls9-CCD2 g : masking 1432 positive outlier pixels and 0 negative outlier pixels
Image ksb_160216_115529_ooi_r_ls9-CCD1 r : masking 53 positive outlier pixels and 0 negative outlier pixels
Image ksb_160512_072137_ooi_r_ls9-CCD2 r : masking 318 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/metrics/cus/outlier-mask-custom-216152p39204.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/metrics/cus/outliers-post-custom-216152p39204.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/metrics/cus/outliers-masked-pos-custom-216152p39204.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/metrics/cus/outliers-masked-neg-custom-216152p39204.jpg
Stage outliers : Wall: 1.37 s, CPU: 1.01 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 203 MB, VmData: 232 MB, maxrss: 0.566544 MB
Stage outliers finished: 2020-06-07T16:57:51.842871
Resources for stage outliers : 1.267 s worker CPU, 1.278 s worker Wall, Wall: 1.368 s, Cores in use: 1.66, Total efficiency (on 4 cores): 41.6 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T16:57:51.844602
Stage halos : Wall: 0.24 s, CPU: 0.23 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 203 MB, VmData: 232 MB, maxrss: 0.566544 MB
Stage halos finished: 2020-06-07T16:57:52.082564
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.239 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.9 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T16:57:52.084421
PSF sigmas in coadd pixels: ['2.26', '2.41', '2.66']
Using average PSF sigma 2.440838407848077
Gaussian PSF norm 0.11557290759882059 vs pixelized 0.09497923
average tim pixel scale / coadd scale: 1.7294226985652255
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.04', '2.24', '2.22']
Using average PSF sigma 2.166094097980435
Gaussian PSF norm 0.13023201163647052 vs pixelized 0.11049261
average tim pixel scale / coadd scale: 1.7294510914624193
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.61', '1.61', '2.06']
Using average PSF sigma 1.761186164817289
Gaussian PSF norm 0.16017318180735513 vs pixelized 0.13136569
average tim pixel scale / coadd scale: 0.9909245422828004
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.23 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 204 MB, VmData: 232 MB, maxrss: 0.566544 MB
Stage fit_on_coadds finished: 2020-06-07T16:57:52.338005
Resources for stage fit_on_coadds : 0.306 s worker CPU, 0.321 s worker Wall, Wall: 0.255 s, Cores in use: 2.10, Total efficiency (on 4 cores): 52.4 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T16:57:52.340633
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 19 potential peaks
Of 19 potential peaks: 4 in veto map, 2 cut by saddle test, 0 cut by aper test, 13 kept
SED z : 13 new peaks
Found 15 potential peaks
Of 15 potential peaks: 15 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 12 potential peaks
Of 12 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 20 potential peaks
Of 20 potential peaks: 19 in veto map, 0 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 21 potential peaks
Of 21 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 17 new sources
Median coadd sky for g : 2.8037974e-05
Median coadd sky for r : 0.00028706586
Median coadd sky for z : 0.0001490324
Stage srcs : Wall: 0.51 s, CPU: 0.44 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 205 MB, VmData: 232 MB, maxrss: 0.566544 MB
Stage srcs finished: 2020-06-07T16:57:52.845838
Resources for stage srcs : 0.152 s worker CPU, 0.152 s worker Wall, Wall: 0.506 s, Cores in use: 1.17, Total efficiency (on 4 cores): 29.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/PGC099822-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/PGC099822-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T16:57:52.858491
Blob 1 of 15, id: 8, sources: 2, size: 100x123, npix 6558, brick X: 87,187, Y: 88,211, one pixel: 170 88
Blob 2 of 15, id: 3, sources: 3, size: 39x66, npix 1681, brick X: 182,221, Y: 45,111, one pixel: 196 45
Blob 3 of 15, id: 7, sources: 3, size: 39x45, npix 1151, brick X: 262,301, Y: 74,119, one pixel: 286 74
Blob 4 of 15, id: 2, sources: 2, size: 47x39, npix 1147, brick X: 240,287, Y: 33,72, one pixel: 265 33
Blob 5 of 15, id: 13, sources: 1, size: 32x33, npix 729, brick X: 174,206, Y: 260,293, one pixel: 187 260
Blob 4 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143036 MB
Blob 6 of 15, id: 12, sources: 1, size: 30x32, npix 646, brick X: 23,53, Y: 240,272, one pixel: 36 240
Blob 3 finished, total: Wall: 1.76 s, CPU: 1.75 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142824 MB
Blob 7 of 15, id: 11, sources: 1, size: 27x27, npix 505, brick X: 128,155, Y: 235,262, one pixel: 138 235
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14364 MB
Blob 8 of 15, id: 4, sources: 1, size: 29x27, npix 491, brick X: 83,112, Y: 49,76, one pixel: 91 49
Blob 2 finished, total: Wall: 2.46 s, CPU: 2.46 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142628 MB
Blob 9 of 15, id: 1, sources: 1, size: 22x25, npix 402, brick X: 0,22, Y: 30,55, one pixel: 5 30
Blob 10 of 15, id: 6, sources: 1, size: 25x25, npix 387, brick X: 115,140, Y: 73,98, one pixel: 126 73
Blob 7 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14364 MB
Blob 6 finished, total: Wall: 1.20 s, CPU: 1.20 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143188 MB
Blob 11 of 15, id: 9, sources: 1, size: 23x25, npix 355, brick X: 32,55, Y: 115,140, one pixel: 42 115
Blob 8 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142628 MB
Blob 12 of 15, id: 0, sources: 2, size: 16x30, npix 353, brick X: 285,301, Y: 13,43, one pixel: 295 13
Blob 13 of 15, id: 14, sources: 1, size: 23x22, npix 304, brick X: 151,174, Y: 277,299, one pixel: 161 277
Blob 10 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143188 MB
Blob 14 of 15, id: 5, sources: 1, size: 21x20, npix 248, brick X: 52,73, Y: 53,73, one pixel: 62 53
Blob 11 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142628 MB
Blob 15 of 15, id: 10, sources: 1, size: 19x19, npix 199, brick X: 198,217, Y: 166,185, one pixel: 206 166
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.55545, ee1=0.615781, ee2=0.531217
Blob 1 finished, total: Wall: 3.80 s, CPU: 3.80 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144684 MB
Blob 13 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142628 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (216.13791, 39.19610), pm (0.8, -11.5), parallax 0.398 with NanoMaggies: g=21.5, r=20.9, z=20.5
Reset brightness to NanoMaggies: g=21.5, r=20.8, z=20.5
Blob 12 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143188 MB
Blob 15 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142628 MB
Blob 9 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14364 MB
Blob 14 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144684 MB
Old catalog: 24
New catalog: 23
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/metrics/cus/blobs-custom-216152p39204.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/metrics/cus/all-models-custom-216152p39204.fits
Stage fitblobs : Wall: 4.92 s, CPU: 0.56 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 205 MB, VmData: 232 MB, maxrss: 0.566544 MB
Stage fitblobs finished: 2020-06-07T16:57:57.781912
Resources for stage fitblobs : 16.563 s worker CPU, 16.597 s worker Wall, Wall: 4.925 s, Cores in use: 3.48, Total efficiency (on 4 cores): 87.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T16:57:57.783700
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/tmp-legacysurvey-custom-216152p39204-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/tmp-legacysurvey-custom-216152p39204-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/tmp-legacysurvey-custom-216152p39204-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/tmp-legacysurvey-custom-216152p39204-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-resid.jpg
Stage coadds : Wall: 1.40 s, CPU: 0.66 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 206 MB, VmData: 233 MB, maxrss: 0.566544 MB
Stage coadds finished: 2020-06-07T16:57:59.179426
Resources for stage coadds : 1.989 s worker CPU, 2.249 s worker Wall, Wall: 1.397 s, Cores in use: 1.90, Total efficiency (on 4 cores): 47.4 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T16:57:59.181129
Cut to 1 unWISE tiles
Reading WISE tile 2167p393 band 3
Reading WISE tile 2167p393 band 2
Reading WISE tile 2167p393 band 1
Reading WISE tile 2167p393 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 807 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.187964 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.204792 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.2089 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2167p393/unwise-2167p393-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20826 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/tmp-legacysurvey-custom-216152p39204-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/tmp-legacysurvey-custom-216152p39204-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.49 s, CPU: 0.47 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 206 MB, VmData: 233 MB, maxrss: 0.566544 MB
Stage wise_forced finished: 2020-06-07T16:58:01.672299
Resources for stage wise_forced : 4.512 s worker CPU, 6.173 s worker Wall, Wall: 2.492 s, Cores in use: 2.00, Total efficiency (on 4 cores): 50.0 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T16:58:01.674115
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/coadd/cus/custom-216152p39204/legacysurvey-custom-216152p39204-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/tractor-i/cus/tractor-custom-216152p39204.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/tractor/cus/tractor-custom-216152p39204.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC099822/tractor/cus/brick-custom-216152p39204.sha256sum
Stage writecat : Wall: 1.30 s, CPU: 0.61 s, VmPeak: 1096 MB, VmSize: 968 MB, VmRSS: 208 MB, VmData: 233 MB, maxrss: 0.566544 MB
Stage writecat finished: 2020-06-07T16:58:02.976747
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.304 s, Cores in use: 0.47, Total efficiency (on 4 cores): 11.8 %
Stage writecat finished
All done: 28.209 s worker CPU, 41.095 s worker Wall, Wall: 20.459 s, Cores in use: 1.72, Total efficiency (on 4 cores): 43.0 %
Finished galaxy PGC099822 in 0.372 minutes.