Started working on galaxy PGC2386530 at Sun Jun  7 17:45:41 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.26756299999997 50.9972649 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/PGC2386530-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/PGC2386530-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:45:42.485624
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '166.26756299999997', '50.9972649', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/PGC2386530-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/PGC2386530-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.26756299999997 50.9972649 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/PGC2386530-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/PGC2386530-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 166.26756299999997 50.9972649
Starting process 28371 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 28372 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 28373 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 28374 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:45:43.100152
Keeping 10 CCDs:
   k4m_160420_055335_ooi_zd_ls9.fits.fz k4m_160420_055335_ooi_zd_ls9-CCD2 z exptime 80.102 propid 2016A-0453 seeing 1.06 MJD 57498.246 object MzLS_653401_z
   k4m_170520_053546_ooi_zd_ls9.fits.fz k4m_170520_053546_ooi_zd_ls9-CCD1 z exptime 109.105 propid 2016A-0453 seeing 1.18 MJD 57893.233 object MzLS_654192_z
   k4m_170319_110306_ooi_zd_ls9.fits.fz k4m_170319_110306_ooi_zd_ls9-CCD4 z exptime 80.105 propid 2016A-0453 seeing 0.99 MJD 57831.460 object MzLS_652606_z
   k4m_160420_055130_ooi_zd_ls9.fits.fz k4m_160420_055130_ooi_zd_ls9-CCD4 z exptime 80.103 propid 2016A-0453 seeing 0.98 MJD 57498.244 object MzLS_653400_z
   ksb_170321_070004_ooi_r_ls9.fits.fz ksb_170321_070004_ooi_r_ls9-CCD2 r exptime 64.625 propid BASS seeing 1.28 MJD 57833.292 object 27662
   ksb_160505_042229_ooi_g_ls9.fits.fz ksb_160505_042229_ooi_g_ls9-CCD2 g exptime 249.7 propid BASS seeing 2.58 MJD 57513.182 object 27662
   ksb_170422_070359_ooi_r_ls9.fits.fz ksb_170422_070359_ooi_r_ls9-CCD3 r exptime 66.753 propid BASS seeing 1.22 MJD 57865.294 object 27673
   ksb_170401_063241_ooi_g_ls9.fits.fz ksb_170401_063241_ooi_g_ls9-CCD3 g exptime 172.2 propid BASS seeing 2.18 MJD 57844.273 object 27673
   ksb_170403_054929_ooi_r_ls9.fits.fz ksb_170403_054929_ooi_r_ls9-CCD1 r exptime 136.273 propid BASS seeing 1.87 MJD 57846.243 object 27661
   ksb_160314_071829_ooi_g_ls9.fits.fz ksb_160314_071829_ooi_g_ls9-CCD1 g exptime 51.3 propid 2015A-0801 seeing 1.58 MJD 57461.305 object 27661
mosaic get_fwhm: self.fwhm = 4.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2108 2344 and amp range 2006 4053 and image y 821 1061 and amp range 0 2039
Range in image: x 0 237 , y 0 241 (with image size 237 x 241)
dzp 0.000620604 -> scaling image by 1.0005717608254892
mosaic get_fwhm: self.fwhm = 3.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 575 813 and amp range 0 2047 and image y 3807 4047 and amp range 2022 4060
Range in image: x 0 239 , y 0 241 (with image size 239 x 241)
dzp 0.0033053984 -> scaling image by 1.0030490232713904
mosaic get_fwhm: self.fwhm = 4.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 565 803 and amp range 0 2047 and image y 186 425 and amp range 0 2039
Range in image: x 0 239 , y 0 240 (with image size 239 x 240)
dzp -0.006320339 -> scaling image by 0.9941956631368829
mosaic get_fwhm: self.fwhm = 3.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3276 3518 and amp range 2048 4095 and image y 2066 2304 and amp range 2022 4060
Range in image: x 0 243 , y 0 239 (with image size 243 x 239)
dzp -0.02499645 -> scaling image by 0.9772404160512723
Faked up EXPNUM 78330147
Faked up EXPNUM 78330147
Faked up EXPNUM 78330147
90prime get_fwhm: self.fwhm = 2.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1857 1993 and amp range 0 2015 and image y 3807 3942 and amp range 2048 4095
Range in image: x 0 137 , y 0 136 (with image size 137 x 136)
dzp 0.05525464 -> scaling image by 1.0522086198429996
Faked up EXPNUM 78650125
Faked up EXPNUM 78650125
Faked up EXPNUM 78650125
90prime get_fwhm: self.fwhm = 2.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2077 2214 and amp range 2016 4031 and image y 3374 3511 and amp range 2048 4095
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp -0.035697103 -> scaling image by 0.9676563679910417
Faked up EXPNUM 75130050
Faked up EXPNUM 75130050
Faked up EXPNUM 75130050
90prime get_fwhm: self.fwhm = 5.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1872 2008 and amp range 0 2015 and image y 3810 3945 and amp range 2048 4095
Range in image: x 0 137 , y 0 136 (with image size 137 x 136)
dzp 0.01693853 -> scaling image by 1.015723292931903
Faked up EXPNUM 78440067
Faked up EXPNUM 78440067
Faked up EXPNUM 78440067
90prime get_fwhm: self.fwhm = 4.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2083 2219 and amp range 2016 4031 and image y 3368 3504 and amp range 2048 4095
Range in image: x 0 137 , y 0 137 (with image size 137 x 137)
dzp -0.02530836 -> scaling image by 0.9769597156943128
Stage tims : Wall: 5.52 s, CPU: 0.93 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.56656 MB
Stage tims finished: 2020-06-07T17:45:48.617807
Faked up EXPNUM 74610107
Faked up EXPNUM 74610107
Faked up EXPNUM 74610107
Faked up EXPNUM 78460087
Faked up EXPNUM 78460087
Faked up EXPNUM 78460087
Resources for stage tims : 3.519 s worker CPU, 13.083 s worker Wall, Wall: 5.519 s, Cores in use: 0.81, Total efficiency (on 4 cores): 20.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/PGC2386530-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/PGC2386530-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:45:48.640615
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01347.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01348.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01453.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01246.fits
Matched 9 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/metrics/cus/reference-custom-166267p50997.fits
Stage refs : Wall: 2.00 s, CPU: 1.45 s, VmPeak: 972 MB, VmSize: 952 MB, VmRSS: 182 MB, VmData: 214 MB, maxrss: 0.56656 MB
Stage refs finished: 2020-06-07T17:45:50.641325
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.002 s, Cores in use: 0.72, Total efficiency (on 4 cores): 18.1 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:45:50.642818
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/metrics/cus/outlier-mask-custom-166267p50997.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/metrics/cus/outliers-pre-custom-166267p50997.jpg
Image k4m_160420_055335_ooi_zd_ls9-CCD2 z : masking 543 positive outlier pixels and 0 negative outlier pixels
Image k4m_170520_053546_ooi_zd_ls9-CCD1 z : masking 457 positive outlier pixels and 0 negative outlier pixels
Image k4m_160420_055130_ooi_zd_ls9-CCD4 z : masking 171 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/metrics/cus/outlier-mask-custom-166267p50997.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/metrics/cus/outliers-post-custom-166267p50997.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/metrics/cus/outliers-masked-pos-custom-166267p50997.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/metrics/cus/outliers-masked-neg-custom-166267p50997.jpg
Stage outliers : Wall: 0.81 s, CPU: 0.60 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 193 MB, VmData: 223 MB, maxrss: 0.56656 MB
Stage outliers finished: 2020-06-07T17:45:51.452756
Resources for stage outliers : 0.633 s worker CPU, 0.635 s worker Wall, Wall: 0.811 s, Cores in use: 1.52, Total efficiency (on 4 cores): 38.1 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:45:51.454379
Stage halos : Wall: 0.27 s, CPU: 0.27 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 193 MB, VmData: 223 MB, maxrss: 0.56656 MB
Stage halos finished: 2020-06-07T17:45:51.723515
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.270 s, Cores in use: 0.99, Total efficiency (on 4 cores): 24.8 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T17:45:51.725318
PSF sigmas in coadd pixels: ['4.19', '3.54']
Using average PSF sigma 3.8644830725976997
Gaussian PSF norm 0.07299677252415922 vs pixelized 0.0566236
average tim pixel scale / coadd scale: 1.7298398608739936
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.08', '1.98']
Using average PSF sigma 2.031123608974278
Gaussian PSF norm 0.1388860778967247 vs pixelized 0.13023044
average tim pixel scale / coadd scale: 1.7293964717928176
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.72', '1.92', '1.61', '1.60']
Using average PSF sigma 1.7098249552411178
Gaussian PSF norm 0.16498460319530045 vs pixelized 0.14983803
average tim pixel scale / coadd scale: 0.9908978406291895
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.14 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 194 MB, VmData: 223 MB, maxrss: 0.56656 MB
Stage fit_on_coadds finished: 2020-06-07T17:45:51.928544
Resources for stage fit_on_coadds : 0.143 s worker CPU, 0.143 s worker Wall, Wall: 0.204 s, Cores in use: 1.38, Total efficiency (on 4 cores): 34.5 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:45:51.931161
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 21 potential peaks
Of 21 potential peaks: 4 in veto map, 3 cut by saddle test, 0 cut by aper test, 14 kept
SED z : 14 new peaks
Found 11 potential peaks
Of 11 potential peaks: 9 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 10 potential peaks
Of 10 potential peaks: 10 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 18 potential peaks
Of 18 potential peaks: 15 in veto map, 0 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 18 potential peaks
Of 18 potential peaks: 16 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 18 new sources
Median coadd sky for g : 4.776974e-05
Median coadd sky for r : 0.00018065072
Median coadd sky for z : -9.548919e-05
Stage srcs : Wall: 0.48 s, CPU: 0.43 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 195 MB, VmData: 223 MB, maxrss: 0.56656 MB
Stage srcs finished: 2020-06-07T17:45:52.408557
Resources for stage srcs : 0.089 s worker CPU, 0.098 s worker Wall, Wall: 0.478 s, Cores in use: 1.08, Total efficiency (on 4 cores): 27.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/PGC2386530-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/PGC2386530-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:45:52.420264
Blob 1 of 14, id: 6, sources: 4, size: 133x94, npix 8661, brick X: 60,193, Y: 69,163, one pixel: 131 69
Blob 2 of 14, id: 5, sources: 3, size: 56x45, npix 1464, brick X: 4,60, Y: 56,101, one pixel: 30 56
Blob 3 of 14, id: 12, sources: 1, size: 62x32, npix 1427, brick X: 68,130, Y: 201,233, one pixel: 84 201
Blob 4 of 14, id: 3, sources: 1, size: 43x38, npix 1134, brick X: 167,210, Y: 15,53, one pixel: 185 15
Blob 5 of 14, id: 8, sources: 2, size: 41x43, npix 970, brick X: 41,82, Y: 146,189, one pixel: 50 146
Blob 3 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 803 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.13944 MB
Blob 6 of 14, id: 0, sources: 1, size: 34x36, npix 813, brick X: 69,103, Y: 6,42, one pixel: 83 6
Blob 4 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141552 MB
Blob 7 of 14, id: 7, sources: 1, size: 28x32, npix 659, brick X: 0,28, Y: 111,143, one pixel: 7 111
Blob 2 finished, total: Wall: 2.18 s, CPU: 2.18 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141708 MB
Blob 8 of 14, id: 11, sources: 1, size: 27x26, npix 455, brick X: 150,177, Y: 173,199, one pixel: 162 173
Blob 5 finished, total: Wall: 1.75 s, CPU: 1.75 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141384 MB
Blob 9 of 14, id: 9, sources: 1, size: 21x26, npix 360, brick X: 212,233, Y: 158,184, one pixel: 224 158
Blob 10 of 14, id: 2, sources: 1, size: 21x22, npix 291, brick X: 208,229, Y: 12,34, one pixel: 216 12
Blob 8 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142192 MB
Blob 11 of 14, id: 1, sources: 1, size: 22x22, npix 284, brick X: 40,62, Y: 12,34, one pixel: 50 12
Blob 6 finished, total: Wall: 1.96 s, CPU: 1.96 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14212 MB
Blob 12 of 14, id: 4, sources: 1, size: 21x20, npix 230, brick X: 134,155, Y: 30,50, one pixel: 143 30
Blob 7 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142256 MB
Blob 13 of 14, id: 13, sources: 1, size: 19x19, npix 181, brick X: 45,64, Y: 210,229, one pixel: 54 210
Blob 9 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142192 MB
Blob 14 of 14, id: 10, sources: 1, size: 17x18, npix 162, brick X: 178,195, Y: 159,177, one pixel: 186 159
Blob 11 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142256 MB
Blob 13 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142256 MB
Blob 10 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14212 MB
Blob 14 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142256 MB
Blob 12 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142192 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.844841, ee1=0.0267585, ee2=0.453701
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 6.46 s, CPU: 6.46 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143736 MB
Old catalog: 20
New catalog: 19
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/metrics/cus/blobs-custom-166267p50997.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/metrics/cus/all-models-custom-166267p50997.fits
Stage fitblobs : Wall: 6.95 s, CPU: 0.48 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 195 MB, VmData: 223 MB, maxrss: 0.56656 MB
Stage fitblobs finished: 2020-06-07T17:45:59.374791
Resources for stage fitblobs : 17.997 s worker CPU, 18.048 s worker Wall, Wall: 6.956 s, Cores in use: 2.66, Total efficiency (on 4 cores): 66.4 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:45:59.376626
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/tmp-legacysurvey-custom-166267p50997-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/tmp-legacysurvey-custom-166267p50997-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/tmp-legacysurvey-custom-166267p50997-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/tmp-legacysurvey-custom-166267p50997-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-resid.jpg
Stage coadds : Wall: 1.28 s, CPU: 0.59 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 195 MB, VmData: 223 MB, maxrss: 0.56656 MB
Stage coadds finished: 2020-06-07T17:46:00.656522
Resources for stage coadds : 1.782 s worker CPU, 1.968 s worker Wall, Wall: 1.281 s, Cores in use: 1.85, Total efficiency (on 4 cores): 46.3 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:46:00.658133
Cut to 1 unWISE tiles
Reading WISE tile 1668p514 band 3
Reading WISE tile 1668p514 band 4
Reading WISE tile 1668p514 band 1
Reading WISE tile 1668p514 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 804 MB, VmSize: 795 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.1933 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 169 MB, maxrss: 0.2045 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208292 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1668p514/unwise-1668p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208444 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/tmp-legacysurvey-custom-166267p50997-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/tmp-legacysurvey-custom-166267p50997-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.46 s, CPU: 0.58 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 196 MB, VmData: 223 MB, maxrss: 0.56656 MB
Stage wise_forced finished: 2020-06-07T17:46:03.116864
Resources for stage wise_forced : 4.222 s worker CPU, 5.851 s worker Wall, Wall: 2.460 s, Cores in use: 1.95, Total efficiency (on 4 cores): 48.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:46:03.118576
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/coadd/cus/custom-166267p50997/legacysurvey-custom-166267p50997-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/tractor-i/cus/tractor-custom-166267p50997.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/tractor/cus/tractor-custom-166267p50997.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2386530/tractor/cus/brick-custom-166267p50997.sha256sum
Stage writecat : Wall: 1.04 s, CPU: 0.51 s, VmPeak: 1093 MB, VmSize: 965 MB, VmRSS: 198 MB, VmData: 223 MB, maxrss: 0.56656 MB
Stage writecat finished: 2020-06-07T17:46:04.162633
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.045 s, Cores in use: 0.49, Total efficiency (on 4 cores): 12.3 %
Stage writecat finished
All done: 28.386 s worker CPU, 39.828 s worker Wall, Wall: 21.067 s, Cores in use: 1.63, Total efficiency (on 4 cores): 40.8 %
Finished galaxy PGC2386530 in 0.386 minutes.