Started working on galaxy PGC2706390 at Sun Jun  7 16:36:56 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 104.59408350000001 67.80586109999999 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/PGC2706390-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/PGC2706390-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T16:36:57.349979
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '104.59408350000001', '67.80586109999999', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/PGC2706390-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/PGC2706390-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 104.59408350000001 67.80586109999999 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/PGC2706390-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/PGC2706390-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 104.59408350000001 67.80586109999999
Starting process 855 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 856 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 858 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 859 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T16:36:57.900587
Keeping 8 CCDs:
   k4m_160217_032458_ooi_zd_ls9.fits.fz k4m_160217_032458_ooi_zd_ls9-CCD4 z exptime 108.103 propid 2016A-0453 seeing 1.06 MJD 57435.142 object MzLS_708473_z
   k4m_170210_043952_ooi_zd_ls9.fits.fz k4m_170210_043952_ooi_zd_ls9-CCD4 z exptime 136.104 propid 2016A-0453 seeing 0.85 MJD 57794.194 object MzLS_707991_z
   k4m_160217_032000_ooi_zd_ls9.fits.fz k4m_160217_032000_ooi_zd_ls9-CCD3 z exptime 118.104 propid 2016A-0453 seeing 1.13 MJD 57435.139 object MzLS_708951_z
   ksb_181215_085942_ooi_g_ls9.fits.fz ksb_181215_085942_ooi_g_ls9-CCD1 g exptime 250.0 propid NOTBASS seeing 1.62 MJD 58467.375 object 
   ksb_170205_035138_ooi_r_ls9.fits.fz ksb_170205_035138_ooi_r_ls9-CCD1 r exptime 238.8 propid BASS seeing 1.36 MJD 57789.161 object 44143
   ksb_190104_084156_ooi_g_ls9.fits.fz ksb_190104_084156_ooi_g_ls9-CCD4 g exptime 114.93 propid NOTBASS seeing 1.69 MJD 58487.362 object 
   ksb_190208_054652_ooi_r_ls9.fits.fz ksb_190208_054652_ooi_r_ls9-CCD2 r exptime 85.05 propid NOTBASS seeing 1.19 MJD 58522.241 object 
   ksb_180410_040354_ooi_g_ls9.fits.fz ksb_180410_040354_ooi_g_ls9-CCD2 g exptime 191.55 propid BASS seeing 1.70 MJD 58218.169 object 44141
mosaic get_fwhm: self.fwhm = 4.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 504 738 and amp range 0 2047 and image y 0 126 and amp range 0 2021
Range in image: x 0 235 , y 0 127 (with image size 235 x 127)
dzp 0.005139143 -> scaling image by 1.0047445456970268
mosaic get_fwhm: self.fwhm = 4.37
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2078 2314 and amp range 2006 4053 and image y 2422 2660 and amp range 2040 4078
Range in image: x 0 237 , y 0 239 (with image size 237 x 239)
dzp -0.0026360443 -> scaling image by 0.99757505842151
mosaic get_fwhm: self.fwhm = 3.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3216 3456 and amp range 2048 4095 and image y 1751 1989 and amp range 0 2021
Range in image: x 0 241 , y 0 239 (with image size 241 x 239)
dzp -0.03444113 -> scaling image by 0.9687763957004109
Faked up EXPNUM 84670063
Faked up EXPNUM 84670063
Faked up EXPNUM 84670063
90prime get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3585 3722 and amp range 2016 4031 and image y 1953 2090 and amp range 0 2047
Range in image: x 0 138 , y 0 95 (with image size 138 x 138)
dzp -0.016997293 -> scaling image by 0.9844668188169152
Found overlap: image x 3585 3722 and amp range 2016 4031 and image y 1953 2090 and amp range 2048 4095
Range in image: x 0 138 , y 95 138 (with image size 138 x 138)
dzp 0.016853841 -> scaling image by 1.0156440682362244
Faked up EXPNUM 77890063
Faked up EXPNUM 77890063
Faked up EXPNUM 77890063
90prime get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3589 3726 and amp range 2016 4031 and image y 1920 2057 and amp range 0 2047
Range in image: x 0 138 , y 0 128 (with image size 138 x 138)
dzp -0.006547878 -> scaling image by 0.9939873303458991
Found overlap: image x 3589 3726 and amp range 2016 4031 and image y 1920 2057 and amp range 2048 4095
Range in image: x 0 138 , y 128 138 (with image size 138 x 138)
dzp 0.02308583 -> scaling image by 1.021490500713915
Faked up EXPNUM 85220124
Faked up EXPNUM 85220124
Faked up EXPNUM 85220124
90prime get_fwhm: self.fwhm = 2.63
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1412 1547 and amp range 0 2015 and image y 3921 4056 and amp range 2048 4095
Range in image: x 0 136 , y 0 136 (with image size 136 x 136)
dzp 0.049663078 -> scaling image by 1.0468036570994166
Faked up EXPNUM 84870017
Faked up EXPNUM 84870017
Faked up EXPNUM 84870017
90prime get_fwhm: self.fwhm = 3.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3410 3547 and amp range 2016 4031 and image y 1454 1591 and amp range 0 2047
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp 0.01073364 -> scaling image by 1.0099350760198083
Faked up EXPNUM 82180051
Faked up EXPNUM 82180051
Faked up EXPNUM 82180051
90prime get_fwhm: self.fwhm = 3.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1391 1526 and amp range 0 2015 and image y 3912 4047 and amp range 2048 4095
Range in image: x 0 136 , y 0 136 (with image size 136 x 136)
dzp 0.0459271 -> scaling image by 1.0432078344950917
Stage tims : Wall: 7.27 s, CPU: 0.98 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 169 MB, VmData: 203 MB, maxrss: 0.566628 MB
Stage tims finished: 2020-06-07T16:37:05.171735
Resources for stage tims : 2.949 s worker CPU, 15.027 s worker Wall, Wall: 7.272 s, Cores in use: 0.54, Total efficiency (on 4 cores): 13.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/PGC2706390-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/PGC2706390-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T16:37:05.190257
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00498.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00437.fits
Matched 1 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/metrics/cus/reference-custom-104594p67805.fits
Stage refs : Wall: 4.73 s, CPU: 3.75 s, VmPeak: 981 MB, VmSize: 975 MB, VmRSS: 205 MB, VmData: 237 MB, maxrss: 0.566628 MB
Stage refs finished: 2020-06-07T16:37:09.916322
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.727 s, Cores in use: 0.79, Total efficiency (on 4 cores): 19.8 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T16:37:09.917938
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/metrics/cus/outlier-mask-custom-104594p67805.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/metrics/cus/outliers-pre-custom-104594p67805.jpg
Image ksb_181215_085942_ooi_g_ls9-CCD1 g : masking 49 positive outlier pixels and 0 negative outlier pixels
Image ksb_190208_054652_ooi_r_ls9-CCD2 r : masking 861 positive outlier pixels and 0 negative outlier pixels
Image k4m_170210_043952_ooi_zd_ls9-CCD4 z : masking 1133 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/metrics/cus/outlier-mask-custom-104594p67805.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/metrics/cus/outliers-post-custom-104594p67805.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/metrics/cus/outliers-masked-pos-custom-104594p67805.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/metrics/cus/outliers-masked-neg-custom-104594p67805.jpg
Stage outliers : Wall: 0.83 s, CPU: 0.62 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 214 MB, VmData: 245 MB, maxrss: 0.566628 MB
Stage outliers finished: 2020-06-07T16:37:10.747287
Resources for stage outliers : 0.573 s worker CPU, 0.575 s worker Wall, Wall: 0.830 s, Cores in use: 1.43, Total efficiency (on 4 cores): 35.8 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T16:37:10.748900
Stage halos : Wall: 0.36 s, CPU: 0.35 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 214 MB, VmData: 245 MB, maxrss: 0.566628 MB
Stage halos finished: 2020-06-07T16:37:11.112654
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.365 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T16:37:11.114312
PSF sigmas in coadd pixels: ['2.63', '2.75', '2.76']
Using average PSF sigma 2.712758567397806
Gaussian PSF norm 0.10398816730840722 vs pixelized 0.08461557
average tim pixel scale / coadd scale: 1.7307561649834267
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.21', '1.94']
Using average PSF sigma 2.0760888813975154
Gaussian PSF norm 0.13587799361652889 vs pixelized 0.105092816
average tim pixel scale / coadd scale: 1.7301493834434005
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.72', '1.39', '1.84']
Using average PSF sigma 1.651452044665376
Gaussian PSF norm 0.17081621757357016 vs pixelized 0.13575277
average tim pixel scale / coadd scale: 0.9908752546126719
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.14 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 217 MB, VmData: 247 MB, maxrss: 0.566628 MB
Stage fit_on_coadds finished: 2020-06-07T16:37:11.285144
Resources for stage fit_on_coadds : 0.146 s worker CPU, 0.148 s worker Wall, Wall: 0.172 s, Cores in use: 1.66, Total efficiency (on 4 cores): 41.6 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T16:37:11.287677
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 29 potential peaks
Of 29 potential peaks: 9 in veto map, 4 cut by saddle test, 0 cut by aper test, 16 kept
SED z : 16 new peaks
Found 24 potential peaks
Of 24 potential peaks: 18 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 20 potential peaks
Of 20 potential peaks: 16 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 31 potential peaks
Of 31 potential peaks: 25 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 38 potential peaks
Of 38 potential peaks: 29 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 20 new sources
Median coadd sky for g : -4.6786692e-05
Median coadd sky for r : 8.002586e-05
Median coadd sky for z : -0.00080347044
Stage srcs : Wall: 0.60 s, CPU: 0.56 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 218 MB, VmData: 247 MB, maxrss: 0.566628 MB
Stage srcs finished: 2020-06-07T16:37:11.888084
Resources for stage srcs : 0.097 s worker CPU, 0.108 s worker Wall, Wall: 0.601 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/PGC2706390-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/PGC2706390-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T16:37:11.900228
Blob 1 of 15, id: 6, sources: 5, size: 167x101, npix 9419, brick X: 31,198, Y: 72,173, one pixel: 75 72
Blob 2 of 15, id: 8, sources: 2, size: 63x60, npix 2416, brick X: 0,63, Y: 103,163, one pixel: 7 103
Blob 3 of 15, id: 0, sources: 2, size: 74x46, npix 2351, brick X: 6,80, Y: 0,46, one pixel: 11 0
Blob 4 of 15, id: 5, sources: 3, size: 48x54, npix 1635, brick X: 182,230, Y: 41,95, one pixel: 214 41
Blob 5 of 15, id: 7, sources: 2, size: 30x49, npix 784, brick X: 203,233, Y: 84,133, one pixel: 229 84
Blob 3 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139408 MB
Blob 6 of 15, id: 4, sources: 2, size: 31x41, npix 774, brick X: 142,173, Y: 24,65, one pixel: 152 24
Blob 2 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141088 MB
Blob 7 of 15, id: 13, sources: 1, size: 31x31, npix 625, brick X: 144,175, Y: 192,223, one pixel: 156 192
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141384 MB
Blob 8 of 15, id: 2, sources: 1, size: 30x28, npix 561, brick X: 77,107, Y: 11,39, one pixel: 88 11
Blob 6 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141088 MB
Blob 9 of 15, id: 1, sources: 1, size: 33x19, npix 456, brick X: 168,201, Y: 0,19, one pixel: 171 0
Blob 7 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141384 MB
Blob 10 of 15, id: 10, sources: 1, size: 23x23, npix 327, brick X: 43,66, Y: 163,186, one pixel: 52 163
Blob 11 of 15, id: 14, sources: 1, size: 19x24, npix 324, brick X: 214,233, Y: 198,222, one pixel: 224 198
Blob 8 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141088 MB
Blob 12 of 15, id: 3, sources: 1, size: 20x23, npix 318, brick X: 213,233, Y: 11,34, one pixel: 225 11
Blob 10 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141088 MB
Blob 13 of 15, id: 11, sources: 1, size: 22x22, npix 299, brick X: 78,100, Y: 168,190, one pixel: 86 168
Blob 9 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141384 MB
Blob 14 of 15, id: 12, sources: 1, size: 20x21, npix 248, brick X: 104,124, Y: 188,209, one pixel: 114 188
Blob 12 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141384 MB
Blob 15 of 15, id: 9, sources: 1, size: 21x20, npix 230, brick X: 196,217, Y: 139,159, one pixel: 206 139
Measuring 1 iterative sources
Blob 11 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141088 MB
Blob 4 finished, total: Wall: 3.94 s, CPU: 3.94 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142472 MB
Blob 13 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141384 MB
Blob 15 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142472 MB
Blob 14 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141088 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.889502, ee1=-0.39866, ee2=-0.286433
Measuring 4 iterative sources
Blob 1 finished, total: Wall: 8.54 s, CPU: 8.54 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144328 MB
Old catalog: 28
New catalog: 27
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/metrics/cus/blobs-custom-104594p67805.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/metrics/cus/all-models-custom-104594p67805.fits
Stage fitblobs : Wall: 9.11 s, CPU: 0.57 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 218 MB, VmData: 247 MB, maxrss: 0.566628 MB
Stage fitblobs finished: 2020-06-07T16:37:21.007899
Resources for stage fitblobs : 21.266 s worker CPU, 21.346 s worker Wall, Wall: 9.109 s, Cores in use: 2.40, Total efficiency (on 4 cores): 59.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T16:37:21.009807
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/tmp-legacysurvey-custom-104594p67805-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/tmp-legacysurvey-custom-104594p67805-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/tmp-legacysurvey-custom-104594p67805-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/tmp-legacysurvey-custom-104594p67805-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-resid.jpg
Stage coadds : Wall: 1.47 s, CPU: 0.67 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 218 MB, VmData: 247 MB, maxrss: 0.566628 MB
Stage coadds finished: 2020-06-07T16:37:22.482199
Resources for stage coadds : 2.033 s worker CPU, 2.194 s worker Wall, Wall: 1.473 s, Cores in use: 1.83, Total efficiency (on 4 cores): 45.8 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T16:37:22.483958
Cut to 1 unWISE tiles
Reading WISE tile 1028p681 band 1
Reading WISE tile 1028p681 band 2
Reading WISE tile 1028p681 band 3
Reading WISE tile 1028p681 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 807 MB, VmSize: 797 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.193532 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208692 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 806 MB, VmSize: 788 MB, VmRSS: 139 MB, VmData: 170 MB, maxrss: 0.203652 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/102/1028p681/unwise-1028p681-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208444 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/tmp-legacysurvey-custom-104594p67805-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/tmp-legacysurvey-custom-104594p67805-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.03 s, CPU: 0.89 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 219 MB, VmData: 247 MB, maxrss: 0.566628 MB
Stage wise_forced finished: 2020-06-07T16:37:25.517688
Resources for stage wise_forced : 4.256 s worker CPU, 6.658 s worker Wall, Wall: 3.035 s, Cores in use: 1.70, Total efficiency (on 4 cores): 42.4 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T16:37:25.519605
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/coadd/cus/custom-104594p67805/legacysurvey-custom-104594p67805-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/tractor-i/cus/tractor-custom-104594p67805.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/tractor/cus/tractor-custom-104594p67805.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2706390/tractor/cus/brick-custom-104594p67805.sha256sum
Stage writecat : Wall: 1.06 s, CPU: 0.81 s, VmPeak: 1117 MB, VmSize: 989 MB, VmRSS: 221 MB, VmData: 247 MB, maxrss: 0.566628 MB
Stage writecat finished: 2020-06-07T16:37:26.580767
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.062 s, Cores in use: 0.76, Total efficiency (on 4 cores): 19.0 %
Stage writecat finished
All done: 31.323 s worker CPU, 46.058 s worker Wall, Wall: 28.685 s, Cores in use: 1.42, Total efficiency (on 4 cores): 35.5 %
Finished galaxy PGC2706390 in 0.514 minutes.