Started working on galaxy PGC3140106 at Sun Jun  7 17:34:00 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.869059 65.88915329999999 --width 235 --height 235 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/PGC3140106-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/PGC3140106-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:34:01.812340
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.869059', '65.88915329999999', '--width', '235', '--height', '235', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/PGC3140106-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/PGC3140106-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.869059 65.88915329999999 --width 235 --height 235 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/PGC3140106-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/PGC3140106-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 167.869059 65.88915329999999
Starting process 44380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 44381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 44382 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 44383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:34:06.180903
Keeping 10 CCDs:
   k4m_171122_095732_ooi_zd_ls9.fits.fz k4m_171122_095732_ooi_zd_ls9-CCD4 z exptime 151.103 propid 2016A-0453 seeing 1.30 MJD 58079.415 object MzLS_703520_z
   k4m_160513_041336_ooi_zd_ls9.fits.fz k4m_160513_041336_ooi_zd_ls9-CCD3 z exptime 125.103 propid 2016A-0453 seeing 1.11 MJD 57521.176 object MzLS_704548_z
   k4m_160417_053625_ooi_zd_ls9.fits.fz k4m_160417_053625_ooi_zd_ls9-CCD2 z exptime 80.106 propid 2016A-0453 seeing 1.16 MJD 57495.234 object MzLS_703000_z
   k4m_160417_054047_ooi_zd_ls9.fits.fz k4m_160417_054047_ooi_zd_ls9-CCD1 z exptime 84.101 propid 2016A-0453 seeing 1.03 MJD 57495.237 object MzLS_704036_z
   ksb_180319_095156_ooi_g_ls9.fits.fz ksb_180319_095156_ooi_g_ls9-CCD2 g exptime 250.0 propid BASS seeing 1.65 MJD 58196.411 object 42741
   ksb_180508_042941_ooi_r_ls9.fits.fz ksb_180508_042941_ooi_r_ls9-CCD2 r exptime 73.67 propid NOTBASS seeing 1.25 MJD 58246.187 object 42741
   ksb_180324_101807_ooi_g_ls9.fits.fz ksb_180324_101807_ooi_g_ls9-CCD3 g exptime 102.685 propid BASS seeing 1.35 MJD 58201.429 object 42753
   ksb_180225_103535_ooi_r_ls9.fits.fz ksb_180225_103535_ooi_r_ls9-CCD3 r exptime 80.466 propid BASS seeing 1.32 MJD 58174.441 object 42753
   ksb_180225_102916_ooi_r_ls9.fits.fz ksb_180225_102916_ooi_r_ls9-CCD1 r exptime 94.153 propid BASS seeing 1.31 MJD 58174.437 object 42743
   ksb_180324_095407_ooi_g_ls9.fits.fz ksb_180324_095407_ooi_g_ls9-CCD1 g exptime 178.33 propid BASS seeing 1.61 MJD 58201.413 object 42743
mosaic get_fwhm: self.fwhm = 4.47
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3752 3995 and amp range 2048 4095 and image y 3184 3421 and amp range 2040 4078
Range in image: x 0 244 , y 0 238 (with image size 244 x 238)
dzp -0.009154885 -> scaling image by 0.9916034885139223
mosaic get_fwhm: self.fwhm = 3.95
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2620 2857 and amp range 2006 4053 and image y 2890 3127 and amp range 2040 4078
Range in image: x 0 238 , y 0 238 (with image size 238 x 238)
dzp -0.006092005 -> scaling image by 0.9944047680378836
mosaic get_fwhm: self.fwhm = 4.99
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1052 1289 and amp range 0 2047 and image y 1358 1595 and amp range 0 2021
Range in image: x 0 238 , y 0 238 (with image size 238 x 238)
dzp -0.029266886 -> scaling image by 0.9734042664541822
Faked up EXPNUM 82460054
Faked up EXPNUM 82460054
Faked up EXPNUM 82460054
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 713 851 and amp range 0 2015 and image y 2258 2396 and amp range 2048 4095
Range in image: x 0 139 , y 0 139 (with image size 139 x 139)
dzp 0.0503617 -> scaling image by 1.047477444828492
Faked up EXPNUM 81960165
Faked up EXPNUM 81960165
Faked up EXPNUM 81960165
90prime get_fwhm: self.fwhm = 3.63
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 710 848 and amp range 0 2015 and image y 2249 2388 and amp range 2048 4095
Range in image: x 0 139 , y 0 140 (with image size 139 x 140)
dzp 0.0459271 -> scaling image by 1.0432078344950917
Faked up EXPNUM 82010074
Faked up EXPNUM 82010074
Faked up EXPNUM 82010074
90prime get_fwhm: self.fwhm = 2.97
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2924 3063 and amp range 2016 4031 and image y 3764 3903 and amp range 2048 4095
Range in image: x 0 140 , y 0 140 (with image size 140 x 140)
dzp -0.01723723 -> scaling image by 0.9842492857213068
Faked up EXPNUM 81740150
Faked up EXPNUM 81740150
Faked up EXPNUM 81740150
90prime get_fwhm: self.fwhm = 2.91
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2924 3062 and amp range 2016 4031 and image y 3767 3906 and amp range 2048 4095
Range in image: x 0 139 , y 0 140 (with image size 139 x 140)
dzp -0.0072602304 -> scaling image by 0.9933353884052984
mosaic get_fwhm: self.fwhm = 4.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 0 106 and amp range 0 2005 and image y 2403 2645 and amp range 2040 4078
Range in image: x 0 107 , y 0 243 (with image size 107 x 243)
dzp 0.0022078273 -> scaling image by 1.0020355530120029
Faked up EXPNUM 82010066
Faked up EXPNUM 82010066
Faked up EXPNUM 82010066
90prime get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2868 3008 and amp range 2016 4031 and image y 293 434 and amp range 0 2047
Range in image: x 0 141 , y 0 142 (with image size 141 x 142)
dzp -0.019046262 -> scaling image by 0.9826107140833663
Faked up EXPNUM 81740147
Faked up EXPNUM 81740147
Faked up EXPNUM 81740147
90prime get_fwhm: self.fwhm = 2.89
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2858 2998 and amp range 2016 4031 and image y 272 413 and amp range 0 2047
Range in image: x 0 141 , y 0 142 (with image size 141 x 142)
dzp -0.03177219 -> scaling image by 0.9711607558798585
Stage tims : Wall: 20.33 s, CPU: 4.79 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.566548 MB
Stage tims finished: 2020-06-07T17:34:26.512727
Resources for stage tims : 3.302 s worker CPU, 32.121 s worker Wall, Wall: 20.333 s, Cores in use: 0.40, Total efficiency (on 4 cores): 10.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/PGC3140106-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/PGC3140106-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:34:26.615779
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00509.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00510.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00575.fits
Matched 5 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/metrics/cus/reference-custom-167869p65889.fits
Stage refs : Wall: 6.06 s, CPU: 5.08 s, VmPeak: 972 MB, VmSize: 955 MB, VmRSS: 184 MB, VmData: 217 MB, maxrss: 0.566548 MB
Stage refs finished: 2020-06-07T17:34:32.676987
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.062 s, Cores in use: 0.84, Total efficiency (on 4 cores): 21.0 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:34:32.678508
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/metrics/cus/outlier-mask-custom-167869p65889.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/metrics/cus/outliers-pre-custom-167869p65889.jpg
Image ksb_180225_103535_ooi_r_ls9-CCD3 r : masking 41 positive outlier pixels and 0 negative outlier pixels
Image k4m_171122_095732_ooi_zd_ls9-CCD4 z : masking 269 positive outlier pixels and 0 negative outlier pixels
Image k4m_160417_053625_ooi_zd_ls9-CCD2 z : masking 154 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/metrics/cus/outlier-mask-custom-167869p65889.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/metrics/cus/outliers-post-custom-167869p65889.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/metrics/cus/outliers-masked-pos-custom-167869p65889.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/metrics/cus/outliers-masked-neg-custom-167869p65889.jpg
Stage outliers : Wall: 6.37 s, CPU: 6.15 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 196 MB, VmData: 226 MB, maxrss: 0.566548 MB
Stage outliers finished: 2020-06-07T17:34:39.045921
Resources for stage outliers : 0.720 s worker CPU, 0.724 s worker Wall, Wall: 6.368 s, Cores in use: 1.08, Total efficiency (on 4 cores): 27.0 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:34:39.047399
Stage halos : Wall: 6.82 s, CPU: 6.80 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 196 MB, VmData: 226 MB, maxrss: 0.566548 MB
Stage halos finished: 2020-06-07T17:34:45.868595
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 6.822 s, Cores in use: 1.00, Total efficiency (on 4 cores): 24.9 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T17:34:45.870220
PSF sigmas in coadd pixels: ['2.67', '2.19', '2.61']
Using average PSF sigma 2.491698297600308
Gaussian PSF norm 0.11321386383157084 vs pixelized 0.09715722
average tim pixel scale / coadd scale: 1.7306688534920565
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.02', '2.14', '2.13']
Using average PSF sigma 2.0987420024986947
Gaussian PSF norm 0.13441137187802274 vs pixelized 0.11830362
average tim pixel scale / coadd scale: 1.7305348203553041
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.10', '1.81', '1.88', '1.67']
Using average PSF sigma 1.865943879988559
Gaussian PSF norm 0.15118074814533428 vs pixelized 0.12570302
average tim pixel scale / coadd scale: 0.990944204030857
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.15 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 198 MB, VmData: 227 MB, maxrss: 0.566548 MB
Stage fit_on_coadds finished: 2020-06-07T17:34:46.060744
Resources for stage fit_on_coadds : 0.175 s worker CPU, 0.177 s worker Wall, Wall: 0.191 s, Cores in use: 1.71, Total efficiency (on 4 cores): 42.8 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:34:46.063237
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 9 potential peaks
Of 9 potential peaks: 1 in veto map, 2 cut by saddle test, 0 cut by aper test, 6 kept
SED z : 6 new peaks
Found 11 potential peaks
Of 11 potential peaks: 6 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 11 potential peaks
Of 11 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 16 potential peaks
Of 16 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 18 potential peaks
Of 18 potential peaks: 12 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 14 new sources
Median coadd sky for g : -6.833574e-06
Median coadd sky for r : -4.9152364e-05
Median coadd sky for z : -0.0001719697
Stage srcs : Wall: 5.73 s, CPU: 5.69 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 198 MB, VmData: 227 MB, maxrss: 0.566548 MB
Stage srcs finished: 2020-06-07T17:34:51.795580
Resources for stage srcs : 0.092 s worker CPU, 0.101 s worker Wall, Wall: 5.733 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/PGC3140106-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/PGC3140106-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:34:51.806430
Blob 1 of 12, id: 4, sources: 2, size: 73x100, npix 3764, brick X: 88,161, Y: 59,159, one pixel: 128 59
Blob 2 of 12, id: 5, sources: 2, size: 32x47, npix 901, brick X: 179,211, Y: 76,123, one pixel: 191 76
Blob 3 of 12, id: 3, sources: 1, size: 39x35, npix 849, brick X: 190,229, Y: 38,73, one pixel: 205 38
Blob 4 of 12, id: 11, sources: 2, size: 31x44, npix 818, brick X: 0,31, Y: 191,235, one pixel: 17 191
Blob 5 of 12, id: 7, sources: 1, size: 32x39, npix 736, brick X: 41,73, Y: 97,136, one pixel: 58 97
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 1.65 s, CPU: 1.65 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141836 MB
Blob 6 of 12, id: 10, sources: 1, size: 36x29, npix 634, brick X: 183,219, Y: 134,163, one pixel: 193 134
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.0984, ee1=0.438213, ee2=0.462514
Measuring 2 iterative sources
Blob 3 finished, total: Wall: 1.91 s, CPU: 1.91 s, VmPeak: 791 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141544 MB
Blob 7 of 12, id: 0, sources: 1, size: 24x25, npix 396, brick X: 78,102, Y: 7,32, one pixel: 89 7
Blob 2 finished, total: Wall: 1.94 s, CPU: 1.94 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141808 MB
Blob 8 of 12, id: 8, sources: 1, size: 24x25, npix 378, brick X: 148,172, Y: 117,142, one pixel: 157 117
Blob 7 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142384 MB
Blob 9 of 12, id: 9, sources: 1, size: 24x24, npix 365, brick X: 22,46, Y: 129,153, one pixel: 32 129
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 2.86 s, CPU: 2.86 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14186 MB
Blob 10 of 12, id: 2, sources: 1, size: 22x22, npix 282, brick X: 97,119, Y: 30,52, one pixel: 106 30
Blob 11 of 12, id: 1, sources: 1, size: 18x18, npix 180, brick X: 115,133, Y: 13,31, one pixel: 123 13
Blob 5 finished, total: Wall: 1.58 s, CPU: 1.58 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142404 MB
Blob 12 of 12, id: 6, sources: 1, size: 16x17, npix 144, brick X: 219,235, Y: 96,113, one pixel: 227 96
Blob 8 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142384 MB
Blob 9 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14186 MB
Blob 11 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142384 MB
Blob 12 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14186 MB
Blob 10 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142404 MB
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 2.18 s, CPU: 2.18 s, VmPeak: 791 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142188 MB
Old catalog: 18
New catalog: 16
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/metrics/cus/blobs-custom-167869p65889.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/metrics/cus/all-models-custom-167869p65889.fits
Stage fitblobs : Wall: 9.14 s, CPU: 4.99 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 199 MB, VmData: 227 MB, maxrss: 0.566548 MB
Stage fitblobs finished: 2020-06-07T17:35:00.945032
Resources for stage fitblobs : 14.615 s worker CPU, 14.645 s worker Wall, Wall: 9.140 s, Cores in use: 2.14, Total efficiency (on 4 cores): 53.6 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:35:00.946975
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/tmp-legacysurvey-custom-167869p65889-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/tmp-legacysurvey-custom-167869p65889-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/tmp-legacysurvey-custom-167869p65889-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/tmp-legacysurvey-custom-167869p65889-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-resid.jpg
Stage coadds : Wall: 8.94 s, CPU: 7.93 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 199 MB, VmData: 227 MB, maxrss: 0.566548 MB
Stage coadds finished: 2020-06-07T17:35:09.887330
Resources for stage coadds : 1.591 s worker CPU, 1.631 s worker Wall, Wall: 8.941 s, Cores in use: 1.07, Total efficiency (on 4 cores): 26.6 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:35:09.888605
Cut to 2 unWISE tiles
Reading WISE tile 1670p666 band 1
Reading WISE tile 1670p666 band 4
Reading WISE tile 1670p666 band 3
Reading WISE tile 1670p666 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 1677p651 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 1677p651 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 1677p651 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20846 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 797 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.188056 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 792 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20452 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1670p666/unwise-1670p666-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 1677p651 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1677p651/unwise-1677p651-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 802 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208792 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/tmp-legacysurvey-custom-167869p65889-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/tmp-legacysurvey-custom-167869p65889-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 45.00 s, CPU: 27.20 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 200 MB, VmData: 227 MB, maxrss: 0.566548 MB
Stage wise_forced finished: 2020-06-07T17:35:54.887710
Resources for stage wise_forced : 6.006 s worker CPU, 30.170 s worker Wall, Wall: 45.000 s, Cores in use: 0.74, Total efficiency (on 4 cores): 18.5 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:35:54.889439
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/coadd/cus/custom-167869p65889/legacysurvey-custom-167869p65889-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/tractor-i/cus/tractor-custom-167869p65889.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/tractor/cus/tractor-custom-167869p65889.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3140106/tractor/cus/brick-custom-167869p65889.sha256sum
Stage writecat : Wall: 7.92 s, CPU: 7.57 s, VmPeak: 1096 MB, VmSize: 968 MB, VmRSS: 202 MB, VmData: 227 MB, maxrss: 0.566548 MB
Stage writecat finished: 2020-06-07T17:36:02.804986
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.917 s, Cores in use: 0.96, Total efficiency (on 4 cores): 23.9 %
Stage writecat finished
All done: 26.502 s worker CPU, 79.570 s worker Wall, Wall: 116.629 s, Cores in use: 0.88, Total efficiency (on 4 cores): 22.1 %
Finished galaxy PGC3140106 in 2.043 minutes.