Started working on galaxy PGC2308662 at Sun Jun  7 19:10:39 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.44193850000002 48.006240999999996 --width 231 --height 231 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/PGC2308662-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/PGC2308662-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T19:10:41.752142
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '128.44193850000002', '48.006240999999996', '--width', '231', '--height', '231', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/PGC2308662-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/PGC2308662-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.44193850000002 48.006240999999996 --width 231 --height 231 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/PGC2308662-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/PGC2308662-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 128.44193850000002 48.006240999999996
Starting process 45629 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057296 MB
Starting process 45632 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 45635 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 45638 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T19:10:42.434921
Keeping 12 CCDs:
   k4m_160410_032013_ooi_zd_ls9.fits.fz k4m_160410_032013_ooi_zd_ls9-CCD2 z exptime 92.103 propid 2016A-0453 seeing 1.05 MJD 57488.139 object MzLS_640256_z
   k4m_160314_050318_ooi_zd_ls9.fits.fz k4m_160314_050318_ooi_zd_ls9-CCD1 z exptime 80.103 propid 2016A-0453 seeing 1.20 MJD 57461.211 object MzLS_641099_z
   k4m_171029_103521_ooi_zd_ls9.fits.fz k4m_171029_103521_ooi_zd_ls9-CCD1 z exptime 143.103 propid 2016A-0453 seeing 0.99 MJD 58055.441 object MzLS_641939_z
   k4m_170426_040700_ooi_zd_ls9.fits.fz k4m_170426_040700_ooi_zd_ls9-CCD1 z exptime 250.106 propid 2016A-0453 seeing 1.61 MJD 57869.172 object MzLS_641939_z
   ksb_160312_051244_ooi_g_ls9.fits.fz ksb_160312_051244_ooi_g_ls9-CCD4 g exptime 162.0 propid 2015A-0801 seeing 2.44 MJD 57459.217 object 23892
   ksb_170321_050607_ooi_r_ls9.fits.fz ksb_170321_050607_ooi_r_ls9-CCD4 r exptime 79.96 propid BASS seeing 1.64 MJD 57833.213 object 23892
   ksb_170201_085845_ooi_g_ls9.fits.fz ksb_170201_085845_ooi_g_ls9-CCD3 g exptime 83.3 propid BASS seeing 1.41 MJD 57785.374 object 23891
   ksb_170324_050029_ooi_r_ls9.fits.fz ksb_170324_050029_ooi_r_ls9-CCD3 r exptime 108.48 propid BASS seeing 1.78 MJD 57836.209 object 23891
   ksb_170321_050004_ooi_r_ls9.fits.fz ksb_170321_050004_ooi_r_ls9-CCD2 r exptime 83.203 propid BASS seeing 1.36 MJD 57833.208 object 23882
   ksb_160312_045223_ooi_g_ls9.fits.fz ksb_160312_045223_ooi_g_ls9-CCD2 g exptime 139.4 propid 2015A-0801 seeing 2.14 MJD 57459.203 object 23882
   ksb_170401_025335_ooi_r_ls9.fits.fz ksb_170401_025335_ooi_r_ls9-CCD3 r exptime 135.6 propid BASS seeing 2.37 MJD 57844.121 object 23893
   ksb_180114_094222_ooi_g_ls9.fits.fz ksb_180114_094222_ooi_g_ls9-CCD3 g exptime 106.427 propid BASS seeing 1.48 MJD 58132.404 object 23893
mosaic get_fwhm: self.fwhm = 6.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1336 1570 and amp range 0 2005 and image y 2570 2805 and amp range 2040 4078
Range in image: x 0 235 , y 0 236 (with image size 235 x 236)
dzp 0.032569118 -> scaling image by 1.0304517167935139
mosaic get_fwhm: self.fwhm = 3.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1311 1546 and amp range 0 2005 and image y 2555 2790 and amp range 2040 4078
Range in image: x 0 236 , y 0 236 (with image size 236 x 236)
dzp 0.014419514 -> scaling image by 1.0133694453441033
mosaic get_fwhm: self.fwhm = 4.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 4012 4046 and amp range 2006 4053 and image y 3330 3561 and amp range 2040 4078
Range in image: x 0 35 , y 0 232 (with image size 35 x 232)
dzp -0.006092005 -> scaling image by 0.9944047680378836
mosaic get_fwhm: self.fwhm = 4.05
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2457 2694 and amp range 2048 4095 and image y 1529 1764 and amp range 0 2039
Range in image: x 0 238 , y 0 236 (with image size 238 x 236)
dzp 0.0072022504 -> scaling image by 1.0066555682883527
Faked up EXPNUM 74590064
Faked up EXPNUM 74590064
Faked up EXPNUM 74590064
90prime get_fwhm: self.fwhm = 5.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1808 1943 and amp range 0 2015 and image y 3903 4039 and amp range 2048 4095
Range in image: x 0 136 , y 0 137 (with image size 136 x 137)
dzp 0.009255477 -> scaling image by 1.0085610475070432
Faked up EXPNUM 77850162
Faked up EXPNUM 77850162
Faked up EXPNUM 77850162
90prime get_fwhm: self.fwhm = 3.11
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3999 4016 and amp range 2016 4031 and image y 1895 2029 and amp range 0 2047
Range in image: x 0 18 , y 0 135 (with image size 18 x 135)
dzp -3.875605e-05 -> scaling image by 0.9999643049955675
Faked up EXPNUM 78330085
Faked up EXPNUM 78330085
Faked up EXPNUM 78330085
90prime get_fwhm: self.fwhm = 3.63
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1821 1956 and amp range 0 2015 and image y 3894 4031 and amp range 2048 4095
Range in image: x 0 136 , y 0 138 (with image size 136 x 138)
dzp 0.01103811 -> scaling image by 1.0102183288830229
Faked up EXPNUM 81320192
Faked up EXPNUM 81320192
Faked up EXPNUM 81320192
90prime get_fwhm: self.fwhm = 3.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2040 2174 and amp range 2016 4031 and image y 15 41 and amp range 0 2047
Range in image: x 0 135 , y 0 27 (with image size 135 x 27)
dzp -0.0012233759 -> scaling image by 0.9988738637196966
Faked up EXPNUM 78360077
Faked up EXPNUM 78360077
Faked up EXPNUM 78360077
Faked up EXPNUM 78330082
Faked up EXPNUM 78330082
Faked up EXPNUM 78330082
90prime get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1773 1909 and amp range 0 2015 and image y 335 472 and amp range 0 2047
Range in image: x 0 137 , y 0 138 (with image size 137 x 138)
dzp 0.005335051 -> scaling image by 1.0049258559887364
Faked up EXPNUM 74590059
Faked up EXPNUM 74590059
Faked up EXPNUM 74590059
90prime get_fwhm: self.fwhm = 4.71
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1741 1877 and amp range 0 2015 and image y 305 442 and amp range 0 2047
Range in image: x 0 137 , y 0 138 (with image size 137 x 138)
dzp -0.008523628 -> scaling image by 0.992180183483648
Faked up EXPNUM 78440036
Faked up EXPNUM 78440036
Faked up EXPNUM 78440036
90prime get_fwhm: self.fwhm = 5.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2065 2199 and amp range 2016 4031 and image y 15 97 and amp range 0 2047
Range in image: x 0 135 , y 0 83 (with image size 135 x 83)
dzp -0.0023383768 -> scaling image by 0.9978485929508539
Stage tims : Wall: 8.22 s, CPU: 1.00 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.56658 MB
Stage tims finished: 2020-06-07T19:10:50.653893
Resources for stage tims : 3.652 s worker CPU, 21.033 s worker Wall, Wall: 8.220 s, Cores in use: 0.57, Total efficiency (on 4 cores): 14.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/PGC2308662-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/PGC2308662-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T19:10:50.677179
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01552.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01665.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01442.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01551.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/metrics/cus/reference-custom-128441p48006.fits
Stage refs : Wall: 2.58 s, CPU: 1.97 s, VmPeak: 972 MB, VmSize: 959 MB, VmRSS: 188 MB, VmData: 221 MB, maxrss: 0.56658 MB
Stage refs finished: 2020-06-07T19:10:53.258662
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.582 s, Cores in use: 0.76, Total efficiency (on 4 cores): 19.0 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T19:10:53.260339
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/metrics/cus/outlier-mask-custom-128441p48006.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/metrics/cus/outliers-pre-custom-128441p48006.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/metrics/cus/outlier-mask-custom-128441p48006.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/metrics/cus/outliers-post-custom-128441p48006.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/metrics/cus/outliers-masked-pos-custom-128441p48006.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/metrics/cus/outliers-masked-neg-custom-128441p48006.jpg
Stage outliers : Wall: 0.78 s, CPU: 0.60 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 199 MB, VmData: 230 MB, maxrss: 0.56658 MB
Stage outliers finished: 2020-06-07T19:10:54.038944
Resources for stage outliers : 0.622 s worker CPU, 0.626 s worker Wall, Wall: 0.780 s, Cores in use: 1.56, Total efficiency (on 4 cores): 39.1 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T19:10:54.040942
Stage halos : Wall: 0.34 s, CPU: 0.32 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 199 MB, VmData: 230 MB, maxrss: 0.56658 MB
Stage halos finished: 2020-06-07T19:10:54.376232
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.337 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T19:10:54.378452
PSF sigmas in coadd pixels: ['3.97', '2.29', '3.47', '2.41']
Using average PSF sigma 3.0334175652685706
Gaussian PSF norm 0.0929957006261689 vs pixelized 0.07906939
average tim pixel scale / coadd scale: 1.730216316699285
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.67', '2.22', '3.85']
Using average PSF sigma 2.9121185679889474
Gaussian PSF norm 0.09686926723203011 vs pixelized 0.09078851
average tim pixel scale / coadd scale: 1.7295749271501792
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.71', '1.94', '1.62', '2.62']
Using average PSF sigma 1.9712166545887162
Gaussian PSF norm 0.14310694418962067 vs pixelized 0.12786095
average tim pixel scale / coadd scale: 0.9908869433552666
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.16 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.56658 MB
Stage fit_on_coadds finished: 2020-06-07T19:10:54.573765
Resources for stage fit_on_coadds : 0.145 s worker CPU, 0.146 s worker Wall, Wall: 0.197 s, Cores in use: 1.54, Total efficiency (on 4 cores): 38.4 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T19:10:54.577121
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 6 potential peaks
Of 6 potential peaks: 1 in veto map, 0 cut by saddle test, 0 cut by aper test, 5 kept
SED z : 5 new peaks
Found 9 potential peaks
Of 9 potential peaks: 7 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 5 potential peaks
Of 5 potential peaks: 5 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 12 potential peaks
Of 12 potential peaks: 8 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 10 potential peaks
Of 10 potential peaks: 7 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 9 new sources
Median coadd sky for g : 9.279174e-05
Median coadd sky for r : 0.00032316573
Median coadd sky for z : 0.00021559687
Stage srcs : Wall: 0.51 s, CPU: 0.47 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.56658 MB
Stage srcs finished: 2020-06-07T19:10:55.091360
Resources for stage srcs : 0.098 s worker CPU, 0.107 s worker Wall, Wall: 0.515 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/PGC2308662-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/PGC2308662-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T19:10:55.103678
Blob 1 of 9, id: 3, sources: 2, size: 88x105, npix 5413, brick X: 80,168, Y: 64,169, one pixel: 124 64
Blob 2 of 9, id: 6, sources: 1, size: 34x37, npix 804, brick X: 194,228, Y: 173,210, one pixel: 212 173
Blob 3 of 9, id: 4, sources: 1, size: 36x34, npix 776, brick X: 36,72, Y: 112,146, one pixel: 51 112
Blob 4 of 9, id: 2, sources: 1, size: 33x29, npix 665, brick X: 73,106, Y: 52,81, one pixel: 86 52
Blob 5 of 9, id: 1, sources: 1, size: 32x28, npix 649, brick X: 199,231, Y: 45,73, one pixel: 211 45
Blob 3 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139712 MB
Blob 6 of 9, id: 0, sources: 1, size: 20x19, npix 218, brick X: 156,176, Y: 22,41, one pixel: 164 22
Blob 7 of 9, id: 7, sources: 1, size: 19x19, npix 199, brick X: 82,101, Y: 179,198, one pixel: 90 179
Blob 4 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14162 MB
Blob 8 of 9, id: 5, sources: 1, size: 19x18, npix 189, brick X: 149,168, Y: 136,154, one pixel: 157 136
Blob 6 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14162 MB
Blob 9 of 9, id: 8, sources: 1, size: 18x19, npix 180, brick X: 114,132, Y: 196,215, one pixel: 123 196
Blob 7 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14162 MB
Blob 2 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141724 MB
Blob 9 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141724 MB
Blob 8 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14162 MB
Blob 5 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141652 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.16007, ee1=0.829568, ee2=0.272878
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 2.81 s, CPU: 2.81 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1431 MB
Old catalog: 14
New catalog: 8
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/metrics/cus/blobs-custom-128441p48006.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/metrics/cus/all-models-custom-128441p48006.fits
Stage fitblobs : Wall: 3.10 s, CPU: 0.28 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.56658 MB
Stage fitblobs finished: 2020-06-07T19:10:58.206461
Resources for stage fitblobs : 6.662 s worker CPU, 6.695 s worker Wall, Wall: 3.104 s, Cores in use: 2.24, Total efficiency (on 4 cores): 56.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T19:10:58.208271
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/tmp-legacysurvey-custom-128441p48006-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/tmp-legacysurvey-custom-128441p48006-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/tmp-legacysurvey-custom-128441p48006-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/tmp-legacysurvey-custom-128441p48006-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-resid.jpg
Stage coadds : Wall: 1.06 s, CPU: 0.47 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.56658 MB
Stage coadds finished: 2020-06-07T19:10:59.266089
Resources for stage coadds : 1.696 s worker CPU, 1.781 s worker Wall, Wall: 1.059 s, Cores in use: 2.04, Total efficiency (on 4 cores): 51.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T19:10:59.267739
Cut to 1 unWISE tiles
Reading WISE tile 1282p484 band 1
Reading WISE tile 1282p484 band 2
Reading WISE tile 1282p484 band 4
Reading WISE tile 1282p484 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 793 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.188388 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 805 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.20444 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 788 MB, VmRSS: 142 MB, VmData: 169 MB, maxrss: 0.204652 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1282p484/unwise-1282p484-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208256 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/tmp-legacysurvey-custom-128441p48006-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/tmp-legacysurvey-custom-128441p48006-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.34 s, CPU: 0.41 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 204 MB, VmData: 231 MB, maxrss: 0.56658 MB
Stage wise_forced finished: 2020-06-07T19:11:01.605539
Resources for stage wise_forced : 4.965 s worker CPU, 6.053 s worker Wall, Wall: 2.339 s, Cores in use: 2.30, Total efficiency (on 4 cores): 57.5 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T19:11:01.607291
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/coadd/cus/custom-128441p48006/legacysurvey-custom-128441p48006-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/tractor-i/cus/tractor-custom-128441p48006.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/tractor/cus/tractor-custom-128441p48006.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2308662/tractor/cus/brick-custom-128441p48006.sha256sum
Stage writecat : Wall: 0.95 s, CPU: 0.52 s, VmPeak: 1101 MB, VmSize: 973 MB, VmRSS: 206 MB, VmData: 231 MB, maxrss: 0.56658 MB
Stage writecat finished: 2020-06-07T19:11:02.553178
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.947 s, Cores in use: 0.55, Total efficiency (on 4 cores): 13.8 %
Stage writecat finished
All done: 17.841 s worker CPU, 36.443 s worker Wall, Wall: 20.123 s, Cores in use: 1.20, Total efficiency (on 4 cores): 29.9 %
Finished galaxy PGC2308662 in 0.386 minutes.