Started working on galaxy PGC2605319 at Sun Jun  7 17:24:45 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.9719065 60.6748407 --width 263 --height 263 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/PGC2605319-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/PGC2605319-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:24:47.185773
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.9719065', '60.6748407', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/PGC2605319-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/PGC2605319-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.9719065 60.6748407 --width 263 --height 263 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/PGC2605319-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/PGC2605319-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 167.9719065 60.6748407
Starting process 50487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 50488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 50489 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057404 MB
Starting process 50490 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:24:47.965496
Keeping 9 CCDs:
   k4m_171118_111243_ooi_zd_ls9.fits.fz k4m_171118_111243_ooi_zd_ls9-CCD4 z exptime 113.105 propid 2016A-0453 seeing 1.09 MJD 58075.467 object MzLS_688121_z
   k4m_170310_085026_ooi_zd_ls9.fits.fz k4m_170310_085026_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 0.93 MJD 57822.368 object MzLS_689358_z
   k4m_170502_042450_ooi_zd_ls9.fits.fz k4m_170502_042450_ooi_zd_ls9-CCD1 z exptime 92.105 propid 2016A-0453 seeing 1.07 MJD 57875.184 object MzLS_688742_z
   ksb_180225_082953_ooi_r_ls9.fits.fz ksb_180225_082953_ooi_r_ls9-CCD2 r exptime 224.49 propid BASS seeing 1.25 MJD 58174.354 object 38243
   ksb_180324_095742_ooi_g_ls9.fits.fz ksb_180324_095742_ooi_g_ls9-CCD2 g exptime 170.0 propid BASS seeing 1.48 MJD 58201.415 object 38243
   ksb_170325_072556_ooi_r_ls9.fits.fz ksb_170325_072556_ooi_r_ls9-CCD1 r exptime 91.078 propid BASS seeing 2.61 MJD 57837.310 object 37272
   ksb_170301_084342_ooi_g_ls9.fits.fz ksb_170301_084342_ooi_g_ls9-CCD1 g exptime 84.42 propid BASS seeing 1.46 MJD 57813.364 object 37272
   ksb_180508_042521_ooi_r_ls9.fits.fz ksb_180508_042521_ooi_r_ls9-CCD2 r exptime 71.528 propid NOTBASS seeing 1.31 MJD 58246.184 object 38241
   ksb_170225_101139_ooi_g_ls9.fits.fz ksb_170225_101139_ooi_g_ls9-CCD2 g exptime 122.3 propid BASS seeing 1.66 MJD 57809.425 object 38241
mosaic get_fwhm: self.fwhm = 4.11
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3481 3747 and amp range 2006 4053 and image y 1651 1919 and amp range 0 2039
Range in image: x 0 267 , y 0 269 (with image size 267 x 269)
dzp 0.000620604 -> scaling image by 1.0005717608254892
mosaic get_fwhm: self.fwhm = 3.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 747 1016 and amp range 0 2005 and image y 1951 2221 and amp range 0 2039
Range in image: x 0 270 , y 0 89 (with image size 270 x 271)
dzp 0.007397243 -> scaling image by 1.006836374469654
Found overlap: image x 747 1016 and amp range 0 2005 and image y 1951 2221 and amp range 2040 4078
Range in image: x 0 270 , y 89 271 (with image size 270 x 271)
dzp 0.032569118 -> scaling image by 1.0304517167935139
Faked up EXPNUM 81740114
Faked up EXPNUM 81740114
Faked up EXPNUM 81740114
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 389 543 and amp range 0 2015 and image y 844 1000 and amp range 0 2047
Range in image: x 0 155 , y 0 157 (with image size 155 x 157)
dzp -0.003875085 -> scaling image by 0.9964372765054066
mosaic get_fwhm: self.fwhm = 4.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1893 2160 and amp range 0 2047 and image y 1036 1301 and amp range 0 2021
Range in image: x 0 155 , y 0 266 (with image size 268 x 266)
dzp -0.029266886 -> scaling image by 0.9734042664541822
Found overlap: image x 1893 2160 and amp range 2048 4095 and image y 1036 1301 and amp range 0 2021
Range in image: x 155 268 , y 0 266 (with image size 268 x 266)
dzp -0.029506588 -> scaling image by 0.9731893881648719
Faked up EXPNUM 78370125
Faked up EXPNUM 78370125
Faked up EXPNUM 78370125
90prime get_fwhm: self.fwhm = 5.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 621 777 and amp range 0 2015 and image y 1453 1608 and amp range 0 2047
Range in image: x 0 157 , y 0 156 (with image size 157 x 156)
dzp -0.024106435 -> scaling image by 0.9780418215011345
Faked up EXPNUM 82010067
Faked up EXPNUM 82010067
Faked up EXPNUM 82010067
90prime get_fwhm: self.fwhm = 3.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 412 567 and amp range 0 2015 and image y 834 990 and amp range 0 2047
Range in image: x 0 156 , y 0 157 (with image size 156 x 157)
dzp -0.0036920775 -> scaling image by 0.9966052462302274
Faked up EXPNUM 78130058
Faked up EXPNUM 78130058
Faked up EXPNUM 78130058
90prime get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 625 781 and amp range 0 2015 and image y 1453 1608 and amp range 0 2047
Range in image: x 0 157 , y 0 156 (with image size 157 x 156)
dzp -0.023075538 -> scaling image by 0.9789709052881876
Faked up EXPNUM 78090188
Faked up EXPNUM 78090188
Faked up EXPNUM 78090188
90prime get_fwhm: self.fwhm = 3.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2449 2602 and amp range 2016 4031 and image y 2810 2964 and amp range 2048 4095
Range in image: x 0 154 , y 0 155 (with image size 154 x 155)
dzp 0.010008041 -> scaling image by 1.0092603604948323
Faked up EXPNUM 82460052
Faked up EXPNUM 82460052
Faked up EXPNUM 82460052
90prime get_fwhm: self.fwhm = 2.89
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2431 2585 and amp range 2016 4031 and image y 2803 2958 and amp range 2048 4095
Range in image: x 0 155 , y 0 156 (with image size 155 x 156)
dzp 0.019008487 -> scaling image by 1.0176616178968958
Stage tims : Wall: 6.50 s, CPU: 1.15 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.568328 MB
Stage tims finished: 2020-06-07T17:24:54.464151
Resources for stage tims : 3.446 s worker CPU, 15.327 s worker Wall, Wall: 6.500 s, Cores in use: 0.71, Total efficiency (on 4 cores): 17.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/PGC2605319-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/PGC2605319-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:24:54.536251
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00797.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00719.fits
Matched 14 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/metrics/cus/reference-custom-167971p60674.fits
Stage refs : Wall: 1.86 s, CPU: 1.53 s, VmPeak: 972 MB, VmSize: 954 MB, VmRSS: 184 MB, VmData: 217 MB, maxrss: 0.568328 MB
Stage refs finished: 2020-06-07T17:24:56.395333
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.860 s, Cores in use: 0.82, Total efficiency (on 4 cores): 20.5 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:24:56.396868
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/metrics/cus/outlier-mask-custom-167971p60674.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/metrics/cus/outliers-pre-custom-167971p60674.jpg
Image ksb_180324_095742_ooi_g_ls9-CCD2 g : masking 116 positive outlier pixels and 0 negative outlier pixels
Image ksb_180225_082953_ooi_r_ls9-CCD2 r : masking 147 positive outlier pixels and 0 negative outlier pixels
Image k4m_170310_085026_ooi_zd_ls9-CCD1 z : masking 587 positive outlier pixels and 0 negative outlier pixels
Image k4m_171118_111243_ooi_zd_ls9-CCD4 z : masking 249 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/metrics/cus/outlier-mask-custom-167971p60674.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/metrics/cus/outliers-post-custom-167971p60674.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/metrics/cus/outliers-masked-pos-custom-167971p60674.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/metrics/cus/outliers-masked-neg-custom-167971p60674.jpg
Stage outliers : Wall: 1.15 s, CPU: 0.80 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 199 MB, VmData: 229 MB, maxrss: 0.568328 MB
Stage outliers finished: 2020-06-07T17:24:57.548259
Resources for stage outliers : 0.856 s worker CPU, 0.865 s worker Wall, Wall: 1.153 s, Cores in use: 1.44, Total efficiency (on 4 cores): 35.9 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:24:57.550093
Stage halos : Wall: 0.57 s, CPU: 0.54 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 199 MB, VmData: 229 MB, maxrss: 0.568328 MB
Stage halos finished: 2020-06-07T17:24:58.115466
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.566 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T17:24:58.117294
PSF sigmas in coadd pixels: ['2.41', '2.38', '2.70']
Using average PSF sigma 2.496164294258165
Gaussian PSF norm 0.11301130795868301 vs pixelized 0.097385846
average tim pixel scale / coadd scale: 1.7303673955718524
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.03', '4.25', '2.13']
Using average PSF sigma 2.799959862370374
Gaussian PSF norm 0.1007495841512042 vs pixelized 0.093727715
average tim pixel scale / coadd scale: 1.7302788843806007
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.78', '1.51', '1.73']
Using average PSF sigma 1.6740360833866512
Gaussian PSF norm 0.16851177496914377 vs pixelized 0.1510884
average tim pixel scale / coadd scale: 0.9909253087577247
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.28 s, CPU: 0.18 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.568328 MB
Stage fit_on_coadds finished: 2020-06-07T17:24:58.395853
Resources for stage fit_on_coadds : 0.174 s worker CPU, 0.182 s worker Wall, Wall: 0.280 s, Cores in use: 1.27, Total efficiency (on 4 cores): 31.6 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:24:58.398804
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 24 potential peaks
Of 24 potential peaks: 5 in veto map, 3 cut by saddle test, 0 cut by aper test, 16 kept
SED z : 16 new peaks
Found 76 potential peaks
Of 76 potential peaks: 67 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 82 potential peaks
Of 82 potential peaks: 71 in veto map, 5 cut by saddle test, 1 cut by aper test, 5 kept
SED g : 5 new peaks
Found 128 potential peaks
Of 128 potential peaks: 113 in veto map, 8 cut by saddle test, 1 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 146 potential peaks
Of 146 potential peaks: 137 in veto map, 7 cut by saddle test, 1 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 30 new sources
Median coadd sky for g : 0.0005591734
Median coadd sky for r : 0.0011930438
Median coadd sky for z : 0.00015149068
Stage srcs : Wall: 0.93 s, CPU: 0.86 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.568328 MB
Stage srcs finished: 2020-06-07T17:24:59.330969
Resources for stage srcs : 0.119 s worker CPU, 0.119 s worker Wall, Wall: 0.933 s, Cores in use: 1.05, Total efficiency (on 4 cores): 26.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/PGC2605319-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/PGC2605319-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:24:59.344417
Blob 1 of 12, id: 4, sources: 18, size: 248x238, npix 33783, brick X: 3,251, Y: 25,263, one pixel: 179 25
Blob 2 of 12, id: 10, sources: 2, size: 56x34, npix 956, brick X: 207,263, Y: 188,222, one pixel: 234 188
Blob 3 of 12, id: 5, sources: 2, size: 49x33, npix 946, brick X: 43,92, Y: 35,68, one pixel: 58 35
Blob 4 of 12, id: 3, sources: 1, size: 32x25, npix 568, brick X: 99,131, Y: 6,31, one pixel: 108 6
Blob 5 of 12, id: 6, sources: 2, size: 37x29, npix 563, brick X: 7,44, Y: 72,101, one pixel: 18 72
Blob 4 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141028 MB
Blob 6 of 12, id: 1, sources: 1, size: 31x22, npix 487, brick X: 161,192, Y: 0,22, one pixel: 167 0
Blob 5 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141028 MB
Blob 7 of 12, id: 8, sources: 1, size: 24x23, npix 370, brick X: 238,262, Y: 98,121, one pixel: 248 98
Blob 2 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142996 MB
Blob 8 of 12, id: 0, sources: 1, size: 25x21, npix 358, brick X: 9,34, Y: 0,21, one pixel: 16 0
Blob 9 of 12, id: 9, sources: 1, size: 16x30, npix 352, brick X: 0,16, Y: 125,155, one pixel: 4 125
Blob 7 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142996 MB
Blob 10 of 12, id: 11, sources: 1, size: 17x24, npix 261, brick X: 0,17, Y: 205,229, one pixel: 6 205
Blob 3 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141196 MB
Blob 11 of 12, id: 7, sources: 1, size: 17x18, npix 178, brick X: 246,263, Y: 80,98, one pixel: 254 80
Blob 9 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141196 MB
Blob 12 of 12, id: 2, sources: 1, size: 19x14, npix 173, brick X: 236,255, Y: 0,14, one pixel: 239 0
Blob 10 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141196 MB
Blob 11 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141196 MB
Blob 8 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142996 MB
Blob 12 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141196 MB
Blob 6 finished, total: Wall: 1.78 s, CPU: 1.78 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143144 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.97978, 60.69183), pm (-27.5, 1.5), parallax 3.455 with NanoMaggies: g=11.2, r=10.7, z=10.6
Reset brightness to NanoMaggies: g=11.2, r=10.7, z=10.6
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.702392, ee1=0.204212, ee2=0.331648
Measuring 4 iterative sources
Blob 1 finished, total: Wall: 22.46 s, CPU: 22.45 s, VmPeak: 805 MB, VmSize: 712 MB, VmRSS: 146 MB, VmData: 178 MB, maxrss: 0.167096 MB
Old catalog: 32
New catalog: 30
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/metrics/cus/blobs-custom-167971p60674.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/metrics/cus/all-models-custom-167971p60674.fits
Stage fitblobs : Wall: 23.05 s, CPU: 0.56 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 202 MB, VmData: 229 MB, maxrss: 0.568328 MB
Stage fitblobs finished: 2020-06-07T17:25:22.396848
Resources for stage fitblobs : 28.475 s worker CPU, 28.563 s worker Wall, Wall: 23.054 s, Cores in use: 1.26, Total efficiency (on 4 cores): 31.5 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:25:22.399026
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/tmp-legacysurvey-custom-167971p60674-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/tmp-legacysurvey-custom-167971p60674-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/tmp-legacysurvey-custom-167971p60674-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/tmp-legacysurvey-custom-167971p60674-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-resid.jpg
Stage coadds : Wall: 1.53 s, CPU: 0.77 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 202 MB, VmData: 229 MB, maxrss: 0.568328 MB
Stage coadds finished: 2020-06-07T17:25:23.928335
Resources for stage coadds : 2.181 s worker CPU, 2.288 s worker Wall, Wall: 1.530 s, Cores in use: 1.93, Total efficiency (on 4 cores): 48.3 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:25:23.930012
Cut to 1 unWISE tiles
Reading WISE tile 1680p605 band 2
Reading WISE tile 1680p605 band 4
Reading WISE tile 1680p605 band 1
Reading WISE tile 1680p605 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 803 MB, VmSize: 794 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.188472 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 805 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.205044 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209028 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1680p605/unwise-1680p605-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 797 MB, VmRSS: 154 MB, VmData: 179 MB, maxrss: 0.218868 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/tmp-legacysurvey-custom-167971p60674-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/tmp-legacysurvey-custom-167971p60674-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.41 s, CPU: 0.49 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 203 MB, VmData: 229 MB, maxrss: 0.568328 MB
Stage wise_forced finished: 2020-06-07T17:25:26.335832
Resources for stage wise_forced : 4.757 s worker CPU, 5.848 s worker Wall, Wall: 2.407 s, Cores in use: 2.18, Total efficiency (on 4 cores): 54.5 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:25:26.337744
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/coadd/cus/custom-167971p60674/legacysurvey-custom-167971p60674-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/tractor-i/cus/tractor-custom-167971p60674.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/tractor/cus/tractor-custom-167971p60674.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2605319/tractor/cus/brick-custom-167971p60674.sha256sum
Stage writecat : Wall: 0.90 s, CPU: 0.64 s, VmPeak: 1095 MB, VmSize: 967 MB, VmRSS: 205 MB, VmData: 229 MB, maxrss: 0.568328 MB
Stage writecat finished: 2020-06-07T17:25:27.238044
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.901 s, Cores in use: 0.71, Total efficiency (on 4 cores): 17.9 %
Stage writecat finished
All done: 40.008 s worker CPU, 53.196 s worker Wall, Wall: 39.278 s, Cores in use: 1.21, Total efficiency (on 4 cores): 30.3 %
Finished galaxy PGC2605319 in 0.710 minutes.