Started working on galaxy PGC2339531 at Sun Jun  7 20:12:38 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.0887505 49.31619439999999 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/PGC2339531-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/PGC2339531-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T20:12:39.461736
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.0887505', '49.31619439999999', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/PGC2339531-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/PGC2339531-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.0887505 49.31619439999999 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/PGC2339531-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/PGC2339531-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 273.0887505 49.31619439999999
Starting process 54031 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057368 MB
Starting process 54033 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057368 MB
Starting process 54035 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057396 MB
Starting process 54037 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T20:12:39.823361
Keeping 9 CCDs:
   k4m_170809_083842_ooi_zd_ls9.fits.fz k4m_170809_083842_ooi_zd_ls9-CCD3 z exptime 131.105 propid 2016A-0453 seeing 0.83 MJD 57974.360 object MzLS_647074_z
   k4m_160516_101242_ooi_zd_ls9.fits.fz k4m_160516_101242_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.03 MJD 57524.425 object MzLS_647892_z
   k4m_160523_092509_ooi_zd_ls9.fits.fz k4m_160523_092509_ooi_zd_ls9-CCD4 z exptime 92.103 propid 2016A-0453 seeing 0.90 MJD 57531.392 object MzLS_646255_z
   ksb_160611_102411_ooi_r_ls9.fits.fz ksb_160611_102411_ooi_r_ls9-CCD3 r exptime 62.9 propid BASS seeing 1.09 MJD 57550.433 object 26031
   ksb_170527_092107_ooi_g_ls9.fits.fz ksb_170527_092107_ooi_g_ls9-CCD3 g exptime 108.36 propid 2015A-0801 seeing 1.27 MJD 57900.390 object 26031
   ksb_170619_055629_ooi_g_ls9.fits.fz ksb_170619_055629_ooi_g_ls9-CCD4 g exptime 165.533 propid BASS seeing 2.27 MJD 57923.248 object 27193
   ksb_180518_104320_ooi_r_ls9.fits.fz ksb_180518_104320_ooi_r_ls9-CCD4 r exptime 80.377 propid NOTBASS seeing 1.21 MJD 58256.447 object 27193
   ksb_160612_104353_ooi_r_ls9.fits.fz ksb_160612_104353_ooi_r_ls9-CCD1 r exptime 84.1 propid BASS seeing 1.45 MJD 57551.447 object 26022
   ksb_160706_095707_ooi_g_ls9.fits.fz ksb_160706_095707_ooi_g_ls9-CCD1 g exptime 176.8 propid BASS seeing 2.08 MJD 57575.415 object 26022
mosaic get_fwhm: self.fwhm = 3.95
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 456 721 and amp range 0 2005 and image y 2238 2500 and amp range 2040 4078
Range in image: x 0 266 , y 0 263 (with image size 266 x 263)
dzp -0.005990375 -> scaling image by 0.994497853444703
mosaic get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3179 3439 and amp range 2006 4053 and image y 2351 2614 and amp range 2040 4078
Range in image: x 0 261 , y 0 264 (with image size 261 x 264)
dzp 0.0056365696 -> scaling image by 1.005204971477435
Faked up EXPNUM 75500170
Faked up EXPNUM 75500170
Faked up EXPNUM 75500170
90prime get_fwhm: self.fwhm = 2.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1541 1691 and amp range 0 2015 and image y 2301 2451 and amp range 2048 4095
Range in image: x 0 151 , y 0 151 (with image size 151 x 151)
dzp -0.011545347 -> scaling image by 0.9894226798649194
mosaic get_fwhm: self.fwhm = 3.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1611 1871 and amp range 0 2047 and image y 378 636 and amp range 0 2021
Range in image: x 0 261 , y 0 259 (with image size 261 x 259)
dzp 0.005139143 -> scaling image by 1.0047445456970268
Faked up EXPNUM 79000148
Faked up EXPNUM 79000148
Faked up EXPNUM 79000148
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1543 1693 and amp range 0 2015 and image y 2301 2450 and amp range 2048 4095
Range in image: x 0 151 , y 0 150 (with image size 151 x 150)
dzp -0.045992933 -> scaling image by 0.958523636456738
Faked up EXPNUM 82560206
Faked up EXPNUM 82560206
Faked up EXPNUM 82560206
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3320 3471 and amp range 2016 4031 and image y 164 314 and amp range 0 2047
Range in image: x 0 152 , y 0 151 (with image size 152 x 151)
dzp 0.043530058 -> scaling image by 1.0409072255640852
Faked up EXPNUM 79230081
Faked up EXPNUM 79230081
Faked up EXPNUM 79230081
90prime get_fwhm: self.fwhm = 5.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3325 3476 and amp range 2016 4031 and image y 179 329 and amp range 0 2047
Range in image: x 0 152 , y 0 151 (with image size 152 x 151)
dzp 0.016679538 -> scaling image by 1.0154810312115594
Faked up EXPNUM 75510130
Faked up EXPNUM 75510130
Faked up EXPNUM 75510130
90prime get_fwhm: self.fwhm = 3.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3457 3608 and amp range 2016 4031 and image y 773 925 and amp range 0 2047
Range in image: x 0 152 , y 0 153 (with image size 152 x 153)
dzp -0.0041296566 -> scaling image by 0.9962036700684744
Faked up EXPNUM 75750118
Faked up EXPNUM 75750118
Faked up EXPNUM 75750118
90prime get_fwhm: self.fwhm = 4.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3462 3614 and amp range 2016 4031 and image y 784 936 and amp range 0 2047
Range in image: x 0 153 , y 0 153 (with image size 153 x 153)
dzp -0.0032519526 -> scaling image by 0.9970093219958882
Stage tims : Wall: 3.91 s, CPU: 0.81 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.566604 MB
Stage tims finished: 2020-06-07T20:12:43.728594
Resources for stage tims : 3.506 s worker CPU, 9.863 s worker Wall, Wall: 3.906 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/PGC2339531-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/PGC2339531-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T20:12:43.748395
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01485.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01378.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01597.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01486.fits
Matched 6 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/metrics/cus/reference-custom-273088p49316.fits
Stage refs : Wall: 4.77 s, CPU: 4.42 s, VmPeak: 1001 MB, VmSize: 995 MB, VmRSS: 227 MB, VmData: 258 MB, maxrss: 0.566604 MB
Stage refs finished: 2020-06-07T20:12:48.514637
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.767 s, Cores in use: 0.93, Total efficiency (on 4 cores): 23.2 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T20:12:48.516253
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/metrics/cus/outlier-mask-custom-273088p49316.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/metrics/cus/outliers-pre-custom-273088p49316.jpg
Image ksb_160706_095707_ooi_g_ls9-CCD1 g : masking 1622 positive outlier pixels and 0 negative outlier pixels
Image ksb_170527_092107_ooi_g_ls9-CCD3 g : masking 0 positive outlier pixels and 94 negative outlier pixels
Image ksb_160611_102411_ooi_r_ls9-CCD3 r : masking 178 positive outlier pixels and 0 negative outlier pixels
Image k4m_160516_101242_ooi_zd_ls9-CCD1 z : masking 1584 positive outlier pixels and 0 negative outlier pixels
Image k4m_170809_083842_ooi_zd_ls9-CCD3 z : masking 0 positive outlier pixels and 249 negative outlier pixels
Image k4m_160523_092509_ooi_zd_ls9-CCD4 z : masking 570 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/metrics/cus/outlier-mask-custom-273088p49316.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/metrics/cus/outliers-post-custom-273088p49316.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/metrics/cus/outliers-masked-pos-custom-273088p49316.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/metrics/cus/outliers-masked-neg-custom-273088p49316.jpg
Stage outliers : Wall: 0.78 s, CPU: 0.50 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 238 MB, VmData: 268 MB, maxrss: 0.566604 MB
Stage outliers finished: 2020-06-07T20:12:49.295928
Resources for stage outliers : 1.008 s worker CPU, 1.017 s worker Wall, Wall: 0.781 s, Cores in use: 1.93, Total efficiency (on 4 cores): 48.3 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T20:12:49.297647
Stage halos : Wall: 0.13 s, CPU: 0.12 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 238 MB, VmData: 268 MB, maxrss: 0.566604 MB
Stage halos finished: 2020-06-07T20:12:49.425268
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.129 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.7 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T20:12:49.426940
PSF sigmas in coadd pixels: ['2.07', '3.69', '3.38']
Using average PSF sigma 3.0439439195051468
Gaussian PSF norm 0.09267410939020791 vs pixelized 0.06490363
average tim pixel scale / coadd scale: 1.7292464093326498
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.77', '1.97', '2.36']
Using average PSF sigma 2.033910064965747
Gaussian PSF norm 0.138695804024466 vs pixelized 0.1140329
average tim pixel scale / coadd scale: 1.7297248896353572
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.35', '1.67', '1.45']
Using average PSF sigma 1.4885033078939676
Gaussian PSF norm 0.18951573051792842 vs pixelized 0.15295166
average tim pixel scale / coadd scale: 0.9909282413574347
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.19 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 241 MB, VmData: 270 MB, maxrss: 0.566604 MB
Stage fit_on_coadds finished: 2020-06-07T20:12:49.638228
Resources for stage fit_on_coadds : 0.235 s worker CPU, 0.255 s worker Wall, Wall: 0.212 s, Cores in use: 2.00, Total efficiency (on 4 cores): 49.9 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T20:12:49.640996
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 40 potential peaks
Of 40 potential peaks: 15 in veto map, 4 cut by saddle test, 0 cut by aper test, 21 kept
SED z : 21 new peaks
Found 53 potential peaks
Of 53 potential peaks: 41 in veto map, 9 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 26 potential peaks
Of 26 potential peaks: 20 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 57 potential peaks
Of 57 potential peaks: 52 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 60 potential peaks
Of 60 potential peaks: 51 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 26 new sources
Median coadd sky for g : 0.00032820305
Median coadd sky for r : 0.0005844476
Median coadd sky for z : 0.0001923609
Stage srcs : Wall: 0.59 s, CPU: 0.54 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 241 MB, VmData: 270 MB, maxrss: 0.566604 MB
Stage srcs finished: 2020-06-07T20:12:50.235878
Resources for stage srcs : 0.145 s worker CPU, 0.146 s worker Wall, Wall: 0.596 s, Cores in use: 1.15, Total efficiency (on 4 cores): 28.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/PGC2339531-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/PGC2339531-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T20:12:50.248954
Blob 1 of 10, id: 5, sources: 20, size: 174x221, npix 25663, brick X: 22,196, Y: 36,257, one pixel: 156 36
Blob 2 of 10, id: 0, sources: 2, size: 53x65, npix 2509, brick X: 0,53, Y: 0,65, one pixel: 15 0
Blob 3 of 10, id: 7, sources: 2, size: 44x34, npix 852, brick X: 211,255, Y: 126,160, one pixel: 238 126
Blob 4 of 10, id: 8, sources: 1, size: 25x39, npix 728, brick X: 0,25, Y: 143,182, one pixel: 4 143
Blob 5 of 10, id: 6, sources: 1, size: 32x28, npix 610, brick X: 220,252, Y: 89,117, one pixel: 231 89
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 807 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14084 MB
Blob 6 of 10, id: 3, sources: 1, size: 26x31, npix 558, brick X: 231,257, Y: 17,48, one pixel: 244 17
Blob 2 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1426 MB
Blob 7 of 10, id: 1, sources: 1, size: 30x17, npix 372, brick X: 166,196, Y: 0,17, one pixel: 169 0
Blob 8 of 10, id: 4, sources: 1, size: 25x22, npix 348, brick X: 73,98, Y: 21,43, one pixel: 82 21
Blob 3 finished, total: Wall: 1.43 s, CPU: 1.43 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142436 MB
Blob 9 of 10, id: 2, sources: 1, size: 21x24, npix 311, brick X: 120,141, Y: 15,39, one pixel: 130 15
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 807 MB, VmSize: 712 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142944 MB
Blob 10 of 10, id: 9, sources: 1, size: 22x19, npix 255, brick X: 42,64, Y: 238,257, one pixel: 53 238
Blob 7 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142436 MB
Blob 8 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 807 MB, VmSize: 712 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142944 MB
Blob 10 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 807 MB, VmSize: 712 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142944 MB
Blob 9 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142436 MB
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 2.01 s, CPU: 2.01 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143572 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.348867, ee1=0.188968, ee2=0.0161902
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.09342, 49.32926), pm (-5.9, -18.5), parallax 1.336 with NanoMaggies: g=19.6, r=18.1, z=17.1
Reset brightness to NanoMaggies: g=19.6, r=18.1, z=17.1
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 16.10 s, CPU: 16.10 s, VmPeak: 813 MB, VmSize: 717 MB, VmRSS: 150 MB, VmData: 183 MB, maxrss: 0.153924 MB
Old catalog: 35
New catalog: 33
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/metrics/cus/blobs-custom-273088p49316.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/metrics/cus/all-models-custom-273088p49316.fits
Stage fitblobs : Wall: 16.46 s, CPU: 0.30 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 241 MB, VmData: 270 MB, maxrss: 0.566604 MB
Stage fitblobs finished: 2020-06-07T20:13:06.712219
Resources for stage fitblobs : 24.979 s worker CPU, 24.999 s worker Wall, Wall: 16.465 s, Cores in use: 1.54, Total efficiency (on 4 cores): 38.4 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T20:13:06.714265
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/tmp-legacysurvey-custom-273088p49316-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/tmp-legacysurvey-custom-273088p49316-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/tmp-legacysurvey-custom-273088p49316-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/tmp-legacysurvey-custom-273088p49316-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-resid.jpg
Stage coadds : Wall: 1.15 s, CPU: 0.47 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 242 MB, VmData: 270 MB, maxrss: 0.566604 MB
Stage coadds finished: 2020-06-07T20:13:07.867268
Resources for stage coadds : 2.171 s worker CPU, 2.247 s worker Wall, Wall: 1.154 s, Cores in use: 2.29, Total efficiency (on 4 cores): 57.3 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T20:13:07.869182
Cut to 1 unWISE tiles
Reading WISE tile 2740p499 band 1
Reading WISE tile 2740p499 band 4
Reading WISE tile 2740p499 band 2
Reading WISE tile 2740p499 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.09 s, VmPeak: 807 MB, VmSize: 795 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.188252 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 813 MB, VmSize: 792 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.213804 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 807 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.206956 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2740p499/unwise-2740p499-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 809 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207544 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/tmp-legacysurvey-custom-273088p49316-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/tmp-legacysurvey-custom-273088p49316-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.13 s, CPU: 0.35 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 242 MB, VmData: 270 MB, maxrss: 0.566604 MB
Stage wise_forced finished: 2020-06-07T20:13:10.000842
Resources for stage wise_forced : 4.758 s worker CPU, 6.038 s worker Wall, Wall: 2.133 s, Cores in use: 2.39, Total efficiency (on 4 cores): 59.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T20:13:10.002748
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/coadd/cus/custom-273088p49316/legacysurvey-custom-273088p49316-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/tractor-i/cus/tractor-custom-273088p49316.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/tractor/cus/tractor-custom-273088p49316.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2339531/tractor/cus/brick-custom-273088p49316.sha256sum
Stage writecat : Wall: 0.70 s, CPU: 0.52 s, VmPeak: 1137 MB, VmSize: 1009 MB, VmRSS: 244 MB, VmData: 270 MB, maxrss: 0.566604 MB
Stage writecat finished: 2020-06-07T20:13:10.704327
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.703 s, Cores in use: 0.73, Total efficiency (on 4 cores): 18.4 %
Stage writecat finished
All done: 36.805 s worker CPU, 44.566 s worker Wall, Wall: 30.885 s, Cores in use: 1.46, Total efficiency (on 4 cores): 36.5 %
Finished galaxy PGC2339531 in 0.541 minutes.