Started working on galaxy PGC2732491 at Sun Jun  7 17:14:18 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 157.41675 69.82230559999999 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/PGC2732491-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/PGC2732491-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:14:19.933495
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '157.41675', '69.82230559999999', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/PGC2732491-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/PGC2732491-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 157.41675 69.82230559999999 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/PGC2732491-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/PGC2732491-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 157.41675 69.82230559999999
Starting process 57766 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057576 MB
Starting process 57768 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05758 MB
Starting process 57770 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05758 MB
Starting process 57772 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05758 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:14:20.308100
Keeping 11 CCDs:
   k4m_160513_034016_ooi_zd_ls9.fits.fz k4m_160513_034016_ooi_zd_ls9-CCD3 z exptime 206.104 propid 2016A-0453 seeing 1.69 MJD 57521.153 object MzLS_713548_z
   k4m_160320_064217_ooi_zd_ls9.fits.fz k4m_160320_064217_ooi_zd_ls9-CCD2 z exptime 92.104 propid 2016A-0453 seeing 0.84 MJD 57467.279 object MzLS_712668_z
   k4m_171120_091827_ooi_zd_ls9.fits.fz k4m_171120_091827_ooi_zd_ls9-CCD3 z exptime 121.104 propid 2016A-0453 seeing 1.13 MJD 58077.388 object MzLS_713982_z
   k4m_180210_072017_ooi_zd_ls9.fits.fz k4m_180210_072017_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 0.84 MJD 58159.306 object MzLS_713982_z
   k4m_170511_063632_ooi_zd_ls9.fits.fz k4m_170511_063632_ooi_zd_ls9-CCD2 z exptime 234.105 propid 2016A-0453 seeing 1.00 MJD 57884.275 object MzLS_713110_z
   ksb_180415_065828_ooi_g_ls9.fits.fz ksb_180415_065828_ooi_g_ls9-CCD4 g exptime 152.28 propid BASS seeing 1.71 MJD 58223.291 object 45891
   ksb_180518_052534_ooi_r_ls9.fits.fz ksb_180518_052534_ooi_r_ls9-CCD4 r exptime 104.497 propid NOTBASS seeing 1.56 MJD 58256.226 object 45891
   ksb_170403_040129_ooi_r_ls9.fits.fz ksb_170403_040129_ooi_r_ls9-CCD2 r exptime 201.978 propid BASS seeing 1.47 MJD 57846.168 object 45882
   ksb_180411_074915_ooi_g_ls9.fits.fz ksb_180411_074915_ooi_g_ls9-CCD2 g exptime 165.488 propid BASS seeing 1.38 MJD 58219.326 object 45882
   ksb_180509_052133_ooi_g_ls9.fits.fz ksb_180509_052133_ooi_g_ls9-CCD3 g exptime 155.592 propid NOTBASS seeing 1.49 MJD 58247.223 object 45893
   ksb_180518_052313_ooi_r_ls9.fits.fz ksb_180518_052313_ooi_r_ls9-CCD3 r exptime 104.497 propid NOTBASS seeing 1.39 MJD 58256.224 object 45893
mosaic get_fwhm: self.fwhm = 6.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2939 3173 and amp range 2006 4053 and image y 1458 1694 and amp range 0 2039
Range in image: x 0 235 , y 0 237 (with image size 235 x 237)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
mosaic get_fwhm: self.fwhm = 4.37
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 243 483 and amp range 0 2005 and image y 1362 1601 and amp range 0 2039
Range in image: x 0 241 , y 0 240 (with image size 241 x 240)
dzp 0.0014252509 -> scaling image by 1.0013135665633692
mosaic get_fwhm: self.fwhm = 3.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1347 1583 and amp range 0 2047 and image y 2496 2731 and amp range 2040 4078
Range in image: x 0 237 , y 0 236 (with image size 237 x 236)
dzp 0.015739892 -> scaling image by 1.0146025667655956
Faked up EXPNUM 82230089
Faked up EXPNUM 82230089
Faked up EXPNUM 82230089
90prime get_fwhm: self.fwhm = 3.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1252 1389 and amp range 0 2015 and image y 2697 2834 and amp range 2048 4095
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp 0.027550658 -> scaling image by 1.0256997821704772
Faked up EXPNUM 82560087
Faked up EXPNUM 82560087
Faked up EXPNUM 82560087
90prime get_fwhm: self.fwhm = 3.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1287 1423 and amp range 0 2015 and image y 2680 2817 and amp range 2048 4095
Range in image: x 0 137 , y 0 138 (with image size 137 x 138)
dzp 0.04491909 -> scaling image by 1.0422397564357018
mosaic get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 219 459 and amp range 0 2005 and image y 1393 1631 and amp range 0 2039
Range in image: x 0 241 , y 0 239 (with image size 241 x 239)
dzp 0.0014252509 -> scaling image by 1.0013135665633692
Faked up EXPNUM 82560086
Faked up EXPNUM 82560086
Faked up EXPNUM 82560086
90prime get_fwhm: self.fwhm = 3.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3493 3627 and amp range 2016 4031 and image y 725 860 and amp range 0 2047
Range in image: x 0 135 , y 0 136 (with image size 135 x 136)
dzp 0.0057031885 -> scaling image by 1.00526665101287
Faked up EXPNUM 82190108
Faked up EXPNUM 82190108
Faked up EXPNUM 82190108
90prime get_fwhm: self.fwhm = 3.05
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3196 3334 and amp range 2016 4031 and image y 1184 1324 and amp range 0 2047
Range in image: x 0 139 , y 0 141 (with image size 139 x 141)
dzp 0.009189803 -> scaling image by 1.0085000434534261
Faked up EXPNUM 82470067
Faked up EXPNUM 82470067
Faked up EXPNUM 82470067
90prime get_fwhm: self.fwhm = 3.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3489 3624 and amp range 2016 4031 and image y 736 871 and amp range 0 2047
Range in image: x 0 136 , y 0 136 (with image size 136 x 136)
dzp -0.0012233759 -> scaling image by 0.9988738637196966
Faked up EXPNUM 78460052
Faked up EXPNUM 78460052
Faked up EXPNUM 78460052
90prime get_fwhm: self.fwhm = 3.25
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3229 3367 and amp range 2016 4031 and image y 1192 1331 and amp range 0 2047
Range in image: x 0 139 , y 0 140 (with image size 139 x 140)
dzp 0.032776505 -> scaling image by 1.0306485625912574
Stage tims : Wall: 6.39 s, CPU: 0.86 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.566584 MB
Stage tims finished: 2020-06-07T17:14:26.700303
Resources for stage tims : 3.291 s worker CPU, 16.648 s worker Wall, Wall: 6.393 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/PGC2732491-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/PGC2732491-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:14:26.758245
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00388.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00334.fits
Matched 11 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/metrics/cus/reference-custom-157416p69822.fits
Stage refs : Wall: 2.33 s, CPU: 1.46 s, VmPeak: 972 MB, VmSize: 956 MB, VmRSS: 186 MB, VmData: 219 MB, maxrss: 0.566584 MB
Stage refs finished: 2020-06-07T17:14:29.093115
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.336 s, Cores in use: 0.63, Total efficiency (on 4 cores): 15.6 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:14:29.094543
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/metrics/cus/outlier-mask-custom-157416p69822.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/metrics/cus/outliers-pre-custom-157416p69822.jpg
Image ksb_180411_074915_ooi_g_ls9-CCD2 g : masking 107 positive outlier pixels and 0 negative outlier pixels
Image k4m_160513_034016_ooi_zd_ls9-CCD3 z : masking 191 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/metrics/cus/outlier-mask-custom-157416p69822.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/metrics/cus/outliers-post-custom-157416p69822.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/metrics/cus/outliers-masked-pos-custom-157416p69822.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/metrics/cus/outliers-masked-neg-custom-157416p69822.jpg
Stage outliers : Wall: 0.79 s, CPU: 0.59 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.566584 MB
Stage outliers finished: 2020-06-07T17:14:29.886327
Resources for stage outliers : 0.703 s worker CPU, 0.720 s worker Wall, Wall: 0.793 s, Cores in use: 1.63, Total efficiency (on 4 cores): 40.7 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:14:29.887930
Stage halos : Wall: 0.25 s, CPU: 0.25 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 198 MB, VmData: 228 MB, maxrss: 0.566584 MB
Stage halos finished: 2020-06-07T17:14:30.140728
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.254 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.4 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T17:14:30.142509
PSF sigmas in coadd pixels: ['2.78', '2.25', '2.42']
Using average PSF sigma 2.48176551363655
Gaussian PSF norm 0.11366698031053003 vs pixelized 0.08990941
average tim pixel scale / coadd scale: 1.730573077451523
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.54', '2.39', '2.26']
Using average PSF sigma 2.3979896337647477
Gaussian PSF norm 0.11763803637924848 vs pixelized 0.097808965
average tim pixel scale / coadd scale: 1.7303671289718787
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.74', '1.84', '1.36', '1.63']
Using average PSF sigma 1.8954712275630894
Gaussian PSF norm 0.14882567863430618 vs pixelized 0.12128903
average tim pixel scale / coadd scale: 0.9909737716341845
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.97 s, CPU: 0.16 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 201 MB, VmData: 230 MB, maxrss: 0.566584 MB
Stage fit_on_coadds finished: 2020-06-07T17:14:31.109737
Resources for stage fit_on_coadds : 0.158 s worker CPU, 0.161 s worker Wall, Wall: 0.968 s, Cores in use: 0.33, Total efficiency (on 4 cores): 8.3 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:14:31.112577
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 17 potential peaks
Of 17 potential peaks: 3 in veto map, 3 cut by saddle test, 0 cut by aper test, 11 kept
SED z : 11 new peaks
Found 16 potential peaks
Of 16 potential peaks: 13 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 17 potential peaks
Of 17 potential peaks: 13 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 25 potential peaks
Of 25 potential peaks: 16 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept
SED Flat : 4 new peaks
Found 26 potential peaks
Of 26 potential peaks: 20 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 16 new sources
Median coadd sky for g : 4.1307692e-05
Median coadd sky for r : 0.00010591678
Median coadd sky for z : -0.00031953305
Stage srcs : Wall: 0.50 s, CPU: 0.45 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 201 MB, VmData: 230 MB, maxrss: 0.566584 MB
Stage srcs finished: 2020-06-07T17:14:31.610735
Resources for stage srcs : 0.096 s worker CPU, 0.097 s worker Wall, Wall: 0.499 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/PGC2732491-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/PGC2732491-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:14:31.621757
Blob 1 of 11, id: 3, sources: 5, size: 160x112, npix 11349, brick X: 24,184, Y: 60,172, one pixel: 47 60
Blob 2 of 11, id: 7, sources: 2, size: 57x33, npix 1099, brick X: 2,59, Y: 200,233, one pixel: 39 200
Blob 3 of 11, id: 5, sources: 1, size: 30x40, npix 927, brick X: 0,30, Y: 131,171, one pixel: 5 131
Blob 4 of 11, id: 1, sources: 1, size: 32x39, npix 885, brick X: 0,32, Y: 6,45, one pixel: 11 6
Blob 5 of 11, id: 2, sources: 2, size: 42x26, npix 611, brick X: 169,211, Y: 10,36, one pixel: 177 10
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141424 MB
Blob 6 of 11, id: 10, sources: 1, size: 27x28, npix 482, brick X: 120,147, Y: 203,231, one pixel: 131 203
Blob 3 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139236 MB
Blob 7 of 11, id: 0, sources: 1, size: 33x19, npix 469, brick X: 42,75, Y: 0,19, one pixel: 47 0
Blob 6 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141352 MB
Blob 8 of 11, id: 6, sources: 1, size: 18x31, npix 418, brick X: 0,18, Y: 175,206, one pixel: 4 175
Blob 5 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141424 MB
Blob 9 of 11, id: 4, sources: 1, size: 20x26, npix 346, brick X: 198,218, Y: 72,98, one pixel: 207 72
Blob 10 of 11, id: 9, sources: 1, size: 22x21, npix 262, brick X: 207,229, Y: 202,223, one pixel: 216 202
Blob 4 finished, total: Wall: 1.99 s, CPU: 1.99 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141764 MB
Blob 11 of 11, id: 8, sources: 1, size: 20x21, npix 239, brick X: 180,200, Y: 200,221, one pixel: 190 200
Blob 9 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141764 MB
Blob 8 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141424 MB
Blob 10 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141764 MB
Blob 11 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141424 MB
Blob 7 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141704 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.04068, ee1=-0.206061, ee2=-0.325906
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 7.68 s, CPU: 7.68 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.1442 MB
Old catalog: 19
New catalog: 18
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/metrics/cus/blobs-custom-157416p69822.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/metrics/cus/all-models-custom-157416p69822.fits
Stage fitblobs : Wall: 7.99 s, CPU: 0.31 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 201 MB, VmData: 230 MB, maxrss: 0.566584 MB
Stage fitblobs finished: 2020-06-07T17:14:39.612731
Resources for stage fitblobs : 16.029 s worker CPU, 16.074 s worker Wall, Wall: 7.992 s, Cores in use: 2.04, Total efficiency (on 4 cores): 51.1 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:14:39.614692
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/tmp-legacysurvey-custom-157416p69822-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/tmp-legacysurvey-custom-157416p69822-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/tmp-legacysurvey-custom-157416p69822-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/tmp-legacysurvey-custom-157416p69822-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-resid.jpg
Stage coadds : Wall: 1.14 s, CPU: 0.52 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.566584 MB
Stage coadds finished: 2020-06-07T17:14:40.754674
Resources for stage coadds : 1.854 s worker CPU, 1.947 s worker Wall, Wall: 1.141 s, Cores in use: 2.08, Total efficiency (on 4 cores): 52.0 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:14:40.756297
Cut to 1 unWISE tiles
Reading WISE tile 1590p696 band 1
Reading WISE tile 1590p696 band 3
Reading WISE tile 1590p696 band 4
Reading WISE tile 1590p696 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 805 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.188036 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208912 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208416 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/159/1590p696/unwise-1590p696-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208364 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/tmp-legacysurvey-custom-157416p69822-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/tmp-legacysurvey-custom-157416p69822-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.23 s, CPU: 0.38 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.566584 MB
Stage wise_forced finished: 2020-06-07T17:14:42.985741
Resources for stage wise_forced : 4.472 s worker CPU, 5.965 s worker Wall, Wall: 2.231 s, Cores in use: 2.18, Total efficiency (on 4 cores): 54.4 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:14:42.987489
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/coadd/cus/custom-157416p69822/legacysurvey-custom-157416p69822-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/tractor-i/cus/tractor-custom-157416p69822.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/tractor/cus/tractor-custom-157416p69822.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2732491/tractor/cus/brick-custom-157416p69822.sha256sum
Stage writecat : Wall: 1.42 s, CPU: 0.46 s, VmPeak: 1098 MB, VmSize: 970 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.566584 MB
Stage writecat finished: 2020-06-07T17:14:44.402844
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.416 s, Cores in use: 0.33, Total efficiency (on 4 cores): 8.2 %
Stage writecat finished
All done: 26.605 s worker CPU, 41.613 s worker Wall, Wall: 24.101 s, Cores in use: 1.33, Total efficiency (on 4 cores): 33.3 %
Finished galaxy PGC2732491 in 0.435 minutes.