Started working on galaxy PGC1995011 at Thu Jun  4 03:23:03 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.6642905 32.3971224 --width 241 --height 241 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/PGC1995011-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/PGC1995011-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T03:23:05.485442
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '166.6642905', '32.3971224', '--width', '241', '--height', '241', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/PGC1995011-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/PGC1995011-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.6642905 32.3971224 --width 241 --height 241 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/PGC1995011-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/PGC1995011-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 166.6642905 32.3971224
Starting process 26293 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 26294 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 26295 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 26296 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 26297 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB
Starting process 26299 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB
Starting process 26302 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB
Starting process 26304 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T03:23:08.578836
Keeping 9 CCDs:
   k4m_170216_092148_ooi_zd_ls9.fits.fz k4m_170216_092148_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 0.92 MJD 57800.390 object MzLS_565719_z
   k4m_170127_102636_ooi_zd_ls9.fits.fz k4m_170127_102636_ooi_zd_ls9-CCD2 z exptime 140.107 propid 2016A-0453 seeing 1.47 MJD 57780.435 object MzLS_564662_z
   k4m_170103_121741_ooi_zd_ls9.fits.fz k4m_170103_121741_ooi_zd_ls9-CCD2 z exptime 82.102 propid 2016A-0453 seeing 0.86 MJD 57756.512 object MzLS_563601_z
   ksb_170516_040859_ooi_g_ls9.fits.fz ksb_170516_040859_ooi_g_ls9-CCD1 g exptime 250.0 propid BASS     seeing 2.06 MJD 57889.173 object 03262
   ksb_180421_063317_ooi_r_ls9.fits.fz ksb_180421_063317_ooi_r_ls9-CCD1 r exptime 137.76 propid BASS     seeing 1.61 MJD 58229.273 object 03262
   ksb_170203_101507_ooi_r_ls9.fits.fz ksb_170203_101507_ooi_r_ls9-CCD2 r exptime 73.02 propid BASS     seeing 1.04 MJD 57787.427 object 04653
   ksb_170222_085506_ooi_g_ls9.fits.fz ksb_170222_085506_ooi_g_ls9-CCD2 g exptime 73.727 propid BASS     seeing 1.16 MJD 57806.372 object 04653
   ksb_170421_065315_ooi_r_ls9.fits.fz ksb_170421_065315_ooi_r_ls9-CCD3 r exptime 65.426 propid BASS     seeing 1.45 MJD 57864.287 object 03271
   ksb_170519_051238_ooi_g_ls9.fits.fz ksb_170519_051238_ooi_g_ls9-CCD3 g exptime 128.31 propid 2015A-0801 seeing 1.60 MJD 57892.217 object 03271
mosaic get_fwhm: self.fwhm = 3.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1689 1936 and amp range 0 2005 and image y 729 978 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp 0.007397243 -> scaling image by 1.006836374469654
Faked up EXPNUM 78640115
Faked up EXPNUM 78640115
Faked up EXPNUM 78640115
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 797 938 and amp range 0 2015 and image y 2685 2826 and amp range 2048 4095
Range in image: x 0 142 , y 0 142 (with image size 142 x 142)
dzp -0.07725406 -> scaling image by 0.9313188157188347
Faked up EXPNUM 77870158
Faked up EXPNUM 77870158
Faked up EXPNUM 77870158
90prime get_fwhm: self.fwhm = 2.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2651 2792 and amp range 2016 4031 and image y 3852 3993 and amp range 2048 4095
Range in image: x 0 142 , y 0 142 (with image size 142 x 142)
dzp 0.021366077 -> scaling image by 1.0198737893800265
Faked up EXPNUM 78060174
Faked up EXPNUM 78060174
Faked up EXPNUM 78060174
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2628 2768 and amp range 2016 4031 and image y 3853 3993 and amp range 2048 4095
Range in image: x 0 141 , y 0 141 (with image size 141 x 141)
dzp 0.010008041 -> scaling image by 1.0092603604948323
mosaic get_fwhm: self.fwhm = 5.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 126 367 and amp range 0 2047 and image y 2932 3174 and amp range 2040 4078
Range in image: x 0 242 , y 0 243 (with image size 242 x 243)
dzp 0.015739892 -> scaling image by 1.0146025667655956
Faked up EXPNUM 82290081
Faked up EXPNUM 82290081
Faked up EXPNUM 82290081
90prime get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2846 2987 and amp range 2016 4031 and image y 945 1087 and amp range 0 2047
Range in image: x 0 142 , y 0 143 (with image size 142 x 143)
dzp -0.03177219 -> scaling image by 0.9711607558798585
Faked up EXPNUM 78890043
Faked up EXPNUM 78890043
Faked up EXPNUM 78890043
90prime get_fwhm: self.fwhm = 4.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2840 2981 and amp range 2016 4031 and image y 1086 1227 and amp range 0 2047
Range in image: x 0 142 , y 0 142 (with image size 142 x 142)
dzp -0.011406615 -> scaling image by 0.9895491130016149
mosaic get_fwhm: self.fwhm = 3.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2820 3065 and amp range 2048 4095 and image y 3931 4072 and amp range 2040 4078
Range in image: x 0 246 , y 0 142 (with image size 246 x 142)
dzp -0.032976374 -> scaling image by 0.9700842429001929
Faked up EXPNUM 78920100
Faked up EXPNUM 78920100
Faked up EXPNUM 78920100
90prime get_fwhm: self.fwhm = 3.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 888 1030 and amp range 0 2015 and image y 2668 2808 and amp range 2048 4095
Range in image: x 0 143 , y 0 141 (with image size 143 x 141)
dzp -0.045992933 -> scaling image by 0.958523636456738
Stage tims : Wall: 27.99 s, CPU: 0.86 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.757528 MB
Stage tims finished: 2020-06-04T03:23:36.569631
Resources for stage tims : 4.886 s worker CPU, 64.108 s worker Wall, Wall: 27.992 s, Cores in use: 0.21, Total efficiency (on 8 cores): 2.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/PGC1995011-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/PGC1995011-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-04T03:23:36.587925
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02939.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02811.fits
Matched 7 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/metrics/cus/reference-custom-166664p32397.fits
Stage refs : Wall: 3.20 s, CPU: 1.89 s, VmPeak: 972 MB, VmSize: 951 MB, VmRSS: 181 MB, VmData: 213 MB, maxrss: 0.757528 MB
Stage refs finished: 2020-06-04T03:23:39.792851
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.206 s, Cores in use: 0.59, Total efficiency (on 8 cores): 7.4 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T03:23:39.794626
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/metrics/cus/outlier-mask-custom-166664p32397.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/metrics/cus/outliers-pre-custom-166664p32397.jpg
Image ksb_170516_040859_ooi_g_ls9-CCD1 g : masking 419 positive outlier pixels and 0 negative outlier pixels
Image k4m_170216_092148_ooi_zd_ls9-CCD1 z : masking 1419 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/metrics/cus/outlier-mask-custom-166664p32397.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/metrics/cus/outliers-post-custom-166664p32397.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/metrics/cus/outliers-masked-pos-custom-166664p32397.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/metrics/cus/outliers-masked-neg-custom-166664p32397.jpg
Stage outliers : Wall: 1.61 s, CPU: 1.46 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 194 MB, VmData: 225 MB, maxrss: 0.757528 MB
Stage outliers finished: 2020-06-04T03:23:41.409454
Resources for stage outliers : 0.600 s worker CPU, 0.600 s worker Wall, Wall: 1.616 s, Cores in use: 1.27, Total efficiency (on 8 cores): 15.9 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T03:23:41.411574
Stage halos : Wall: 1.92 s, CPU: 1.92 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 194 MB, VmData: 225 MB, maxrss: 0.757528 MB
Stage halos finished: 2020-06-04T03:23:43.335419
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.925 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T03:23:43.337426
PSF sigmas in coadd pixels: ['3.35', '1.89', '2.60']
Using average PSF sigma 2.6125682948751416
Gaussian PSF norm 0.1079760450003317 vs pixelized 0.08073307
average tim pixel scale / coadd scale: 1.7295296718046524
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.61', '1.69', '2.35']
Using average PSF sigma 2.215511822726929
Gaussian PSF norm 0.12732714349800495 vs pixelized 0.11470277
average tim pixel scale / coadd scale: 1.7297226235355811
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.49', '2.39', '1.40']
Using average PSF sigma 1.761239554626906
Gaussian PSF norm 0.16016832635446687 vs pixelized 0.13696207
average tim pixel scale / coadd scale: 0.9909576673295263
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.13 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 196 MB, VmData: 225 MB, maxrss: 0.757528 MB
Stage fit_on_coadds finished: 2020-06-04T03:23:43.493348
Resources for stage fit_on_coadds : 0.136 s worker CPU, 0.136 s worker Wall, Wall: 0.157 s, Cores in use: 1.69, Total efficiency (on 8 cores): 21.1 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T03:23:43.496036
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 11 potential peaks
Of 11 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 8 kept
SED z : 8 new peaks
Found 9 potential peaks
Of 9 potential peaks: 9 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 12 potential peaks
Of 12 potential peaks: 9 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 16 potential peaks
Of 16 potential peaks: 11 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 15 potential peaks
Of 15 potential peaks: 14 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 12 new sources
Median coadd sky for g : 7.285474e-05
Median coadd sky for r : 0.00012831061
Median coadd sky for z : -0.00023225293
Stage srcs : Wall: 2.65 s, CPU: 2.60 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 196 MB, VmData: 225 MB, maxrss: 0.757528 MB
Stage srcs finished: 2020-06-04T03:23:46.143812
Resources for stage srcs : 0.090 s worker CPU, 0.090 s worker Wall, Wall: 2.649 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/PGC1995011-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/PGC1995011-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T03:23:46.157466
Blob 1 of 11, id: 4, sources: 2, size: 116x115, npix 8560, brick X: 61,177, Y: 72,187, one pixel: 106 72
Blob 2 of 11, id: 5, sources: 3, size: 58x59, npix 2324, brick X: 183,241, Y: 72,131, one pixel: 199 72
Blob 3 of 11, id: 0, sources: 1, size: 46x40, npix 1316, brick X: 14,60, Y: 0,40, one pixel: 25 0
Blob 4 of 11, id: 3, sources: 1, size: 39x44, npix 1183, brick X: 141,180, Y: 44,88, one pixel: 150 44
Blob 5 of 11, id: 9, sources: 1, size: 35x38, npix 963, brick X: 203,238, Y: 203,241, one pixel: 213 203
Blob 6 of 11, id: 1, sources: 1, size: 30x30, npix 638, brick X: 163,193, Y: 12,42, one pixel: 175 12
Blob 7 of 11, id: 8, sources: 1, size: 29x29, npix 545, brick X: 160,189, Y: 188,217, one pixel: 173 188
Blob 8 of 11, id: 2, sources: 1, size: 27x25, npix 440, brick X: 214,241, Y: 41,66, one pixel: 223 41
Blob 9 of 11, id: 7, sources: 1, size: 24x23, npix 350, brick X: 24,48, Y: 110,133, one pixel: 33 110
Blob 10 of 11, id: 10, sources: 1, size: 23x23, npix 333, brick X: 60,83, Y: 208,231, one pixel: 69 208
Blob 7 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 791 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14134 MB
Blob 11 of 11, id: 6, sources: 1, size: 21x20, npix 237, brick X: 0,21, Y: 80,100, one pixel: 11 80
Blob 6 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 802 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139712 MB
Blob 3 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141284 MB
Blob 8 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139308 MB
Blob 11 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141284 MB
Blob 9 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 791 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14134 MB
Blob 5 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 796 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142224 MB
Blob 10 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 802 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139712 MB
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 1.70 s, CPU: 1.70 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142212 MB
Blob 2 finished, total: Wall: 2.01 s, CPU: 2.00 s, VmPeak: 790 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141076 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.31251, ee1=-0.108275, ee2=-0.103415
Blob 1 finished, total: Wall: 2.88 s, CPU: 2.88 s, VmPeak: 794 MB, VmSize: 712 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142524 MB
Old catalog: 15
New catalog: 14
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/metrics/cus/blobs-custom-166664p32397.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/metrics/cus/all-models-custom-166664p32397.fits
Stage fitblobs : Wall: 3.58 s, CPU: 0.69 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 196 MB, VmData: 225 MB, maxrss: 0.757528 MB
Stage fitblobs finished: 2020-06-04T03:23:49.736743
Resources for stage fitblobs : 10.938 s worker CPU, 10.979 s worker Wall, Wall: 3.581 s, Cores in use: 3.25, Total efficiency (on 8 cores): 40.6 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T03:23:49.739036
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/tmp-legacysurvey-custom-166664p32397-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/tmp-legacysurvey-custom-166664p32397-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/tmp-legacysurvey-custom-166664p32397-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/tmp-legacysurvey-custom-166664p32397-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-resid.jpg
Stage coadds : Wall: 1.35 s, CPU: 0.79 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 197 MB, VmData: 225 MB, maxrss: 0.757528 MB
Stage coadds finished: 2020-06-04T03:23:51.092996
Resources for stage coadds : 3.122 s worker CPU, 3.235 s worker Wall, Wall: 1.355 s, Cores in use: 2.89, Total efficiency (on 8 cores): 36.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T03:23:51.094999
Cut to 1 unWISE tiles
Reading WISE tile 1658p318 band 1
Reading WISE tile 1658p318 band 2
Reading WISE tile 1658p318 band 3
Reading WISE tile 1658p318 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 802 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 169 MB, maxrss: 0.204572 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 793 MB, VmSize: 793 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.18674 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 794 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 169 MB, maxrss: 0.204032 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 796 MB, VmSize: 791 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207024 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/tmp-legacysurvey-custom-166664p32397-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/tmp-legacysurvey-custom-166664p32397-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.38 s, CPU: 0.58 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 198 MB, VmData: 225 MB, maxrss: 0.757528 MB
Stage wise_forced finished: 2020-06-04T03:23:53.472183
Resources for stage wise_forced : 4.058 s worker CPU, 5.454 s worker Wall, Wall: 2.378 s, Cores in use: 1.95, Total efficiency (on 8 cores): 24.4 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T03:23:53.474352
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/coadd/cus/custom-166664p32397/legacysurvey-custom-166664p32397-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/tractor-i/cus/tractor-custom-166664p32397.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/tractor/cus/tractor-custom-166664p32397.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1995011/tractor/cus/brick-custom-166664p32397.sha256sum
Stage writecat : Wall: 0.69 s, CPU: 0.53 s, VmPeak: 1093 MB, VmSize: 965 MB, VmRSS: 200 MB, VmData: 225 MB, maxrss: 0.757528 MB
Stage writecat finished: 2020-06-04T03:23:54.159698
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.687 s, Cores in use: 0.77, Total efficiency (on 8 cores): 9.6 %
Stage writecat finished
All done: 23.831 s worker CPU, 84.605 s worker Wall, Wall: 45.586 s, Cores in use: 0.77, Total efficiency (on 8 cores): 9.7 %
Finished galaxy PGC1995011 in 0.847 minutes.