Started working on galaxy PGC2592518 at Sun Jun  7 18:58:24 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 195.53801549999997 59.623576799999995 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/PGC2592518-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/PGC2592518-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T18:58:25.966061
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '195.53801549999997', '59.623576799999995', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/PGC2592518-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/PGC2592518-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 195.53801549999997 59.623576799999995 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/PGC2592518-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/PGC2592518-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 195.53801549999997 59.623576799999995
Starting process 43701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB
Starting process 43703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 43705 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB
Starting process 43707 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T18:58:26.608359
Keeping 10 CCDs:
   k4m_170501_062246_ooi_zd_ls9.fits.fz k4m_170501_062246_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 1.04 MJD 57874.266 object MzLS_684996_z
   k4m_170605_082429_ooi_zd_ls9.fits.fz k4m_170605_082429_ooi_zd_ls9-CCD4 z exptime 250.105 propid 2016A-0453 seeing 1.53 MJD 57909.350 object MzLS_684353_z
   k4m_180209_094451_ooi_zd_ls9.fits.fz k4m_180209_094451_ooi_zd_ls9-CCD4 z exptime 80.105 propid 2016A-0453 seeing 0.86 MJD 58158.406 object MzLS_684353_z
   k4m_160604_040408_ooi_zd_ls9.fits.fz k4m_160604_040408_ooi_zd_ls9-CCD1 z exptime 80.105 propid 2016A-0453 seeing 1.06 MJD 57543.170 object MzLS_685633_z
   ksb_170521_061059_ooi_g_ls9.fits.fz ksb_170521_061059_ooi_g_ls9-CCD4 g exptime 125.783 propid 2015A-0801 seeing 1.93 MJD 57894.258 object 37423
   ksb_170430_074846_ooi_r_ls9.fits.fz ksb_170430_074846_ooi_r_ls9-CCD4 r exptime 80.798 propid BASS seeing 1.44 MJD 57873.326 object 37423
   ksb_170131_121453_ooi_g_ls9.fits.fz ksb_170131_121453_ooi_g_ls9-CCD1 g exptime 121.0 propid BASS seeing 2.13 MJD 57784.510 object 36432
   ksb_170321_091750_ooi_r_ls9.fits.fz ksb_170321_091750_ooi_r_ls9-CCD1 r exptime 126.826 propid BASS seeing 1.59 MJD 57833.387 object 36432
   ksb_160527_041520_ooi_g_ls9.fits.fz ksb_160527_041520_ooi_g_ls9-CCD2 g exptime 59.7 propid BASS seeing 1.43 MJD 57535.177 object 37411
   ksb_170320_092403_ooi_r_ls9.fits.fz ksb_170320_092403_ooi_r_ls9-CCD2 r exptime 87.696 propid BASS seeing 1.18 MJD 57832.392 object 37411
mosaic get_fwhm: self.fwhm = 4.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2454 2700 and amp range 2006 4053 and image y 3378 3624 and amp range 2040 4078
Range in image: x 0 247 , y 0 247 (with image size 247 x 247)
dzp -0.006092005 -> scaling image by 0.9944047680378836
mosaic get_fwhm: self.fwhm = 3.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3634 3893 and amp range 2048 4095 and image y 3275 3530 and amp range 2022 4060
Range in image: x 0 260 , y 0 256 (with image size 260 x 256)
dzp -0.019603321 -> scaling image by 0.9821066946375949
mosaic get_fwhm: self.fwhm = 4.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 888 1137 and amp range 0 2047 and image y 1140 1389 and amp range 0 2039
Range in image: x 0 250 , y 0 250 (with image size 250 x 250)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
mosaic get_fwhm: self.fwhm = 5.89
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3655 3915 and amp range 2048 4095 and image y 3268 3522 and amp range 2022 4060
Range in image: x 0 261 , y 0 255 (with image size 261 x 255)
dzp -0.02499645 -> scaling image by 0.9772404160512723
Faked up EXPNUM 78940082
Faked up EXPNUM 78940082
Faked up EXPNUM 78940082
90prime get_fwhm: self.fwhm = 4.25
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 876 1019 and amp range 0 2015 and image y 2960 3104 and amp range 2048 4095
Range in image: x 0 144 , y 0 145 (with image size 144 x 145)
dzp 0.019393893 -> scaling image by 1.0180229229717446
Faked up EXPNUM 78730157
Faked up EXPNUM 78730157
Faked up EXPNUM 78730157
90prime get_fwhm: self.fwhm = 3.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 890 1033 and amp range 0 2015 and image y 2907 3050 and amp range 2048 4095
Range in image: x 0 144 , y 0 144 (with image size 144 x 144)
dzp 0.01103811 -> scaling image by 1.0102183288830229
Faked up EXPNUM 78330193
Faked up EXPNUM 78330193
Faked up EXPNUM 78330193
90prime get_fwhm: self.fwhm = 3.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1047 1191 and amp range 0 2015 and image y 2799 2942 and amp range 2048 4095
Range in image: x 0 145 , y 0 144 (with image size 145 x 144)
dzp -0.041613504 -> scaling image by 0.9623977484321999
Faked up EXPNUM 77840232
Faked up EXPNUM 77840232
Faked up EXPNUM 77840232
90prime get_fwhm: self.fwhm = 4.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1063 1207 and amp range 0 2015 and image y 2809 2952 and amp range 2048 4095
Range in image: x 0 145 , y 0 144 (with image size 145 x 144)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Faked up EXPNUM 75350051
Faked up EXPNUM 75350051
Faked up EXPNUM 75350051
90prime get_fwhm: self.fwhm = 3.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2818 2962 and amp range 2016 4031 and image y 1373 1518 and amp range 0 2047
Range in image: x 0 145 , y 0 146 (with image size 145 x 146)
dzp -0.008960029 -> scaling image by 0.9917814665476246
Faked up EXPNUM 78320254
Faked up EXPNUM 78320254
Faked up EXPNUM 78320254
90prime get_fwhm: self.fwhm = 2.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2818 2962 and amp range 2016 4031 and image y 1351 1497 and amp range 0 2047
Range in image: x 0 145 , y 0 147 (with image size 145 x 147)
dzp 0.032776505 -> scaling image by 1.0306485625912574
Stage tims : Wall: 7.61 s, CPU: 1.07 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.56656 MB
Stage tims finished: 2020-06-07T18:58:34.219314
Resources for stage tims : 3.440 s worker CPU, 16.121 s worker Wall, Wall: 7.612 s, Cores in use: 0.59, Total efficiency (on 4 cores): 14.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/PGC2592518-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/PGC2592518-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T18:58:34.240438
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00803.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00885.fits
Matched 9 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/metrics/cus/reference-custom-195538p59623.fits
Stage refs : Wall: 2.49 s, CPU: 1.28 s, VmPeak: 972 MB, VmSize: 954 MB, VmRSS: 184 MB, VmData: 217 MB, maxrss: 0.56656 MB
Stage refs finished: 2020-06-07T18:58:36.730820
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.491 s, Cores in use: 0.51, Total efficiency (on 4 cores): 12.8 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T18:58:36.732431
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/metrics/cus/outlier-mask-custom-195538p59623.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/metrics/cus/outliers-pre-custom-195538p59623.jpg
Image ksb_170430_074846_ooi_r_ls9-CCD4 r : masking 119 positive outlier pixels and 0 negative outlier pixels
Image k4m_170605_082429_ooi_zd_ls9-CCD4 z : masking 254 positive outlier pixels and 0 negative outlier pixels
Image k4m_180209_094451_ooi_zd_ls9-CCD4 z : masking 742 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/metrics/cus/outlier-mask-custom-195538p59623.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/metrics/cus/outliers-post-custom-195538p59623.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/metrics/cus/outliers-masked-pos-custom-195538p59623.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/metrics/cus/outliers-masked-neg-custom-195538p59623.jpg
Stage outliers : Wall: 1.00 s, CPU: 0.69 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.56656 MB
Stage outliers finished: 2020-06-07T18:58:37.728082
Resources for stage outliers : 0.823 s worker CPU, 0.827 s worker Wall, Wall: 0.997 s, Cores in use: 1.52, Total efficiency (on 4 cores): 38.0 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T18:58:37.729940
Stage halos : Wall: 0.39 s, CPU: 0.38 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.56656 MB
Stage halos finished: 2020-06-07T18:58:38.115150
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.386 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.5 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T18:58:38.116871
PSF sigmas in coadd pixels: ['3.13', '3.45', '2.32']
Using average PSF sigma 2.9664677168248432
Gaussian PSF norm 0.09509450926228792 vs pixelized 0.074976005
average tim pixel scale / coadd scale: 1.7298385278741253
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.33', '2.58', '1.92']
Using average PSF sigma 2.2791670143510925
Gaussian PSF norm 0.12377100493190234 vs pixelized 0.117886804
average tim pixel scale / coadd scale: 1.7296212488956009
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.69', '2.48', '1.40', '1.72']
Using average PSF sigma 1.823766701345918
Gaussian PSF norm 0.15467701629034875 vs pixelized 0.12126693
average tim pixel scale / coadd scale: 0.9909381555439548
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.18 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.56656 MB
Stage fit_on_coadds finished: 2020-06-07T18:58:38.320224
Resources for stage fit_on_coadds : 0.182 s worker CPU, 0.196 s worker Wall, Wall: 0.204 s, Cores in use: 1.80, Total efficiency (on 4 cores): 45.0 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T18:58:38.322924
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 17 potential peaks
Of 17 potential peaks: 4 in veto map, 1 cut by saddle test, 0 cut by aper test, 12 kept
SED z : 12 new peaks
Found 15 potential peaks
Of 15 potential peaks: 12 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 13 potential peaks
Of 13 potential peaks: 13 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 21 potential peaks
Of 21 potential peaks: 18 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 19 potential peaks
Of 19 potential peaks: 17 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 17 new sources
Median coadd sky for g : 0.0002165222
Median coadd sky for r : 0.0003778183
Median coadd sky for z : -8.101074e-05
Stage srcs : Wall: 0.49 s, CPU: 0.45 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.56656 MB
Stage srcs finished: 2020-06-07T18:58:38.815870
Resources for stage srcs : 0.103 s worker CPU, 0.111 s worker Wall, Wall: 0.494 s, Cores in use: 1.13, Total efficiency (on 4 cores): 28.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/PGC2592518-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/PGC2592518-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T18:58:38.826315
Blob 1 of 11, id: 3, sources: 3, size: 102x108, npix 6711, brick X: 66,168, Y: 76,184, one pixel: 123 76
Blob 2 of 11, id: 1, sources: 5, size: 88x91, npix 3890, brick X: 127,215, Y: 26,117, one pixel: 158 26
Blob 3 of 11, id: 2, sources: 3, size: 39x69, npix 1486, brick X: 14,53, Y: 55,124, one pixel: 33 55
Blob 4 of 11, id: 4, sources: 1, size: 36x35, npix 836, brick X: 30,66, Y: 123,158, one pixel: 45 123
Blob 5 of 11, id: 6, sources: 1, size: 28x32, npix 441, brick X: 125,153, Y: 173,205, one pixel: 133 173
Blob 4 finished, total: Wall: 1.42 s, CPU: 1.42 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143232 MB
Blob 6 of 11, id: 8, sources: 1, size: 26x27, npix 435, brick X: 91,117, Y: 186,213, one pixel: 102 186
Blob 5 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143232 MB
Blob 7 of 11, id: 9, sources: 1, size: 26x26, npix 432, brick X: 119,145, Y: 201,227, one pixel: 129 201
Blob 3 finished, total: Wall: 1.79 s, CPU: 1.79 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142864 MB
Blob 8 of 11, id: 10, sources: 1, size: 26x26, npix 432, brick X: 89,115, Y: 218,244, one pixel: 100 218
Blob 6 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143232 MB
Blob 9 of 11, id: 7, sources: 1, size: 23x26, npix 384, brick X: 55,78, Y: 175,201, one pixel: 66 175
Blob 7 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142864 MB
Blob 10 of 11, id: 5, sources: 1, size: 21x22, npix 282, brick X: 157,178, Y: 155,177, one pixel: 166 155
Blob 11 of 11, id: 0, sources: 1, size: 20x20, npix 219, brick X: 39,59, Y: 8,28, one pixel: 49 8
Blob 8 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143232 MB
Blob 9 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142864 MB
Blob 11 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142864 MB
Blob 10 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143232 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 3.52 s, CPU: 3.52 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142596 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.347801, ee1=0.0724191, ee2=0.153291
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 4.07 s, CPU: 4.07 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142424 MB
Old catalog: 21
New catalog: 18
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/metrics/cus/blobs-custom-195538p59623.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/metrics/cus/all-models-custom-195538p59623.fits
Stage fitblobs : Wall: 4.47 s, CPU: 0.38 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.56656 MB
Stage fitblobs finished: 2020-06-07T18:58:43.299207
Resources for stage fitblobs : 13.023 s worker CPU, 13.093 s worker Wall, Wall: 4.474 s, Cores in use: 3.00, Total efficiency (on 4 cores): 74.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T18:58:43.301094
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/tmp-legacysurvey-custom-195538p59623-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/tmp-legacysurvey-custom-195538p59623-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/tmp-legacysurvey-custom-195538p59623-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/tmp-legacysurvey-custom-195538p59623-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-resid.jpg
Stage coadds : Wall: 1.28 s, CPU: 0.66 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.56656 MB
Stage coadds finished: 2020-06-07T18:58:44.580018
Resources for stage coadds : 1.754 s worker CPU, 1.822 s worker Wall, Wall: 1.280 s, Cores in use: 1.89, Total efficiency (on 4 cores): 47.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T18:58:44.581745
Cut to 1 unWISE tiles
Reading WISE tile 1958p590 band 2
Reading WISE tile 1958p590 band 1
Reading WISE tile 1958p590 band 4
Reading WISE tile 1958p590 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.203736 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 802 MB, VmSize: 795 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.187352 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208848 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1958p590/unwise-1958p590-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 805 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.20406 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/tmp-legacysurvey-custom-195538p59623-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/tmp-legacysurvey-custom-195538p59623-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.27 s, CPU: 0.44 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 201 MB, VmData: 228 MB, maxrss: 0.56656 MB
Stage wise_forced finished: 2020-06-07T18:58:46.855588
Resources for stage wise_forced : 4.163 s worker CPU, 5.761 s worker Wall, Wall: 2.275 s, Cores in use: 2.02, Total efficiency (on 4 cores): 50.6 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T18:58:46.857200
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/coadd/cus/custom-195538p59623/legacysurvey-custom-195538p59623-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/tractor-i/cus/tractor-custom-195538p59623.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/tractor/cus/tractor-custom-195538p59623.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2592518/tractor/cus/brick-custom-195538p59623.sha256sum
Stage writecat : Wall: 0.81 s, CPU: 0.47 s, VmPeak: 1096 MB, VmSize: 968 MB, VmRSS: 203 MB, VmData: 228 MB, maxrss: 0.56656 MB
Stage writecat finished: 2020-06-07T18:58:47.671408
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.815 s, Cores in use: 0.58, Total efficiency (on 4 cores): 14.5 %
Stage writecat finished
All done: 23.491 s worker CPU, 37.933 s worker Wall, Wall: 21.069 s, Cores in use: 1.40, Total efficiency (on 4 cores): 35.0 %
Finished galaxy PGC2592518 in 0.394 minutes.