Started working on galaxy PGC2559772 at Sun Jun  7 18:27:27 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.8900095 57.1983625 --width 253 --height 253 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/PGC2559772-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/PGC2559772-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T18:27:28.872278
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.8900095', '57.1983625', '--width', '253', '--height', '253', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/PGC2559772-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/PGC2559772-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.8900095 57.1983625 --width 253 --height 253 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/PGC2559772-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/PGC2559772-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 167.8900095 57.1983625
Starting process 534 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057592 MB
Starting process 535 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057592 MB
Starting process 536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057592 MB
Starting process 537 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057596 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T18:27:29.326409
Keeping 10 CCDs:
   k4m_170415_053627_ooi_zd_ls9.fits.fz k4m_170415_053627_ooi_zd_ls9-CCD3 z exptime 80.105 propid 2016A-0453 seeing 0.80 MJD 57858.234 object MzLS_677035_z
   k4m_160414_054718_ooi_zd_ls9.fits.fz k4m_160414_054718_ooi_zd_ls9-CCD4 z exptime 250.102 propid 2016A-0453 seeing 1.48 MJD 57492.241 object MzLS_676351_z
   k4m_170404_075538_ooi_zd_ls9.fits.fz k4m_170404_075538_ooi_zd_ls9-CCD1 z exptime 80.105 propid 2016A-0453 seeing 1.35 MJD 57847.330 object MzLS_677716_z
   k4m_170415_053627_ooi_zd_ls9.fits.fz k4m_170415_053627_ooi_zd_ls9-CCD4 z exptime 80.105 propid 2016A-0453 seeing 0.80 MJD 57858.234 object MzLS_677035_z
   ksb_170322_072235_ooi_r_ls9.fits.fz ksb_170322_072235_ooi_r_ls9-CCD4 r exptime 55.341 propid BASS seeing 1.66 MJD 57834.307 object 34262
   ksb_170131_105159_ooi_g_ls9.fits.fz ksb_170131_105159_ooi_g_ls9-CCD4 g exptime 123.6 propid BASS seeing 1.67 MJD 57784.453 object 34262
   ksb_170521_053335_ooi_g_ls9.fits.fz ksb_170521_053335_ooi_g_ls9-CCD1 g exptime 121.322 propid 2015A-0801 seeing 1.95 MJD 57894.232 object 34263
   ksb_170430_044801_ooi_r_ls9.fits.fz ksb_170430_044801_ooi_r_ls9-CCD1 r exptime 87.062 propid BASS seeing 1.36 MJD 57873.200 object 34263
   ksb_170403_062441_ooi_r_ls9.fits.fz ksb_170403_062441_ooi_r_ls9-CCD3 r exptime 138.752 propid BASS seeing 1.66 MJD 57846.267 object 34261
   ksb_160606_042027_ooi_g_ls9.fits.fz ksb_160606_042027_ooi_g_ls9-CCD3 g exptime 96.7 propid BASS seeing 1.28 MJD 57545.181 object 34261
mosaic get_fwhm: self.fwhm = 5.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1358 1614 and amp range 0 2005 and image y 3337 3592 and amp range 2040 4078
Range in image: x 0 257 , y 0 256 (with image size 257 x 256)
dzp 0.032569118 -> scaling image by 1.0304517167935139
mosaic get_fwhm: self.fwhm = 3.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 7 39 and amp range 0 2047 and image y 2698 2955 and amp range 2022 4060
Range in image: x 0 33 , y 0 258 (with image size 33 x 258)
dzp -0.017482605 -> scaling image by 0.9840268712629925
mosaic get_fwhm: self.fwhm = 5.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2527 2787 and amp range 2048 4095 and image y 2304 2563 and amp range 2022 4060
Range in image: x 0 261 , y 0 260 (with image size 261 x 260)
dzp -0.0028835079 -> scaling image by 0.9973477146455455
Faked up EXPNUM 78340148
Faked up EXPNUM 78340148
Faked up EXPNUM 78340148
90prime get_fwhm: self.fwhm = 3.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 286 433 and amp range 0 2015 and image y 2950 3098 and amp range 2048 4095
Range in image: x 0 148 , y 0 149 (with image size 148 x 149)
dzp 0.01103811 -> scaling image by 1.0102183288830229
Faked up EXPNUM 77840205
Faked up EXPNUM 77840205
Faked up EXPNUM 77840205
90prime get_fwhm: self.fwhm = 3.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 294 441 and amp range 0 2015 and image y 2956 3104 and amp range 2048 4095
Range in image: x 0 148 , y 0 149 (with image size 148 x 149)
dzp 0.019393893 -> scaling image by 1.0180229229717446
Faked up EXPNUM 78940072
Faked up EXPNUM 78940072
Faked up EXPNUM 78940072
90prime get_fwhm: self.fwhm = 4.31
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 455 604 and amp range 0 2015 and image y 3474 3621 and amp range 2048 4095
Range in image: x 0 150 , y 0 148 (with image size 150 x 148)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Faked up EXPNUM 78730068
Faked up EXPNUM 78730068
Faked up EXPNUM 78730068
90prime get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 458 606 and amp range 0 2015 and image y 3463 3611 and amp range 2048 4095
Range in image: x 0 149 , y 0 149 (with image size 149 x 149)
dzp -0.041613504 -> scaling image by 0.9623977484321999
Faked up EXPNUM 78460099
Faked up EXPNUM 78460099
Faked up EXPNUM 78460099
90prime get_fwhm: self.fwhm = 3.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2479 2626 and amp range 2016 4031 and image y 1013 1160 and amp range 0 2047
Range in image: x 0 148 , y 0 148 (with image size 148 x 148)
dzp -0.0023383768 -> scaling image by 0.9978485929508539
Faked up EXPNUM 75450040
Faked up EXPNUM 75450040
Faked up EXPNUM 75450040
90prime get_fwhm: self.fwhm = 2.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2480 2626 and amp range 2016 4031 and image y 575 722 and amp range 0 2047
Range in image: x 0 147 , y 0 148 (with image size 147 x 148)
dzp -0.0022715968 -> scaling image by 0.9979099691834846
Stage tims : Wall: 7.14 s, CPU: 0.98 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.566536 MB
Stage tims finished: 2020-06-07T18:27:36.469607
Resources for stage tims : 3.337 s worker CPU, 19.319 s worker Wall, Wall: 7.144 s, Cores in use: 0.60, Total efficiency (on 4 cores): 15.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/PGC2559772-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/PGC2559772-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T18:27:36.487801
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00964.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00965.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01054.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00879.fits
Matched 29 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/metrics/cus/reference-custom-167890p57198.fits
Stage refs : Wall: 1.79 s, CPU: 1.30 s, VmPeak: 972 MB, VmSize: 953 MB, VmRSS: 183 MB, VmData: 216 MB, maxrss: 0.566536 MB
Stage refs finished: 2020-06-07T18:27:38.278247
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.792 s, Cores in use: 0.73, Total efficiency (on 4 cores): 18.2 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T18:27:38.279864
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/metrics/cus/outlier-mask-custom-167890p57198.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/metrics/cus/outliers-pre-custom-167890p57198.jpg
Image ksb_160606_042027_ooi_g_ls9-CCD3 g : masking 163 positive outlier pixels and 0 negative outlier pixels
Image ksb_170131_105159_ooi_g_ls9-CCD4 g : masking 84 positive outlier pixels and 0 negative outlier pixels
Image k4m_160414_054718_ooi_zd_ls9-CCD4 z : masking 611 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/metrics/cus/outlier-mask-custom-167890p57198.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/metrics/cus/outliers-post-custom-167890p57198.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/metrics/cus/outliers-masked-pos-custom-167890p57198.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/metrics/cus/outliers-masked-neg-custom-167890p57198.jpg
Stage outliers : Wall: 0.88 s, CPU: 0.63 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage outliers finished: 2020-06-07T18:27:39.155571
Resources for stage outliers : 0.735 s worker CPU, 0.741 s worker Wall, Wall: 0.877 s, Cores in use: 1.56, Total efficiency (on 4 cores): 38.9 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T18:27:39.157442
Stage halos : Wall: 0.22 s, CPU: 0.21 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage halos finished: 2020-06-07T18:27:39.377464
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.221 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T18:27:39.379543
PSF sigmas in coadd pixels: ['2.72', '3.17', '2.08']
Using average PSF sigma 2.656652011983039
Gaussian PSF norm 0.10618432165803701 vs pixelized 0.086212784
average tim pixel scale / coadd scale: 1.7293609806713257
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.70', '2.21', '2.70']
Using average PSF sigma 2.5392270585661065
Gaussian PSF norm 0.11109474862526716 vs pixelized 0.102408856
average tim pixel scale / coadd scale: 1.7295849246491912
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.40', '2.19', '1.29']
Using average PSF sigma 1.9605893290710315
Gaussian PSF norm 0.14388265180834203 vs pixelized 0.12246576
average tim pixel scale / coadd scale: 0.9908391969662358
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.17 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage fit_on_coadds finished: 2020-06-07T18:27:39.592395
Resources for stage fit_on_coadds : 0.170 s worker CPU, 0.172 s worker Wall, Wall: 0.214 s, Cores in use: 1.58, Total efficiency (on 4 cores): 39.5 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T18:27:39.595297
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 13 potential peaks
Of 13 potential peaks: 3 in veto map, 1 cut by saddle test, 0 cut by aper test, 9 kept
SED z : 9 new peaks
Found 11 potential peaks
Of 11 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 11 potential peaks
Of 11 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 16 potential peaks
Of 16 potential peaks: 12 in veto map, 1 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 17 potential peaks
Of 17 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 14 new sources
Median coadd sky for g : 6.810709e-05
Median coadd sky for r : 0.00016244286
Median coadd sky for z : -4.2276864e-05
Stage srcs : Wall: 0.72 s, CPU: 0.67 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage srcs finished: 2020-06-07T18:27:40.316924
Resources for stage srcs : 0.111 s worker CPU, 0.111 s worker Wall, Wall: 0.723 s, Cores in use: 1.08, Total efficiency (on 4 cores): 26.9 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/PGC2559772-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/PGC2559772-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T18:27:40.334662
Blob 1 of 12, id: 6, sources: 3, size: 111x137, npix 8191, brick X: 66,177, Y: 62,199, one pixel: 118 62
Blob 2 of 12, id: 4, sources: 1, size: 61x56, npix 2447, brick X: 184,245, Y: 49,105, one pixel: 201 49
Blob 3 of 12, id: 11, sources: 1, size: 53x26, npix 948, brick X: 173,226, Y: 227,253, one pixel: 203 227
Blob 4 of 12, id: 7, sources: 1, size: 37x36, npix 883, brick X: 4,41, Y: 132,168, one pixel: 18 132
Blob 5 of 12, id: 5, sources: 2, size: 40x31, npix 853, brick X: 47,87, Y: 54,85, one pixel: 60 54
Blob 4 finished, total: Wall: 0.46 s, CPU: 0.45 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142456 MB
Blob 6 of 12, id: 3, sources: 2, size: 40x34, npix 778, brick X: 107,147, Y: 22,56, one pixel: 130 22
Blob 5 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142456 MB
Blob 7 of 12, id: 0, sources: 1, size: 28x29, npix 554, brick X: 88,116, Y: 4,33, one pixel: 99 4
Blob 2 finished, total: Wall: 1.35 s, CPU: 1.35 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143592 MB
Blob 8 of 12, id: 10, sources: 1, size: 22x22, npix 292, brick X: 67,89, Y: 225,247, one pixel: 78 225
Blob 9 of 12, id: 1, sources: 1, size: 16x23, npix 246, brick X: 0,16, Y: 9,32, one pixel: 5 9
Blob 7 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143592 MB
Blob 10 of 12, id: 9, sources: 1, size: 21x21, npix 241, brick X: 52,73, Y: 208,229, one pixel: 62 208
Blob 3 finished, total: Wall: 1.91 s, CPU: 1.91 s, VmPeak: 804 MB, VmSize: 712 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142048 MB
Blob 11 of 12, id: 2, sources: 1, size: 18x19, npix 198, brick X: 24,42, Y: 9,28, one pixel: 32 9
Blob 6 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142456 MB
Blob 12 of 12, id: 8, sources: 1, size: 18x19, npix 180, brick X: 106,124, Y: 198,217, one pixel: 114 198
Blob 10 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142456 MB
Blob 11 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142456 MB
Blob 8 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143592 MB
Blob 9 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 804 MB, VmSize: 712 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142048 MB
Blob 12 finished, total: Wall: 0.14 s, CPU: 0.14 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142628 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.27349, ee1=0.222361, ee2=-0.175098
Blob 1 finished, total: Wall: 3.74 s, CPU: 3.74 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143612 MB
Old catalog: 19
New catalog: 14
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/metrics/cus/blobs-custom-167890p57198.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/metrics/cus/all-models-custom-167890p57198.fits
Stage fitblobs : Wall: 4.18 s, CPU: 0.42 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage fitblobs finished: 2020-06-07T18:27:44.511935
Resources for stage fitblobs : 11.072 s worker CPU, 11.117 s worker Wall, Wall: 4.179 s, Cores in use: 2.75, Total efficiency (on 4 cores): 68.8 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T18:27:44.513811
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/tmp-legacysurvey-custom-167890p57198-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/tmp-legacysurvey-custom-167890p57198-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/tmp-legacysurvey-custom-167890p57198-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/tmp-legacysurvey-custom-167890p57198-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-resid.jpg
Stage coadds : Wall: 1.54 s, CPU: 0.70 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage coadds finished: 2020-06-07T18:27:46.053046
Resources for stage coadds : 1.828 s worker CPU, 2.151 s worker Wall, Wall: 1.540 s, Cores in use: 1.64, Total efficiency (on 4 cores): 41.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T18:27:46.054676
Cut to 1 unWISE tiles
Reading WISE tile 1689p575 band 2
Reading WISE tile 1689p575 band 1
Reading WISE tile 1689p575 band 4
Reading WISE tile 1689p575 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208336 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 795 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.193252 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 802 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.20352 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1689p575/unwise-1689p575-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 791 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208328 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/tmp-legacysurvey-custom-167890p57198-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/tmp-legacysurvey-custom-167890p57198-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.42 s, CPU: 0.46 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 201 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage wise_forced finished: 2020-06-07T18:27:48.474325
Resources for stage wise_forced : 4.792 s worker CPU, 6.368 s worker Wall, Wall: 2.421 s, Cores in use: 2.17, Total efficiency (on 4 cores): 54.2 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T18:27:48.476242
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/coadd/cus/custom-167890p57198/legacysurvey-custom-167890p57198-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/tractor-i/cus/tractor-custom-167890p57198.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/tractor/cus/tractor-custom-167890p57198.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC2559772/tractor/cus/brick-custom-167890p57198.sha256sum
Stage writecat : Wall: 1.04 s, CPU: 0.56 s, VmPeak: 1095 MB, VmSize: 967 MB, VmRSS: 203 MB, VmData: 228 MB, maxrss: 0.566536 MB
Stage writecat finished: 2020-06-07T18:27:49.519023
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.044 s, Cores in use: 0.54, Total efficiency (on 4 cores): 13.5 %
Stage writecat finished
All done: 22.047 s worker CPU, 39.981 s worker Wall, Wall: 20.198 s, Cores in use: 1.40, Total efficiency (on 4 cores): 34.9 %
Finished galaxy PGC2559772 in 0.380 minutes.