Started working on galaxy PGC2359851 at Sun Jun  7 17:00:30 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 103.47120000000001 50.0 --width 251 --height 251 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/PGC2359851-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/PGC2359851-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:00:31.817157
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '103.47120000000001', '50.0', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/PGC2359851-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/PGC2359851-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 103.47120000000001 50.0 --width 251 --height 251 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/PGC2359851-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/PGC2359851-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 103.47120000000001 50.0
Starting process 63981 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 63982 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 63984 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 63985 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:00:32.324524
Keeping 9 CCDs:
   k4m_170901_103917_ooi_zd_ls9.fits.fz k4m_170901_103917_ooi_zd_ls9-CCD2 z exptime 250.102 propid 2016A-0453 seeing 1.11 MJD 57997.444 object MzLS_649325_z
   k4m_160227_031932_ooi_zd_ls9.fits.fz k4m_160227_031932_ooi_zd_ls9-CCD1 z exptime 120.104 propid 2016A-0453 seeing 0.96 MJD 57445.139 object MzLS_650134_z
   k4m_160310_023834_ooi_zd_ls9.fits.fz k4m_160310_023834_ooi_zd_ls9-CCD2 z exptime 82.104 propid 2016A-0453 seeing 0.93 MJD 57457.110 object MzLS_648515_z
   ksb_170131_050714_ooi_g_ls9.fits.fz ksb_170131_050714_ooi_g_ls9-CCD4 g exptime 150.1 propid BASS seeing 1.49 MJD 57784.213 object 26111
   ksb_171127_085515_ooi_r_ls9.fits.fz ksb_171127_085515_ooi_r_ls9-CCD4 r exptime 160.744 propid BASS seeing 1.29 MJD 58084.372 object 26111
   ksb_160207_032439_ooi_r_ls9.fits.fz ksb_160207_032439_ooi_r_ls9-CCD2 r exptime 197.2 propid 2015A-0801 seeing 1.72 MJD 57425.142 object 26102
   ksb_180221_041749_ooi_g_ls9.fits.fz ksb_180221_041749_ooi_g_ls9-CCD2 g exptime 250.0 propid BASS seeing 1.69 MJD 58170.179 object 26102
   ksb_170214_031237_ooi_r_ls9.fits.fz ksb_170214_031237_ooi_r_ls9-CCD3 r exptime 132.3 propid BASS seeing 1.64 MJD 57798.134 object 26113
   ksb_180310_032047_ooi_g_ls9.fits.fz ksb_180310_032047_ooi_g_ls9-CCD3 g exptime 94.5 propid BASS seeing 1.39 MJD 58187.139 object 26113
Faked up EXPNUM 77840091
Faked up EXPNUM 77840091
Faked up EXPNUM 77840091
90prime get_fwhm: self.fwhm = 3.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 56 and amp range 0 2015 and image y 3284 3430 and amp range 2048 4095
Range in image: x 0 42 , y 0 147 (with image size 42 x 147)
dzp 0.019393893 -> scaling image by 1.0180229229717446
mosaic get_fwhm: self.fwhm = 4.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 248 500 and amp range 0 2047 and image y 3297 3549 and amp range 2040 4078
Range in image: x 0 253 , y 0 253 (with image size 253 x 253)
dzp 0.003927584 -> scaling image by 1.0036239891963392
mosaic get_fwhm: self.fwhm = 3.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2968 3228 and amp range 2048 4095 and image y 1633 1889 and amp range 0 2039
Range in image: x 0 261 , y 0 257 (with image size 261 x 257)
dzp 0.0072022504 -> scaling image by 1.0066555682883527
mosaic get_fwhm: self.fwhm = 3.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1834 2088 and amp range 0 2005 and image y 1385 1643 and amp range 0 2039
Range in image: x 0 172 , y 0 259 (with image size 255 x 259)
dzp -0.011066288 -> scaling image by 0.989859339076806
Found overlap: image x 1834 2088 and amp range 2006 4053 and image y 1385 1643 and amp range 0 2039
Range in image: x 172 255 , y 0 259 (with image size 255 x 259)
dzp 0.001388291 -> scaling image by 1.0012794811153327
Faked up EXPNUM 77980052
Faked up EXPNUM 77980052
Faked up EXPNUM 77980052
90prime get_fwhm: self.fwhm = 3.63
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2050 2196 and amp range 2016 4031 and image y 1237 1382 and amp range 0 2047
Range in image: x 0 147 , y 0 146 (with image size 147 x 146)
dzp -0.0023383768 -> scaling image by 0.9978485929508539
Faked up EXPNUM 74250040
Faked up EXPNUM 74250040
Faked up EXPNUM 74250040
90prime get_fwhm: self.fwhm = 3.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1838 1985 and amp range 0 2015 and image y 1707 1855 and amp range 0 2047
Range in image: x 0 148 , y 0 149 (with image size 148 x 149)
dzp -0.006045583 -> scaling image by 0.9944472857505693
Faked up EXPNUM 81700095
Faked up EXPNUM 81700095
Faked up EXPNUM 81700095
90prime get_fwhm: self.fwhm = 3.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1816 1962 and amp range 0 2015 and image y 1677 1825 and amp range 0 2047
Range in image: x 0 147 , y 0 149 (with image size 147 x 149)
dzp -0.0036920775 -> scaling image by 0.9966052462302274
Faked up EXPNUM 81870051
Faked up EXPNUM 81870051
Faked up EXPNUM 81870051
90prime get_fwhm: self.fwhm = 3.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2067 2212 and amp range 2016 4031 and image y 1240 1385 and amp range 0 2047
Range in image: x 0 146 , y 0 146 (with image size 146 x 146)
dzp -0.0012233759 -> scaling image by 0.9988738637196966
Stage tims : Wall: 6.33 s, CPU: 1.07 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 203 MB, maxrss: 0.566564 MB
Stage tims finished: 2020-06-07T17:00:38.657715
Faked up EXPNUM 80850144
Faked up EXPNUM 80850144
Faked up EXPNUM 80850144
90prime get_fwhm: self.fwhm = 2.85
Resources for stage tims : 3.490 s worker CPU, 13.836 s worker Wall, Wall: 6.334 s, Cores in use: 0.72, Total efficiency (on 4 cores): 18.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/PGC2359851-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/PGC2359851-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:00:38.681494
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01544.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01329.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01434.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01435.fits
Matched 16 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/metrics/cus/reference-custom-103471p50000.fits
Stage refs : Wall: 4.61 s, CPU: 4.16 s, VmPeak: 994 MB, VmSize: 988 MB, VmRSS: 219 MB, VmData: 251 MB, maxrss: 0.566564 MB
Stage refs finished: 2020-06-07T17:00:43.295934
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.615 s, Cores in use: 0.90, Total efficiency (on 4 cores): 22.5 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:00:43.297524
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/metrics/cus/outlier-mask-custom-103471p50000.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/metrics/cus/outliers-pre-custom-103471p50000.jpg
Image ksb_180310_032047_ooi_g_ls9-CCD3 g : masking 82 positive outlier pixels and 0 negative outlier pixels
Image ksb_170131_050714_ooi_g_ls9-CCD4 g : masking 95 positive outlier pixels and 0 negative outlier pixels
Image ksb_180221_041749_ooi_g_ls9-CCD2 g : masking 1105 positive outlier pixels and 0 negative outlier pixels
Image k4m_170901_103917_ooi_zd_ls9-CCD2 z : masking 523 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/metrics/cus/outlier-mask-custom-103471p50000.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/metrics/cus/outliers-post-custom-103471p50000.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/metrics/cus/outliers-masked-pos-custom-103471p50000.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/metrics/cus/outliers-masked-neg-custom-103471p50000.jpg
Stage outliers : Wall: 0.86 s, CPU: 0.63 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 230 MB, VmData: 260 MB, maxrss: 0.566564 MB
Stage outliers finished: 2020-06-07T17:00:44.152826
Resources for stage outliers : 0.695 s worker CPU, 0.697 s worker Wall, Wall: 0.856 s, Cores in use: 1.55, Total efficiency (on 4 cores): 38.7 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:00:44.154741
Stage halos : Wall: 0.30 s, CPU: 0.29 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 231 MB, VmData: 260 MB, maxrss: 0.566564 MB
Stage halos finished: 2020-06-07T17:00:44.450640
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.297 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.3 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T17:00:44.452455
PSF sigmas in coadd pixels: ['2.42', '2.75', '2.26']
Using average PSF sigma 2.4770617182938492
Gaussian PSF norm 0.11388282725881349 vs pixelized 0.09043469
average tim pixel scale / coadd scale: 1.7307116427878273
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.79', '2.67']
Using average PSF sigma 2.7305874516176996
Gaussian PSF norm 0.10330919509893555 vs pixelized 0.08603167
average tim pixel scale / coadd scale: 1.7296136174713552
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.81', '1.56', '1.51']
Using average PSF sigma 1.6263032757463927
Gaussian PSF norm 0.17345767913085622 vs pixelized 0.13720535
average tim pixel scale / coadd scale: 0.9909507690552082
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.15 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 233 MB, VmData: 261 MB, maxrss: 0.566564 MB
Stage fit_on_coadds finished: 2020-06-07T17:00:44.634897
Resources for stage fit_on_coadds : 0.158 s worker CPU, 0.163 s worker Wall, Wall: 0.184 s, Cores in use: 1.66, Total efficiency (on 4 cores): 41.5 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:00:44.637399
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 21 potential peaks
Of 21 potential peaks: 6 in veto map, 5 cut by saddle test, 0 cut by aper test, 10 kept
SED z : 10 new peaks
Found 12 potential peaks
Of 12 potential peaks: 12 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 9 potential peaks
Of 9 potential peaks: 8 in veto map, 0 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 20 potential peaks
Of 20 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 22 potential peaks
Of 22 potential peaks: 18 in veto map, 1 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 15 new sources
Median coadd sky for g : 7.683075e-05
Median coadd sky for r : -0.00024101682
Median coadd sky for z : -9.464696e-05
Stage srcs : Wall: 0.54 s, CPU: 0.49 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 233 MB, VmData: 261 MB, maxrss: 0.566564 MB
Stage srcs finished: 2020-06-07T17:00:45.180902
Resources for stage srcs : 0.108 s worker CPU, 0.108 s worker Wall, Wall: 0.545 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/PGC2359851-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/PGC2359851-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:00:45.194792
Blob 1 of 14, id: 5, sources: 3, size: 97x107, npix 7365, brick X: 82,179, Y: 72,179, one pixel: 118 72
Blob 2 of 14, id: 3, sources: 2, size: 51x77, npix 2413, brick X: 199,250, Y: 58,135, one pixel: 209 58
Blob 3 of 14, id: 10, sources: 2, size: 65x46, npix 1845, brick X: 61,126, Y: 186,232, one pixel: 102 186
Blob 4 of 14, id: 0, sources: 2, size: 53x43, npix 1733, brick X: 26,79, Y: 0,43, one pixel: 40 0
Blob 5 of 14, id: 9, sources: 3, size: 50x50, npix 1575, brick X: 201,251, Y: 181,231, one pixel: 233 181
Blob 3 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141288 MB
Blob 6 of 14, id: 4, sources: 1, size: 27x27, npix 484, brick X: 30,57, Y: 62,89, one pixel: 41 62
Blob 4 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.13952 MB
Blob 7 of 14, id: 1, sources: 1, size: 27x27, npix 481, brick X: 197,224, Y: 5,32, one pixel: 209 5
Blob 6 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.13952 MB
Blob 8 of 14, id: 12, sources: 1, size: 30x18, npix 375, brick X: 107,137, Y: 233,251, one pixel: 116 233
Blob 9 of 14, id: 7, sources: 1, size: 22x25, npix 343, brick X: 0,22, Y: 163,188, one pixel: 8 163
Blob 7 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.13952 MB
Blob 10 of 14, id: 11, sources: 1, size: 23x22, npix 314, brick X: 129,152, Y: 209,231, one pixel: 138 209
Blob 5 finished, total: Wall: 1.79 s, CPU: 1.79 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141288 MB
Blob 11 of 14, id: 2, sources: 1, size: 23x22, npix 295, brick X: 164,187, Y: 38,60, one pixel: 173 38
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 0.62 s, CPU: 0.61 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141288 MB
Blob 12 of 14, id: 13, sources: 1, size: 21x17, npix 226, brick X: 53,74, Y: 234,251, one pixel: 64 234
Blob 8 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.13952 MB
Blob 13 of 14, id: 8, sources: 1, size: 19x19, npix 199, brick X: 35,54, Y: 178,197, one pixel: 43 178
Blob 10 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141288 MB
Blob 14 of 14, id: 6, sources: 1, size: 17x17, npix 145, brick X: 175,192, Y: 86,103, one pixel: 183 86
Blob 11 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.13952 MB
Blob 13 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.13952 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.39448, ee1=0.00514018, ee2=-0.140926
Blob 1 finished, total: Wall: 3.75 s, CPU: 3.75 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143388 MB
Blob 2 finished, total: Wall: 3.84 s, CPU: 3.84 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143328 MB
Blob 12 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141288 MB
Blob 14 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.13952 MB
Old catalog: 36
New catalog: 22
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/metrics/cus/blobs-custom-103471p50000.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/metrics/cus/all-models-custom-103471p50000.fits
Stage fitblobs : Wall: 4.91 s, CPU: 0.34 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 233 MB, VmData: 261 MB, maxrss: 0.566564 MB
Stage fitblobs finished: 2020-06-07T17:00:50.102675
Resources for stage fitblobs : 15.320 s worker CPU, 15.378 s worker Wall, Wall: 4.909 s, Cores in use: 3.19, Total efficiency (on 4 cores): 79.8 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:00:50.104584
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/tmp-legacysurvey-custom-103471p50000-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/tmp-legacysurvey-custom-103471p50000-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/tmp-legacysurvey-custom-103471p50000-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/tmp-legacysurvey-custom-103471p50000-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-resid.jpg
Stage coadds : Wall: 1.45 s, CPU: 0.71 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.566564 MB
Stage coadds finished: 2020-06-07T17:00:51.558347
Resources for stage coadds : 1.963 s worker CPU, 2.148 s worker Wall, Wall: 1.455 s, Cores in use: 1.84, Total efficiency (on 4 cores): 45.9 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:00:51.560124
Cut to 1 unWISE tiles
Reading WISE tile 1045p499 band 4
Reading WISE tile 1045p499 band 1
Reading WISE tile 1045p499 band 2
Reading WISE tile 1045p499 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 808 MB, VmSize: 795 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.18786 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.20636 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 808 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208724 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/104/1045p499/unwise-1045p499-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.204384 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/tmp-legacysurvey-custom-103471p50000-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/tmp-legacysurvey-custom-103471p50000-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.40 s, CPU: 0.54 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.566564 MB
Stage wise_forced finished: 2020-06-07T17:00:53.962738
Resources for stage wise_forced : 4.546 s worker CPU, 5.946 s worker Wall, Wall: 2.404 s, Cores in use: 2.12, Total efficiency (on 4 cores): 52.9 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:00:53.964613
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/coadd/cus/custom-103471p50000/legacysurvey-custom-103471p50000-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/tractor-i/cus/tractor-custom-103471p50000.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/tractor/cus/tractor-custom-103471p50000.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/103/PGC2359851/tractor/cus/brick-custom-103471p50000.sha256sum
Stage writecat : Wall: 1.33 s, CPU: 0.52 s, VmPeak: 1130 MB, VmSize: 1002 MB, VmRSS: 237 MB, VmData: 261 MB, maxrss: 0.566564 MB
Stage writecat finished: 2020-06-07T17:00:55.294983
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.331 s, Cores in use: 0.39, Total efficiency (on 4 cores): 9.8 %
Stage writecat finished
All done: 26.284 s worker CPU, 38.278 s worker Wall, Wall: 22.982 s, Cores in use: 1.53, Total efficiency (on 4 cores): 38.3 %
Finished galaxy PGC2359851 in 0.424 minutes.