Started working on galaxy PGC2507877 at Sun Jun  7 17:12:57 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.05011050000002 55.60043 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/PGC2507877-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/PGC2507877-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:12:58.685787
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '243.05011050000002', '55.60043', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/PGC2507877-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/PGC2507877-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.05011050000002 55.60043 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/PGC2507877-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/PGC2507877-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 243.05011050000002 55.60043
Starting process 28560 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 28561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 28562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 28563 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:12:59.341409
Keeping 9 CCDs:
   k4m_160606_063553_ooi_zd_ls9.fits.fz k4m_160606_063553_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 1.02 MJD 57545.275 object MzLS_671534_z
   k4m_170411_113457_ooi_zd_ls9.fits.fz k4m_170411_113457_ooi_zd_ls9-CCD2 z exptime 80.104 propid 2016A-0453 seeing 0.78 MJD 57854.483 object MzLS_670822_z
   k4m_170528_092051_ooi_zd_ls9.fits.fz k4m_170528_092051_ooi_zd_ls9-CCD3 z exptime 116.104 propid 2016A-0453 seeing 1.52 MJD 57901.389 object MzLS_672243_z
   ksb_170523_071504_ooi_g_ls9.fits.fz ksb_170523_071504_ooi_g_ls9-CCD4 g exptime 137.76 propid 2015A-0801 seeing 1.71 MJD 57896.302 object 33633
   ksb_170501_083241_ooi_r_ls9.fits.fz ksb_170501_083241_ooi_r_ls9-CCD4 r exptime 55.608 propid BASS seeing 1.36 MJD 57874.356 object 33633
   ksb_170301_120531_ooi_g_ls9.fits.fz ksb_170301_120531_ooi_g_ls9-CCD3 g exptime 77.455 propid BASS seeing 1.46 MJD 57813.504 object 32562
   ksb_160713_061540_ooi_r_ls9.fits.fz ksb_160713_061540_ooi_r_ls9-CCD3 r exptime 241.8 propid BASS seeing 2.09 MJD 57582.261 object 32562
   ksb_160505_101620_ooi_g_ls9.fits.fz ksb_160505_101620_ooi_g_ls9-CCD2 g exptime 78.7 propid BASS seeing 1.36 MJD 57513.428 object 33621
   ksb_160531_072724_ooi_r_ls9.fits.fz ksb_160531_072724_ooi_r_ls9-CCD2 r exptime 60.0 propid BASS seeing 1.27 MJD 57539.311 object 33621
mosaic get_fwhm: self.fwhm = 5.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 897 1147 and amp range 0 2005 and image y 1410 1661 and amp range 0 2039
Range in image: x 0 251 , y 0 252 (with image size 251 x 252)
dzp 0.0013971253 -> scaling image by 1.0012876282438632
mosaic get_fwhm: self.fwhm = 3.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3597 3843 and amp range 2006 4053 and image y 785 1032 and amp range 0 2039
Range in image: x 0 247 , y 0 248 (with image size 247 x 248)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
mosaic get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1988 2239 and amp range 0 2047 and image y 1220 1470 and amp range 0 2039
Range in image: x 0 60 , y 0 251 (with image size 252 x 251)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
Found overlap: image x 1988 2239 and amp range 2048 4095 and image y 1220 1470 and amp range 0 2039
Range in image: x 60 252 , y 0 251 (with image size 252 x 251)
dzp 0.0044767857 -> scaling image by 1.004131784351374
Faked up EXPNUM 78960105
Faked up EXPNUM 78960105
Faked up EXPNUM 78960105
90prime get_fwhm: self.fwhm = 3.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1057 1199 and amp range 0 2015 and image y 3236 3380 and amp range 2048 4095
Range in image: x 0 143 , y 0 145 (with image size 143 x 145)
dzp 0.019393893 -> scaling image by 1.0180229229717446
Faked up EXPNUM 78130152
Faked up EXPNUM 78130152
Faked up EXPNUM 78130152
90prime get_fwhm: self.fwhm = 3.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1276 1419 and amp range 0 2015 and image y 1542 1685 and amp range 0 2047
Range in image: x 0 144 , y 0 144 (with image size 144 x 144)
dzp -0.036130503 -> scaling image by 0.9672701794860779
Faked up EXPNUM 78740182
Faked up EXPNUM 78740182
Faked up EXPNUM 78740182
90prime get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1069 1211 and amp range 0 2015 and image y 3231 3374 and amp range 2048 4095
Range in image: x 0 143 , y 0 144 (with image size 143 x 144)
dzp 0.01103811 -> scaling image by 1.0102183288830229
Faked up EXPNUM 75130135
Faked up EXPNUM 75130135
Faked up EXPNUM 75130135
90prime get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2998 3142 and amp range 2016 4031 and image y 1622 1768 and amp range 0 2047
Range in image: x 0 145 , y 0 147 (with image size 145 x 147)
dzp -0.008960029 -> scaling image by 0.9917814665476246
Faked up EXPNUM 75820060
Faked up EXPNUM 75820060
Faked up EXPNUM 75820060
90prime get_fwhm: self.fwhm = 4.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1282 1425 and amp range 0 2015 and image y 1544 1686 and amp range 0 2047
Range in image: x 0 144 , y 0 143 (with image size 144 x 143)
dzp -0.024507914 -> scaling image by 0.9776802328037623
Faked up EXPNUM 75390136
Faked up EXPNUM 75390136
Faked up EXPNUM 75390136
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2999 3143 and amp range 2016 4031 and image y 1621 1766 and amp range 0 2047
Range in image: x 0 145 , y 0 146 (with image size 145 x 146)
dzp -0.012503507 -> scaling image by 0.9885499019198392
Stage tims : Wall: 5.36 s, CPU: 1.05 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.566628 MB
Stage tims finished: 2020-06-07T17:13:04.699806
Resources for stage tims : 3.560 s worker CPU, 12.255 s worker Wall, Wall: 5.360 s, Cores in use: 0.86, Total efficiency (on 4 cores): 21.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/PGC2507877-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/PGC2507877-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:13:04.724209
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01168.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01073.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01074.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00983.fits
Matched 16 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/metrics/cus/reference-custom-243050p55600.fits
Stage refs : Wall: 2.30 s, CPU: 1.89 s, VmPeak: 972 MB, VmSize: 960 MB, VmRSS: 190 MB, VmData: 223 MB, maxrss: 0.566628 MB
Stage refs finished: 2020-06-07T17:13:07.026132
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.303 s, Cores in use: 0.82, Total efficiency (on 4 cores): 20.5 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:13:07.027656
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/metrics/cus/outlier-mask-custom-243050p55600.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/metrics/cus/outliers-pre-custom-243050p55600.jpg
Image ksb_170523_071504_ooi_g_ls9-CCD4 g : masking 60 positive outlier pixels and 0 negative outlier pixels
Image ksb_160713_061540_ooi_r_ls9-CCD3 r : masking 235 positive outlier pixels and 0 negative outlier pixels
Image k4m_170411_113457_ooi_zd_ls9-CCD2 z : masking 796 positive outlier pixels and 422 negative outlier pixels
Image k4m_170528_092051_ooi_zd_ls9-CCD3 z : masking 699 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/metrics/cus/outlier-mask-custom-243050p55600.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/metrics/cus/outliers-post-custom-243050p55600.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/metrics/cus/outliers-masked-pos-custom-243050p55600.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/metrics/cus/outliers-masked-neg-custom-243050p55600.jpg
Stage outliers : Wall: 1.25 s, CPU: 0.83 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 192 MB, VmData: 223 MB, maxrss: 0.566628 MB
Stage outliers finished: 2020-06-07T17:13:08.278466
Resources for stage outliers : 0.929 s worker CPU, 0.941 s worker Wall, Wall: 1.252 s, Cores in use: 1.40, Total efficiency (on 4 cores): 35.1 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:13:08.280230
Stage halos : Wall: 0.27 s, CPU: 0.25 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 192 MB, VmData: 223 MB, maxrss: 0.566628 MB
Stage halos finished: 2020-06-07T17:13:08.549132
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.270 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.6 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T17:13:08.550787
PSF sigmas in coadd pixels: ['2.78', '2.36', '2.22']
Using average PSF sigma 2.451318507052065
Gaussian PSF norm 0.11507879982235478 vs pixelized 0.092652366
average tim pixel scale / coadd scale: 1.7299019120178605
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.22', '3.39', '2.07']
Using average PSF sigma 2.558516199387369
Gaussian PSF norm 0.11025718416065733 vs pixelized 0.09591449
average tim pixel scale / coadd scale: 1.7295095435066419
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.66', '1.27', '2.47']
Using average PSF sigma 1.7975098860917538
Gaussian PSF norm 0.1569364340950716 vs pixelized 0.12559113
average tim pixel scale / coadd scale: 0.9908230343428334
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.17 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 195 MB, VmData: 224 MB, maxrss: 0.566628 MB
Stage fit_on_coadds finished: 2020-06-07T17:13:08.747736
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.252 s worker CPU, 0.268 s worker Wall, Wall: 0.198 s, Cores in use: 2.12, Total efficiency (on 4 cores): 53.1 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:13:08.750245
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 19 potential peaks
Of 19 potential peaks: 4 in veto map, 2 cut by saddle test, 0 cut by aper test, 13 kept
SED z : 13 new peaks
Found 55 potential peaks
Of 55 potential peaks: 45 in veto map, 5 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 42 potential peaks
Of 42 potential peaks: 38 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 69 potential peaks
Of 69 potential peaks: 58 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 60 potential peaks
Of 60 potential peaks: 52 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 22 new sources
Median coadd sky for g : 0.0006691636
Median coadd sky for r : 0.0011601812
Median coadd sky for z : -0.00037776472
Stage srcs : Wall: 0.65 s, CPU: 0.59 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 195 MB, VmData: 224 MB, maxrss: 0.566628 MB
Stage srcs finished: 2020-06-07T17:13:09.397851
Resources for stage srcs : 0.127 s worker CPU, 0.133 s worker Wall, Wall: 0.648 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/PGC2507877-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/PGC2507877-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:13:09.410845
Blob 1 of 12, id: 0, sources: 14, size: 234x220, npix 26750, brick X: 0,234, Y: 0,220, one pixel: 0 0
Blob 2 of 12, id: 9, sources: 1, size: 28x34, npix 590, brick X: 87,115, Y: 203,237, one pixel: 96 203
Blob 3 of 12, id: 10, sources: 1, size: 30x28, npix 557, brick X: 162,192, Y: 217,245, one pixel: 173 217
Blob 4 of 12, id: 6, sources: 1, size: 26x29, npix 511, brick X: 0,26, Y: 133,162, one pixel: 9 133
Blob 5 of 12, id: 4, sources: 1, size: 25x29, npix 440, brick X: 199,224, Y: 80,109, one pixel: 210 80
Blob 3 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.140024 MB
Blob 6 of 12, id: 5, sources: 1, size: 28x26, npix 436, brick X: 212,240, Y: 115,141, one pixel: 224 115
Blob 2 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139688 MB
Blob 7 of 12, id: 7, sources: 1, size: 26x27, npix 431, brick X: 19,45, Y: 179,206, one pixel: 30 179
Blob 4 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 803 MB, VmSize: 712 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.139956 MB
Blob 8 of 12, id: 11, sources: 1, size: 30x19, npix 394, brick X: 1,31, Y: 226,245, one pixel: 14 226
Blob 9 of 12, id: 1, sources: 1, size: 24x23, npix 349, brick X: 206,230, Y: 20,43, one pixel: 217 20
Blob 6 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141528 MB
Blob 10 of 12, id: 8, sources: 1, size: 22x21, npix 280, brick X: 145,167, Y: 196,217, one pixel: 155 196
Blob 5 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141704 MB
Blob 11 of 12, id: 3, sources: 1, size: 18x19, npix 189, brick X: 200,218, Y: 40,59, one pixel: 208 40
Blob 7 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 803 MB, VmSize: 712 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.139956 MB
Blob 12 of 12, id: 2, sources: 1, size: 15x17, npix 141, brick X: 230,245, Y: 36,53, one pixel: 238 36
Blob 8 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141528 MB
Blob 9 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141704 MB
Blob 10 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 712 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.139956 MB
Blob 12 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141704 MB
Blob 11 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141528 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.177794, ee1=0.0799978, ee2=-0.130592
Blob 1 finished, total: Wall: 8.93 s, CPU: 8.93 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 156 MB, VmData: 190 MB, maxrss: 0.160236 MB
Old catalog: 25
New catalog: 18
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/metrics/cus/blobs-custom-243050p55600.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/metrics/cus/all-models-custom-243050p55600.fits
Stage fitblobs : Wall: 9.38 s, CPU: 0.40 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 197 MB, VmData: 224 MB, maxrss: 0.566628 MB
Stage fitblobs finished: 2020-06-07T17:13:18.790484
Resources for stage fitblobs : 13.048 s worker CPU, 13.124 s worker Wall, Wall: 9.381 s, Cores in use: 1.43, Total efficiency (on 4 cores): 35.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:13:18.792273
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/tmp-legacysurvey-custom-243050p55600-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/tmp-legacysurvey-custom-243050p55600-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/tmp-legacysurvey-custom-243050p55600-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/tmp-legacysurvey-custom-243050p55600-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-resid.jpg
Stage coadds : Wall: 1.34 s, CPU: 0.65 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 197 MB, VmData: 224 MB, maxrss: 0.566628 MB
Stage coadds finished: 2020-06-07T17:13:20.130935
Resources for stage coadds : 1.860 s worker CPU, 1.975 s worker Wall, Wall: 1.340 s, Cores in use: 1.88, Total efficiency (on 4 cores): 46.9 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:13:20.132553
Cut to 1 unWISE tiles
Reading WISE tile 2426p560 band 1
Reading WISE tile 2426p560 band 4
Reading WISE tile 2426p560 band 3
Reading WISE tile 2426p560 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 795 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.186984 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 806 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.203708 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207356 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2426p560/unwise-2426p560-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 148 MB, VmData: 173 MB, maxrss: 0.212376 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/tmp-legacysurvey-custom-243050p55600-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/tmp-legacysurvey-custom-243050p55600-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.16 s, CPU: 0.39 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 198 MB, VmData: 224 MB, maxrss: 0.566628 MB
Stage wise_forced finished: 2020-06-07T17:13:22.290432
Resources for stage wise_forced : 4.593 s worker CPU, 5.728 s worker Wall, Wall: 2.159 s, Cores in use: 2.31, Total efficiency (on 4 cores): 57.7 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:13:22.292257
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/coadd/cus/custom-243050p55600/legacysurvey-custom-243050p55600-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/tractor-i/cus/tractor-custom-243050p55600.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/tractor/cus/tractor-custom-243050p55600.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2507877/tractor/cus/brick-custom-243050p55600.sha256sum
Stage writecat : Wall: 0.71 s, CPU: 0.49 s, VmPeak: 1093 MB, VmSize: 965 MB, VmRSS: 200 MB, VmData: 224 MB, maxrss: 0.566628 MB
Stage writecat finished: 2020-06-07T17:13:23.004752
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.714 s, Cores in use: 0.69, Total efficiency (on 4 cores): 17.2 %
Stage writecat finished
All done: 24.370 s worker CPU, 34.427 s worker Wall, Wall: 23.673 s, Cores in use: 1.31, Total efficiency (on 4 cores): 32.9 %
Finished galaxy PGC2507877 in 0.433 minutes.