Started working on galaxy PGC2210284 at Sun Jun  7 17:13:55 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.2806255 42.9776944 --width 379 --height 379 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/PGC2210284-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/PGC2210284-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:13:56.401287
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '278.2806255', '42.9776944', '--width', '379', '--height', '379', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/PGC2210284-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/PGC2210284-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.2806255 42.9776944 --width 379 --height 379 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/PGC2210284-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/PGC2210284-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 278.2806255 42.9776944
Starting process 14273 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 14277 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 14282 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057464 MB
Starting process 14293 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:13:56.977638
Keeping 9 CCDs:
   k4m_160503_110406_ooi_zd_ls9.fits.fz k4m_160503_110406_ooi_zd_ls9-CCD3 z exptime 80.102 propid 2016A-0453 seeing 0.93 MJD 57511.461 object MzLS_619297_z
   k4m_170805_081224_ooi_zd_ls9.fits.fz k4m_170805_081224_ooi_zd_ls9-CCD2 z exptime 229.105 propid 2016A-0453 seeing 1.13 MJD 57970.342 object MzLS_618380_z
   k4m_160509_105555_ooi_zd_ls9.fits.fz k4m_160509_105555_ooi_zd_ls9-CCD4 z exptime 80.105 propid 2016A-0453 seeing 0.81 MJD 57517.455 object MzLS_617459_z
   ksb_160516_102738_ooi_r_ls9.fits.fz ksb_160516_102738_ooi_r_ls9-CCD2 r exptime 82.5 propid BASS seeing 1.55 MJD 57524.436 object 18762
   ksb_160604_092403_ooi_r_ls9.fits.fz ksb_160604_092403_ooi_r_ls9-CCD4 r exptime 57.3 propid BASS seeing 1.26 MJD 57543.392 object 18771
   ksb_160603_100938_ooi_g_ls9.fits.fz ksb_160603_100938_ooi_g_ls9-CCD4 g exptime 73.6 propid BASS seeing 1.24 MJD 57542.423 object 18771
   ksb_160703_084006_ooi_g_ls9.fits.fz ksb_160703_084006_ooi_g_ls9-CCD2 g exptime 76.5 propid BASS seeing 1.29 MJD 57572.361 object 18762
   ksb_160703_082216_ooi_g_ls9.fits.fz ksb_160703_082216_ooi_g_ls9-CCD4 g exptime 71.7 propid BASS seeing 1.13 MJD 57572.349 object 18772
   ksb_160516_102954_ooi_r_ls9.fits.fz ksb_160516_102954_ooi_r_ls9-CCD4 r exptime 78.8 propid BASS seeing 1.51 MJD 57524.437 object 18772
mosaic get_fwhm: self.fwhm = 4.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 411 792 and amp range 0 2047 and image y 2030 2413 and amp range 0 2039
Range in image: x 0 382 , y 0 10 (with image size 382 x 384)
dzp 0.007023884 -> scaling image by 1.0064902069278665
Found overlap: image x 411 792 and amp range 0 2047 and image y 2030 2413 and amp range 2040 4078
Range in image: x 0 382 , y 10 384 (with image size 382 x 384)
dzp 0.003927584 -> scaling image by 1.0036239891963392
mosaic get_fwhm: self.fwhm = 3.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1986 2371 and amp range 0 2005 and image y 3091 3484 and amp range 2040 4078
Range in image: x 0 20 , y 0 394 (with image size 386 x 394)
dzp 0.0022078273 -> scaling image by 1.0020355530120029
Found overlap: image x 1986 2371 and amp range 2006 4053 and image y 3091 3484 and amp range 2040 4078
Range in image: x 20 386 , y 0 394 (with image size 386 x 394)
dzp -0.0026360443 -> scaling image by 0.99757505842151
Faked up EXPNUM 75240159
Faked up EXPNUM 75240159
Faked up EXPNUM 75240159
90prime get_fwhm: self.fwhm = 3.41
WARNING: image median 0.025531098 is more than 1 sigma away from zero!
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1928 2151 and amp range 0 2015 and image y 81 307 and amp range 0 2047
Range in image: x 0 88 , y 0 227 (with image size 224 x 227)
dzp -0.006045583 -> scaling image by 0.9944472857505693
Found overlap: image x 1928 2151 and amp range 2016 4031 and image y 81 307 and amp range 0 2047
Range in image: x 88 224 , y 0 227 (with image size 224 x 227)
dzp -0.012503507 -> scaling image by 0.9885499019198392
mosaic get_fwhm: self.fwhm = 3.11
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3120 3510 and amp range 2048 4095 and image y 857 1240 and amp range 0 2021
Range in image: x 0 391 , y 0 384 (with image size 391 x 384)
dzp -0.0006399284 -> scaling image by 0.9994107778325068
Faked up EXPNUM 75430172
Faked up EXPNUM 75430172
Faked up EXPNUM 75430172
90prime get_fwhm: self.fwhm = 2.79
WARNING: image median 0.027096566 is more than 1 sigma away from zero!
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 22 242 and amp range 0 2015 and image y 1668 1888 and amp range 0 2047
Range in image: x 0 221 , y 0 221 (with image size 221 x 221)
dzp 0.009781551 -> scaling image by 1.0090498455107675
Faked up EXPNUM 75420156
Faked up EXPNUM 75420156
Faked up EXPNUM 75420156
90prime get_fwhm: self.fwhm = 2.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 29 249 and amp range 0 2015 and image y 1651 1871 and amp range 0 2047
Range in image: x 0 221 , y 0 221 (with image size 221 x 221)
dzp 0.009539392 -> scaling image by 1.0088248156909383
Faked up EXPNUM 75720078
Faked up EXPNUM 75720078
Faked up EXPNUM 75720078
90prime get_fwhm: self.fwhm = 2.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1923 2145 and amp range 0 2015 and image y 81 307 and amp range 0 2047
Range in image: x 0 93 , y 0 227 (with image size 223 x 227)
dzp -0.008523628 -> scaling image by 0.992180183483648
Found overlap: image x 1923 2145 and amp range 2016 4031 and image y 81 307 and amp range 0 2047
Range in image: x 93 223 , y 0 227 (with image size 223 x 227)
dzp -0.008960029 -> scaling image by 0.9917814665476246
Faked up EXPNUM 75720070
Faked up EXPNUM 75720070
Faked up EXPNUM 75720070
90prime get_fwhm: self.fwhm = 2.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2008 2230 and amp range 0 2015 and image y 3652 3874 and amp range 2048 4095
Range in image: x 0 8 , y 0 223 (with image size 223 x 223)
dzp 0.009255477 -> scaling image by 1.0085610475070432
Found overlap: image x 2008 2230 and amp range 2016 4031 and image y 3652 3874 and amp range 2048 4095
Range in image: x 8 223 , y 0 223 (with image size 223 x 223)
dzp 0.0013913503 -> scaling image by 1.001282302423891
Faked up EXPNUM 75240160
Faked up EXPNUM 75240160
Faked up EXPNUM 75240160
90prime get_fwhm: self.fwhm = 3.33
WARNING: image median 0.027234677 is more than 1 sigma away from zero!
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2017 2238 and amp range 2016 4031 and image y 3658 3879 and amp range 2048 4095
Range in image: x 0 222 , y 0 222 (with image size 222 x 222)
dzp -0.0036899033 -> scaling image by 0.9966072419211972
Stage tims : Wall: 7.33 s, CPU: 0.99 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.566512 MB
Stage tims finished: 2020-06-07T17:14:04.309199
Resources for stage tims : 3.580 s worker CPU, 16.133 s worker Wall, Wall: 7.333 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/PGC2210284-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/PGC2210284-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:14:04.331986
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01832.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02083.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01956.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01955.fits
Matched 4 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/metrics/cus/reference-custom-278280p42977.fits
Stage refs : Wall: 7.97 s, CPU: 7.35 s, VmPeak: 1023 MB, VmSize: 1017 MB, VmRSS: 253 MB, VmData: 284 MB, maxrss: 0.566512 MB
Stage refs finished: 2020-06-07T17:14:12.298010
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.967 s, Cores in use: 0.92, Total efficiency (on 4 cores): 23.1 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:14:12.299533
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/metrics/cus/outlier-mask-custom-278280p42977.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/metrics/cus/outliers-pre-custom-278280p42977.jpg
Image ksb_160703_084006_ooi_g_ls9-CCD2 g : masking 320 positive outlier pixels and 0 negative outlier pixels
Image ksb_160516_102738_ooi_r_ls9-CCD2 r : masking 326 positive outlier pixels and 0 negative outlier pixels
Image k4m_160503_110406_ooi_zd_ls9-CCD3 z : masking 3156 positive outlier pixels and 0 negative outlier pixels
Image k4m_160509_105555_ooi_zd_ls9-CCD4 z : masking 361 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/metrics/cus/outlier-mask-custom-278280p42977.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/metrics/cus/outliers-post-custom-278280p42977.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/metrics/cus/outliers-masked-pos-custom-278280p42977.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/metrics/cus/outliers-masked-neg-custom-278280p42977.jpg
Stage outliers : Wall: 1.56 s, CPU: 0.96 s, VmPeak: 1027 MB, VmSize: 1027 MB, VmRSS: 280 MB, VmData: 309 MB, maxrss: 0.566512 MB
Stage outliers finished: 2020-06-07T17:14:13.856867
Resources for stage outliers : 1.819 s worker CPU, 1.868 s worker Wall, Wall: 1.558 s, Cores in use: 1.78, Total efficiency (on 4 cores): 44.6 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:14:13.858665
Stage halos : Wall: 0.21 s, CPU: 0.20 s, VmPeak: 1027 MB, VmSize: 1027 MB, VmRSS: 280 MB, VmData: 309 MB, maxrss: 0.566512 MB
Stage halos finished: 2020-06-07T17:14:14.066693
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.209 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T17:14:14.068470
PSF sigmas in coadd pixels: ['2.01', '2.10', '1.83']
Using average PSF sigma 1.9799324954454394
Gaussian PSF norm 0.1424769745548387 vs pixelized 0.12540632
average tim pixel scale / coadd scale: 1.7296895651388486
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.51', '2.05', '2.45']
Using average PSF sigma 2.3384378481235153
Gaussian PSF norm 0.12063386332899366 vs pixelized 0.09654072
average tim pixel scale / coadd scale: 1.7298904482189934
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.51', '1.83', '1.31']
Using average PSF sigma 1.5531454029216494
Gaussian PSF norm 0.18162806344030935 vs pixelized 0.14761014
average tim pixel scale / coadd scale: 0.9909217096580804
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 1.36 s, CPU: 0.30 s, VmPeak: 1027 MB, VmSize: 1027 MB, VmRSS: 282 MB, VmData: 309 MB, maxrss: 0.566512 MB
Stage fit_on_coadds finished: 2020-06-07T17:14:15.430394
Resources for stage fit_on_coadds : 0.390 s worker CPU, 0.422 s worker Wall, Wall: 1.363 s, Cores in use: 0.51, Total efficiency (on 4 cores): 12.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:14:15.433019
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 173 potential peaks
Of 173 potential peaks: 106 in veto map, 14 cut by saddle test, 0 cut by aper test, 53 kept
SED z : 53 new peaks
Found 249 potential peaks
Of 249 potential peaks: 241 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 333 potential peaks
Of 333 potential peaks: 321 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 354 potential peaks
Of 354 potential peaks: 333 in veto map, 16 cut by saddle test, 0 cut by aper test, 5 kept
SED Flat : 5 new peaks
Found 403 potential peaks
Of 403 potential peaks: 381 in veto map, 18 cut by saddle test, 1 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 63 new sources
Median coadd sky for g : 0.0007410584
Median coadd sky for r : 0.0016768709
Median coadd sky for z : -0.0001725939
Stage srcs : Wall: 1.30 s, CPU: 1.22 s, VmPeak: 1027 MB, VmSize: 1027 MB, VmRSS: 282 MB, VmData: 309 MB, maxrss: 0.566512 MB
Stage srcs finished: 2020-06-07T17:14:16.734678
Resources for stage srcs : 0.222 s worker CPU, 0.237 s worker Wall, Wall: 1.303 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/PGC2210284-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/PGC2210284-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:14:16.756207
Blob 1 of 7, id: 0, sources: 78, size: 379x379, npix 105041, brick X: 0,379, Y: 0,379, one pixel: 59 0
Blob 2 of 7, id: 5, sources: 1, size: 31x21, npix 482, brick X: 125,156, Y: 358,379, one pixel: 140 358
Blob 3 of 7, id: 6, sources: 1, size: 28x20, npix 374, brick X: 48,76, Y: 359,379, one pixel: 61 359
Blob 4 of 7, id: 3, sources: 1, size: 19x24, npix 324, brick X: 360,379, Y: 173,197, one pixel: 369 173
Blob 5 of 7, id: 4, sources: 1, size: 21x24, npix 294, brick X: 6,27, Y: 354,378, one pixel: 16 354
Blob 6 of 7, id: 1, sources: 1, size: 20x17, npix 213, brick X: 128,148, Y: 0,17, one pixel: 133 0
Blob 4 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 179 MB, maxrss: 0.141616 MB
Blob 7 of 7, id: 2, sources: 1, size: 20x14, npix 196, brick X: 173,193, Y: 0,14, one pixel: 176 0
Blob 2 finished, total: Wall: 0.50 s, CPU: 0.46 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141264 MB
Blob 3 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143632 MB
Blob 6 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141264 MB
Blob 5 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143616 MB
Blob 7 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143632 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.24313, 42.98305), pm (9.1, -15.3), parallax 1.688 with NanoMaggies: g=14.3, r=13.8, z=13.6
Reset brightness to NanoMaggies: g=14.3, r=13.8, z=13.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.29983, 42.96966), pm (-1.4, 4.6), parallax 0.594 with NanoMaggies: g=20, r=20.5, z=18
Reset brightness to NanoMaggies: g=17, r=16.4, z=16.2
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.78794, ee1=-0.0353001, ee2=-0.232727
Measuring 25 iterative sources
Blob 1 finished, total: Wall: 83.02 s, CPU: 83.02 s, VmPeak: 812 MB, VmSize: 777 MB, VmRSS: 214 MB, VmData: 243 MB, maxrss: 0.219256 MB
Old catalog: 93
New catalog: 97
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/metrics/cus/blobs-custom-278280p42977.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/metrics/cus/all-models-custom-278280p42977.fits
Stage fitblobs : Wall: 83.80 s, CPU: 0.66 s, VmPeak: 1027 MB, VmSize: 1027 MB, VmRSS: 287 MB, VmData: 313 MB, maxrss: 0.566512 MB
Stage fitblobs finished: 2020-06-07T17:15:40.552706
Resources for stage fitblobs : 85.789 s worker CPU, 85.921 s worker Wall, Wall: 83.798 s, Cores in use: 1.03, Total efficiency (on 4 cores): 25.8 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:15:40.555641
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/tmp-legacysurvey-custom-278280p42977-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/tmp-legacysurvey-custom-278280p42977-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/tmp-legacysurvey-custom-278280p42977-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/tmp-legacysurvey-custom-278280p42977-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-resid.jpg
Stage coadds : Wall: 2.09 s, CPU: 0.70 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 293 MB, VmData: 319 MB, maxrss: 0.566512 MB
Stage coadds finished: 2020-06-07T17:15:42.645710
Resources for stage coadds : 4.140 s worker CPU, 4.241 s worker Wall, Wall: 2.091 s, Cores in use: 2.31, Total efficiency (on 4 cores): 57.9 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:15:42.647299
Cut to 1 unWISE tiles
Reading WISE tile 2791p424 band 1
Reading WISE tile 2791p424 band 2
Reading WISE tile 2791p424 band 3
Reading WISE tile 2791p424 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.23 s, CPU: 0.32 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 149 MB, VmData: 187 MB, maxrss: 0.213116 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.74 s, CPU: 1.20 s, VmPeak: 1064 MB, VmSize: 1000 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.192172 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.18 s, CPU: 0.39 s, VmPeak: 1032 MB, VmSize: 1032 MB, VmRSS: 189 MB, VmData: 222 MB, maxrss: 0.247488 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2791p424/unwise-2791p424-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.18 s, CPU: 0.49 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 151 MB, VmData: 187 MB, maxrss: 0.213148 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/tmp-legacysurvey-custom-278280p42977-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/tmp-legacysurvey-custom-278280p42977-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.45 s, CPU: 0.66 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 293 MB, VmData: 319 MB, maxrss: 0.566512 MB
Stage wise_forced finished: 2020-06-07T17:15:46.099795
Resources for stage wise_forced : 6.629 s worker CPU, 8.496 s worker Wall, Wall: 3.454 s, Cores in use: 2.11, Total efficiency (on 4 cores): 52.7 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:15:46.101760
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/coadd/cus/custom-278280p42977/legacysurvey-custom-278280p42977-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/tractor-i/cus/tractor-custom-278280p42977.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/tractor/cus/tractor-custom-278280p42977.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2210284/tractor/cus/brick-custom-278280p42977.sha256sum
Stage writecat : Wall: 1.61 s, CPU: 0.88 s, VmPeak: 1165 MB, VmSize: 1037 MB, VmRSS: 295 MB, VmData: 319 MB, maxrss: 0.566512 MB
Stage writecat finished: 2020-06-07T17:15:47.709546
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.609 s, Cores in use: 0.55, Total efficiency (on 4 cores): 13.7 %
Stage writecat finished
All done: 102.571 s worker CPU, 117.321 s worker Wall, Wall: 110.738 s, Cores in use: 1.05, Total efficiency (on 4 cores): 26.3 %
Finished galaxy PGC2210284 in 1.880 minutes.