Started working on galaxy PGC2549223 at Wed Aug  5 22:14:58 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.94040099999995 56.8355179 --width 405 --height 405 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T22:14:59.061696
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.94040099999995', '56.8355179', '--width', '405', '--height', '405', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.94040099999995 56.8355179 --width 405 --height 405 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 273.94040099999995 56.8355179
Starting process 29071 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 29072 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 29073 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 29074 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 29075 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 29076 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 29077 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 29078 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 29079 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 29080 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 29081 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 29083 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 29084 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 29085 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 29086 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 29082 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T22:14:59.529063
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  k4m_160603_090801_ooi_zd_ls9-CCD2 z expnum 92996 exptime 80.103 propid 2016A-0453 seeing 0.96 MJD 57542.381 object MzLS_675074_z 
    mosaic/CP/V4.3/CP20160602/k4m_160603_090801_ooi_zd_ls9.fits.fz
  k4m_170906_063018_ooi_zd_ls9-CCD3 z expnum 138513 exptime 100.105 propid 2016A-0453 seeing 1.06 MJD 58002.271 object MzLS_676452_z 
    mosaic/CP/V4.3/CP20170905/k4m_170906_063018_ooi_zd_ls9.fits.fz
  k4m_160604_084945_ooi_zd_ls9-CCD4 z expnum 93256 exptime 80.104 propid 2016A-0453 seeing 0.93 MJD 57543.368 object MzLS_675765_z 
    mosaic/CP/V4.3/CP20160603/k4m_160604_084945_ooi_zd_ls9.fits.fz
  ksb_170622_101613_ooi_r_ls9-CCD3 r expnum 79260135 exptime 125.19 propid 2015A-0801 seeing 1.33 MJD 57926.428 object 34843 
    90prime/CP/V2.3/CP20170621/ksb_170622_101613_ooi_r_ls9.fits.fz
  ksb_170523_110922_ooi_g_ls9-CCD3 g expnum 78960196 exptime 167.16 propid 2015A-0801 seeing 1.89 MJD 57896.465 object 34843 
    90prime/CP/V2.3/CP20170522/ksb_170523_110922_ooi_g_ls9.fits.fz
  ksb_160708_094606_ooi_g_ls9-CCD2 g expnum 75770130 exptime 161.7 propid BASS seeing 1.67 MJD 57577.407 object 34832 
    90prime/CP/V2.3/CP20160707/ksb_160708_094606_ooi_g_ls9.fits.fz
  ksb_170731_052409_ooi_r_ls9-CCD2 r expnum 79650078 exptime 122.0 propid BASS seeing 1.20 MJD 57965.225 object 34832 
    90prime/CP/V2.3/CP20170730/ksb_170731_052409_ooi_r_ls9.fits.fz
  ksb_180515_100524_ooi_g_ls9-CCD2 g expnum 82530150 exptime 95.159 propid NOTBASS seeing 1.43 MJD 58253.420 object 34831 
    90prime/CP/V2.3/CP20180514/ksb_180515_100524_ooi_g_ls9.fits.fz
  ksb_170616_102539_ooi_r_ls9-CCD2 r expnum 79200168 exptime 146.4 propid BASS seeing 1.20 MJD 57920.434 object 34831 
    90prime/CP/V2.3/CP20170615/ksb_170616_102539_ooi_r_ls9.fits.fz
Faked up EXPNUM 79200168
Faked up EXPNUM 79200168
Faked up EXPNUM 79200168
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1109 1347 and amp range 0 2015 and image y 1495 1734 and amp range 0 2047
Range in image: x 0 239 , y 0 240 (with image size 239 x 240)
dzp 0.005335051 -> scaling image by 1.0049258559887364
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75770130
Faked up EXPNUM 75770130
Faked up EXPNUM 75770130
90prime get_fwhm: self.fwhm = 3.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3094 3331 and amp range 2016 4031 and image y 3458 3695 and amp range 2048 4095
Range in image: x 0 238 , y 0 238 (with image size 238 x 238)
dzp 0.0026774607 -> scaling image by 1.002469075566243
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79650078
Faked up EXPNUM 79650078
Faked up EXPNUM 79650078
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Faked up EXPNUM 79260135
Faked up EXPNUM 79260135
Faked up EXPNUM 79260135
90prime get_fwhm: self.fwhm = 2.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3101 3338 and amp range 2016 4031 and image y 3469 3706 and amp range 2048 4095
Range in image: x 0 238 , y 0 238 (with image size 238 x 238)
Found overlap: image x 3333 3569 and amp range 2016 4031 and image y 3046 3283 and amp range 2048 4095
dzp 0.021366077 -> scaling image by 1.0198737893800265
Range in image: x 0 237 , y 0 238 (with image size 237 x 238)
dzp -0.035697103 -> scaling image by 0.9676563679910417
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 82530150
Faked up EXPNUM 82530150
Faked up EXPNUM 82530150
90prime get_fwhm: self.fwhm = 3.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1050 1288 and amp range 0 2015 and image y 1475 1715 and amp range 0 2047
Range in image: x 0 239 , y 0 241 (with image size 239 x 241)
dzp -0.0036920775 -> scaling image by 0.9966052462302274
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1619 2031 and amp range 0 2005 and image y 2598 3018 and amp range 2040 4078
Range in image: x 0 387 , y 0 421 (with image size 413 x 421)
dzp 0.01523814 -> scaling image by 1.014133796220052
Found overlap: image x 1619 2031 and amp range 2006 4053 and image y 2598 3018 and amp range 2040 4078
Range in image: x 387 413 , y 0 421 (with image size 413 x 421)
dzp 0.0056365696 -> scaling image by 1.005204971477435
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 96 504 and amp range 0 2047 and image y 1594 2003 and amp range 0 2021
Range in image: x 0 409 , y 0 410 (with image size 409 x 410)
dzp 0.005139143 -> scaling image by 1.0047445456970268
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78960196
Faked up EXPNUM 78960196
Faked up EXPNUM 78960196
90prime get_fwhm: self.fwhm = 4.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3347 3583 and amp range 2016 4031 and image y 3058 3294 and amp range 2048 4095
Range in image: x 0 237 , y 0 237 (with image size 237 x 237)
dzp -0.02530836 -> scaling image by 0.9769597156943128
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.71
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2790 3203 and amp range 2048 4095 and image y 3165 3575 and amp range 2040 4078
Range in image: x 0 414 , y 0 411 (with image size 414 x 411)
dzp -0.009154885 -> scaling image by 0.9916034885139223
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 7.91 s, CPU: 0.87 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 181 MB, VmData: 213 MB, maxrss: 0.184976 MB
Stage tims finished: 2020-08-05T22:15:07.435926
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.804 s worker CPU, 33.095 s worker Wall, Wall: 7.908 s, Cores in use: 0.84, Total efficiency (on 16 cores): 5.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T22:15:08.041290
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01082.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00990.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00991.fits
Matched 6 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/metrics/cus/reference-custom-273940p56835.fits
Stage refs : Wall: 15.73 s, CPU: 3.64 s, VmPeak: 1005 MB, VmSize: 999 MB, VmRSS: 225 MB, VmData: 255 MB, maxrss: 0.230372 MB
Stage refs finished: 2020-08-05T22:15:23.770287
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 15.731 s, Cores in use: 0.23, Total efficiency (on 16 cores): 1.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T22:15:23.942247
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/metrics/cus/outlier-mask-custom-273940p56835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/metrics/cus/outliers-pre-custom-273940p56835.jpg
Image ksb_170616_102539_ooi_r_ls9-CCD2 r : masking 209 positive outlier pixels and 0 negative outlier pixels
Image k4m_160604_084945_ooi_zd_ls9-CCD4 z : masking 1038 positive outlier pixels and 0 negative outlier pixels
Image k4m_170906_063018_ooi_zd_ls9-CCD3 z : masking 251 positive outlier pixels and 0 negative outlier pixels
Image k4m_160603_090801_ooi_zd_ls9-CCD2 z : masking 236 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/metrics/cus/outlier-mask-custom-273940p56835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/metrics/cus/outliers-post-custom-273940p56835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/metrics/cus/outliers-masked-pos-custom-273940p56835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/metrics/cus/outliers-masked-neg-custom-273940p56835.jpg
Stage outliers : Wall: 1.84 s, CPU: 1.08 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.259316 MB
Stage outliers finished: 2020-08-05T22:15:25.785461
Resources for stage outliers : 2.118 s worker CPU, 2.470 s worker Wall, Wall: 1.845 s, Cores in use: 1.73, Total efficiency (on 16 cores): 10.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T22:15:25.813221
Stage halos : Wall: 0.29 s, CPU: 0.28 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.259576 MB
Stage halos finished: 2020-08-05T22:15:26.103028
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.291 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T22:15:26.244194
PSF sigmas in coadd pixels: ['3.07', '2.72', '2.32']
Using average PSF sigma 2.7014068208613224
Gaussian PSF norm 0.10442514233525718 vs pixelized 0.08890104
average tim pixel scale / coadd scale: 1.7298494584730448
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.16', '1.95', '1.95']
Using average PSF sigma 2.0185152581128825
Gaussian PSF norm 0.13975360881721036 vs pixelized 0.11585836
average tim pixel scale / coadd scale: 1.7291167084454693
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.56', '1.72', '1.51']
Using average PSF sigma 1.598111371684271
Gaussian PSF norm 0.17651760495050775 vs pixelized 0.14875017
average tim pixel scale / coadd scale: 0.9909140115838412
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.36 s, CPU: 0.32 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 257 MB, VmData: 282 MB, maxrss: 0.263204 MB
Stage fit_on_coadds finished: 2020-08-05T22:15:26.606635
Resources for stage fit_on_coadds : 0.441 s worker CPU, 0.441 s worker Wall, Wall: 0.364 s, Cores in use: 2.10, Total efficiency (on 16 cores): 13.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T22:15:26.678120
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 70 potential peaks
Of 70 potential peaks: 28 in veto map, 7 cut by saddle test, 0 cut by aper test, 35 kept
SED z : 35 new peaks
Found 121 potential peaks
Of 121 potential peaks: 107 in veto map, 9 cut by saddle test, 1 cut by aper test, 4 kept
SED r : 4 new peaks
Found 62 potential peaks
Of 62 potential peaks: 58 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 128 potential peaks
Of 128 potential peaks: 105 in veto map, 12 cut by saddle test, 1 cut by aper test, 10 kept
SED Flat : 10 new peaks
Found 128 potential peaks
Of 128 potential peaks: 113 in veto map, 14 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 50 new sources
Median coadd sky for g : 0.0002482034
Median coadd sky for r : 0.0006610023
Median coadd sky for z : 4.5624492e-05
Stage srcs : Wall: 0.94 s, CPU: 0.88 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 258 MB, VmData: 282 MB, maxrss: 0.263784 MB
Stage srcs finished: 2020-08-05T22:15:27.620747
Resources for stage srcs : 0.182 s worker CPU, 0.182 s worker Wall, Wall: 0.944 s, Cores in use: 1.12, Total efficiency (on 16 cores): 7.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T22:15:27.648233
Blob 1 of 30, id: 11, sources: 25, size: 338x306, npix 45996, brick X: 13,351, Y: 84,390, one pixel: 209 84
Blob 2 of 30, id: 17, sources: 5, size: 70x113, npix 3961, brick X: 335,405, Y: 182,295, one pixel: 374 182
Blob 3 of 30, id: 26, sources: 3, size: 36x54, npix 1417, brick X: 0,36, Y: 330,384, one pixel: 5 330
Blob 4 of 30, id: 27, sources: 2, size: 51x43, npix 1145, brick X: 296,347, Y: 344,387, one pixel: 307 344
Blob 5 of 30, id: 0, sources: 2, size: 41x31, npix 959, brick X: 16,57, Y: 0,31, one pixel: 22 0
Blob 6 of 30, id: 1, sources: 1, size: 42x32, npix 848, brick X: 302,344, Y: 0,32, one pixel: 307 0
Blob 7 of 30, id: 6, sources: 1, size: 34x34, npix 785, brick X: 262,296, Y: 55,89, one pixel: 275 55
Blob 8 of 30, id: 18, sources: 1, size: 34x33, npix 738, brick X: 317,351, Y: 186,219, one pixel: 331 186
Blob 9 of 30, id: 16, sources: 1, size: 30x36, npix 698, brick X: 373,403, Y: 149,185, one pixel: 384 149
Blob 10 of 30, id: 21, sources: 1, size: 27x37, npix 640, brick X: 338,365, Y: 285,322, one pixel: 349 285
Blob 11 of 30, id: 2, sources: 1, size: 32x32, npix 631, brick X: 245,277, Y: 10,42, one pixel: 266 10
Blob 12 of 30, id: 15, sources: 1, size: 24x31, npix 561, brick X: 0,24, Y: 101,132, one pixel: 7 101
Blob 13 of 30, id: 29, sources: 1, size: 33x22, npix 523, brick X: 231,264, Y: 383,405, one pixel: 245 383
Blob 14 of 30, id: 24, sources: 1, size: 27x28, npix 482, brick X: 94,121, Y: 313,341, one pixel: 107 313
Blob 15 of 30, id: 13, sources: 2, size: 28x31, npix 457, brick X: 377,405, Y: 89,120, one pixel: 388 89
Blob 16 of 30, id: 8, sources: 1, size: 25x24, npix 387, brick X: 236,261, Y: 64,88, one pixel: 247 64
Blob 17 of 30, id: 20, sources: 1, size: 24x25, npix 377, brick X: 280,304, Y: 280,305, one pixel: 291 280
Blob 13 finished, total: Wall: 0.34 s, CPU: 0.33 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151248 MB
Blob 18 of 30, id: 25, sources: 1, size: 24x22, npix 337, brick X: 60,84, Y: 326,348, one pixel: 69 326
Blob 16 finished, total: Wall: 0.58 s, CPU: 0.52 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151248 MB
Blob 19 of 30, id: 19, sources: 1, size: 21x23, npix 326, brick X: 0,21, Y: 199,222, one pixel: 7 199
Blob 20 of 30, id: 7, sources: 1, size: 23x22, npix 314, brick X: 299,322, Y: 62,84, one pixel: 308 62
Blob 7 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151224 MB
Blob 21 of 30, id: 4, sources: 1, size: 23x22, npix 285, brick X: 99,122, Y: 34,56, one pixel: 109 34
Blob 15 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151344 MB
Blob 22 of 30, id: 22, sources: 1, size: 21x21, npix 259, brick X: 310,331, Y: 296,317, one pixel: 319 296
Blob 10 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150636 MB
Blob 23 of 30, id: 10, sources: 1, size: 22x20, npix 248, brick X: 73,95, Y: 81,101, one pixel: 82 81
Blob 8 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.0967 MB
Blob 24 of 30, id: 3, sources: 1, size: 21x21, npix 241, brick X: 364,385, Y: 30,51, one pixel: 374 30
Measuring 1 iterative sources
Blob 12 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.09864 MB
Blob 22 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.09684 MB
Blob 25 of 30, id: 12, sources: 1, size: 20x20, npix 237, brick X: 29,49, Y: 89,109, one pixel: 38 89
Blob 26 of 30, id: 14, sources: 1, size: 21x19, npix 219, brick X: 49,70, Y: 96,115, one pixel: 58 96
Blob 20 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151344 MB
Blob 27 of 30, id: 9, sources: 1, size: 19x20, npix 209, brick X: 178,197, Y: 79,99, one pixel: 187 79
Blob 18 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151248 MB
Blob 28 of 30, id: 23, sources: 1, size: 19x19, npix 208, brick X: 60,79, Y: 298,317, one pixel: 68 298
Blob 14 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095612 MB
Blob 24 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.09864 MB
Blob 29 of 30, id: 5, sources: 1, size: 13x19, npix 169, brick X: 0,13, Y: 43,62, one pixel: 2 43
Blob 30 of 30, id: 28, sources: 1, size: 17x17, npix 145, brick X: 177,194, Y: 379,396, one pixel: 185 379
Blob 21 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150636 MB
Blob 25 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151344 MB
Blob 27 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095736 MB
Blob 28 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.09864 MB
Blob 30 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151344 MB
Blob 6 finished, total: Wall: 1.19 s, CPU: 1.17 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.098272 MB
Measuring 1 iterative sources
Blob 17 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151248 MB
Blob 26 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151248 MB
Blob 11 finished, total: Wall: 1.24 s, CPU: 1.24 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15174 MB
Blob 19 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151224 MB
Blob 4 finished, total: Wall: 1.45 s, CPU: 1.45 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097552 MB
Blob 23 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.096844 MB
Blob 29 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150636 MB
Blob 9 finished, total: Wall: 1.57 s, CPU: 1.52 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.098848 MB
Blob 3 finished, total: Wall: 1.95 s, CPU: 1.95 s, VmPeak: 806 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15174 MB
Blob 5 finished, total: Wall: 2.01 s, CPU: 2.01 s, VmPeak: 806 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151464 MB
Measuring 2 iterative sources
Blob 2 finished, total: Wall: 5.52 s, CPU: 5.52 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 100 MB, VmData: 144 MB, maxrss: 0.10202 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.49579, ee1=-0.314115, ee2=0.113687
Measuring 11 iterative sources
Blob 1 finished, total: Wall: 34.21 s, CPU: 34.21 s, VmPeak: 806 MB, VmSize: 754 MB, VmRSS: 177 MB, VmData: 205 MB, maxrss: 0.207432 MB
Old catalog: 71
New catalog: 66
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/metrics/cus/blobs-custom-273940p56835.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/metrics/cus/all-models-custom-273940p56835.fits
Stage fitblobs : Wall: 34.66 s, CPU: 0.48 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 258 MB, VmData: 282 MB, maxrss: 0.26414 MB
Stage fitblobs finished: 2020-08-05T22:16:02.312705
Resources for stage fitblobs : 59.007 s worker CPU, 59.213 s worker Wall, Wall: 34.666 s, Cores in use: 1.72, Total efficiency (on 16 cores): 10.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T22:16:02.418077
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/tmp-legacysurvey-custom-273940p56835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/tmp-legacysurvey-custom-273940p56835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/tmp-legacysurvey-custom-273940p56835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/tmp-legacysurvey-custom-273940p56835-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-resid.jpg
Stage coadds : Wall: 3.06 s, CPU: 1.24 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 267 MB, VmData: 294 MB, maxrss: 0.273516 MB
Stage coadds finished: 2020-08-05T22:16:05.474920
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 10.590 s worker CPU, 15.206 s worker Wall, Wall: 3.059 s, Cores in use: 3.87, Total efficiency (on 16 cores): 24.2 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T22:16:05.494635
Cut to 1 unWISE tiles
Reading WISE tile 2741p575 band 2
Reading WISE tile 2741p575 band 1
Reading WISE tile 2741p575 band 4
Reading WISE tile 2741p575 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.23 s, VmPeak: 1074 MB, VmSize: 1010 MB, VmRSS: 147 MB, VmData: 186 MB, maxrss: 0.209984 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.25 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 150 MB, VmData: 187 MB, maxrss: 0.211 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.15 s, CPU: 0.40 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 151 MB, VmData: 190 MB, maxrss: 0.195104 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.23 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 210 MB, VmData: 251 MB, maxrss: 0.214796 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/tmp-legacysurvey-custom-273940p56835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/tmp-legacysurvey-custom-273940p56835-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.62 s, CPU: 0.72 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 268 MB, VmData: 294 MB, maxrss: 0.274048 MB
Stage wise_forced finished: 2020-08-05T22:16:11.111191
Resources for stage wise_forced : 4.087 s worker CPU, 12.464 s worker Wall, Wall: 5.618 s, Cores in use: 0.86, Total efficiency (on 16 cores): 5.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T22:16:11.275019
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/coadd/cus/custom-273940p56835/legacysurvey-custom-273940p56835-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/tractor-i/cus/tractor-custom-273940p56835.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/tractor/cus/tractor-custom-273940p56835.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/tractor/cus/brick-custom-273940p56835.sha256sum
Stage writecat : Wall: 1.14 s, CPU: 0.91 s, VmPeak: 1149 MB, VmSize: 1021 MB, VmRSS: 269 MB, VmData: 294 MB, maxrss: 0.406928 MB
Stage writecat finished: 2020-08-05T22:16:12.416371
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.143 s, Cores in use: 0.80, Total efficiency (on 16 cores): 5.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2549223/PGC2549223-largegalaxy-writecat.p
All done: 82.233 s worker CPU, 123.076 s worker Wall, Wall: 73.066 s, Cores in use: 1.27, Total efficiency (on 16 cores): 7.9 %
Finished galaxy PGC2549223 in 1.245 minutes.
Started working on galaxy PGC2549223 at Fri Aug  7 10:17:09 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.9396026194569 56.83579079248464 --width 405 --height 405 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T10:17:11.136296
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.9396026194569', '56.83579079248464', '--width', '405', '--height', '405', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.9396026194569 56.83579079248464 --width 405 --height 405 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 273.9396026194569 56.83579079248464
Starting process 36296 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 36297 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 36298 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 36299 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 36300 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB
Starting process 36301 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059428 MB
Starting process 36302 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059428 MB
Starting process 36303 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 36304 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 36305 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 36306 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 36307 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 36308 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 36309 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 36310 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 36311 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T10:17:11.715033
Keeping 9 CCDs:
  k4m_160603_090801_ooi_zd_ls9-CCD2 z expnum 92996 exptime 80.103 propid 2016A-0453 seeing 0.96 MJD 57542.381 object MzLS_675074_z 
    mosaic/CP/V4.3/CP20160602/k4m_160603_090801_ooi_zd_ls9.fits.fz
  k4m_170906_063018_ooi_zd_ls9-CCD3 z expnum 138513 exptime 100.105 propid 2016A-0453 seeing 1.06 MJD 58002.271 object MzLS_676452_z 
    mosaic/CP/V4.3/CP20170905/k4m_170906_063018_ooi_zd_ls9.fits.fz
  k4m_160604_084945_ooi_zd_ls9-CCD4 z expnum 93256 exptime 80.104 propid 2016A-0453 seeing 0.93 MJD 57543.368 object MzLS_675765_z 
    mosaic/CP/V4.3/CP20160603/k4m_160604_084945_ooi_zd_ls9.fits.fz
  ksb_170622_101613_ooi_r_ls9-CCD3 r expnum 79260135 exptime 125.19 propid 2015A-0801 seeing 1.33 MJD 57926.428 object 34843 
    90prime/CP/V2.3/CP20170621/ksb_170622_101613_ooi_r_ls9.fits.fz
  ksb_170523_110922_ooi_g_ls9-CCD3 g expnum 78960196 exptime 167.16 propid 2015A-0801 seeing 1.89 MJD 57896.465 object 34843 
    90prime/CP/V2.3/CP20170522/ksb_170523_110922_ooi_g_ls9.fits.fz
  ksb_160708_094606_ooi_g_ls9-CCD2 g expnum 75770130 exptime 161.7 propid BASS seeing 1.67 MJD 57577.407 object 34832 
    90prime/CP/V2.3/CP20160707/ksb_160708_094606_ooi_g_ls9.fits.fz
  ksb_170731_052409_ooi_r_ls9-CCD2 r expnum 79650078 exptime 122.0 propid BASS seeing 1.20 MJD 57965.225 object 34832 
    90prime/CP/V2.3/CP20170730/ksb_170731_052409_ooi_r_ls9.fits.fz
  ksb_180515_100524_ooi_g_ls9-CCD2 g expnum 82530150 exptime 95.159 propid NOTBASS seeing 1.43 MJD 58253.420 object 34831 
    90prime/CP/V2.3/CP20180514/ksb_180515_100524_ooi_g_ls9.fits.fz
  ksb_170616_102539_ooi_r_ls9-CCD2 r expnum 79200168 exptime 146.4 propid BASS seeing 1.20 MJD 57920.434 object 34831 
    90prime/CP/V2.3/CP20170615/ksb_170616_102539_ooi_r_ls9.fits.fz
Faked up EXPNUM 82530150
Faked up EXPNUM 82530150
Faked up EXPNUM 82530150
90prime get_fwhm: self.fwhm = 3.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1048 1286 and amp range 0 2015 and image y 1479 1718 and amp range 0 2047
Range in image: x 0 239 , y 0 240 (with image size 239 x 240)
dzp -0.0036920775 -> scaling image by 0.9966052462302274
Faked up EXPNUM 79260135
Faked up EXPNUM 79260135
Faked up EXPNUM 79260135
90prime get_fwhm: self.fwhm = 2.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3331 3567 and amp range 2016 4031 and image y 3050 3286 and amp range 2048 4095
Range in image: x 0 237 , y 0 237 (with image size 237 x 237)
dzp -0.035697103 -> scaling image by 0.9676563679910417
Faked up EXPNUM 75770130
Faked up EXPNUM 75770130
Faked up EXPNUM 75770130
90prime get_fwhm: self.fwhm = 3.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3091 3329 and amp range 2016 4031 and image y 3461 3698 and amp range 2048 4095
Range in image: x 0 239 , y 0 238 (with image size 239 x 238)
dzp 0.0026774607 -> scaling image by 1.002469075566243
Faked up EXPNUM 79200168
Faked up EXPNUM 79200168
Faked up EXPNUM 79200168
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1107 1344 and amp range 0 2015 and image y 1499 1738 and amp range 0 2047
Range in image: x 0 238 , y 0 240 (with image size 238 x 240)
dzp 0.005335051 -> scaling image by 1.0049258559887364
Faked up EXPNUM 79650078
Faked up EXPNUM 79650078
Faked up EXPNUM 79650078
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3099 3336 and amp range 2016 4031 and image y 3473 3709 and amp range 2048 4095
Range in image: x 0 238 , y 0 237 (with image size 238 x 237)
dzp 0.021366077 -> scaling image by 1.0198737893800265
mosaic get_fwhm: self.fwhm = 4.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1622 2035 and amp range 0 2005 and image y 2591 3011 and amp range 2040 4078
Range in image: x 0 384 , y 0 421 (with image size 414 x 421)
dzp 0.01523814 -> scaling image by 1.014133796220052
Found overlap: image x 1622 2035 and amp range 2006 4053 and image y 2591 3011 and amp range 2040 4078
Range in image: x 384 414 , y 0 421 (with image size 414 x 421)
dzp 0.0056365696 -> scaling image by 1.005204971477435
mosaic get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 99 508 and amp range 0 2047 and image y 1588 1997 and amp range 0 2021
Range in image: x 0 410 , y 0 410 (with image size 410 x 410)
dzp 0.005139143 -> scaling image by 1.0047445456970268
Faked up EXPNUM 78960196
Faked up EXPNUM 78960196
Faked up EXPNUM 78960196
90prime get_fwhm: self.fwhm = 4.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3345 3581 and amp range 2016 4031 and image y 3061 3297 and amp range 2048 4095
Range in image: x 0 237 , y 0 237 (with image size 237 x 237)
dzp -0.02530836 -> scaling image by 0.9769597156943128
mosaic get_fwhm: self.fwhm = 3.71
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2794 3206 and amp range 2048 4095 and image y 3159 3568 and amp range 2040 4078
Range in image: x 0 413 , y 0 410 (with image size 413 x 410)
dzp -0.009154885 -> scaling image by 0.9916034885139223
Stage tims : Wall: 30.37 s, CPU: 0.92 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 179 MB, VmData: 212 MB, maxrss: 0.183272 MB
Stage tims finished: 2020-08-07T10:17:42.084075
Resources for stage tims : 4.449 s worker CPU, 87.295 s worker Wall, Wall: 30.371 s, Cores in use: 0.18, Total efficiency (on 16 cores): 1.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T10:17:43.820823
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01082.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00990.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00991.fits
Matched 6 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/metrics/cus/reference-custom-273939p56835.fits
Stage refs : Wall: 41.02 s, CPU: 3.74 s, VmPeak: 998 MB, VmSize: 993 MB, VmRSS: 223 MB, VmData: 254 MB, maxrss: 0.228352 MB
Stage refs finished: 2020-08-07T10:18:24.844342
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 41.025 s, Cores in use: 0.09, Total efficiency (on 16 cores): 0.6 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T10:18:25.876198
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/metrics/cus/outlier-mask-custom-273939p56835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/metrics/cus/outliers-pre-custom-273939p56835.jpg
Image ksb_170616_102539_ooi_r_ls9-CCD2 r : masking 206 positive outlier pixels and 0 negative outlier pixels
Image k4m_170906_063018_ooi_zd_ls9-CCD3 z : masking 255 positive outlier pixels and 0 negative outlier pixels
Image k4m_160604_084945_ooi_zd_ls9-CCD4 z : masking 1053 positive outlier pixels and 0 negative outlier pixels
Image k4m_160603_090801_ooi_zd_ls9-CCD2 z : masking 239 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/metrics/cus/outlier-mask-custom-273939p56835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/metrics/cus/outliers-post-custom-273939p56835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/metrics/cus/outliers-masked-pos-custom-273939p56835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/metrics/cus/outliers-masked-neg-custom-273939p56835.jpg
Stage outliers : Wall: 6.81 s, CPU: 0.88 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 253 MB, VmData: 282 MB, maxrss: 0.259556 MB
Stage outliers finished: 2020-08-07T10:18:32.683238
Resources for stage outliers : 1.685 s worker CPU, 1.828 s worker Wall, Wall: 6.809 s, Cores in use: 0.38, Total efficiency (on 16 cores): 2.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T10:18:32.772048
Stage halos : Wall: 0.44 s, CPU: 0.43 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 254 MB, VmData: 282 MB, maxrss: 0.259936 MB
Stage halos finished: 2020-08-07T10:18:33.216680
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.446 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T10:18:33.268829
PSF sigmas in coadd pixels: ['3.07', '2.72', '2.32']
Using average PSF sigma 2.7014068208613224
Gaussian PSF norm 0.10442514233525718 vs pixelized 0.08889803
average tim pixel scale / coadd scale: 1.7298494584730448
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.16', '1.95', '1.95']
Using average PSF sigma 2.0185152581128825
Gaussian PSF norm 0.13975360881721036 vs pixelized 0.11585482
average tim pixel scale / coadd scale: 1.7291167084454693
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.56', '1.72', '1.51']
Using average PSF sigma 1.598111371684271
Gaussian PSF norm 0.17651760495050775 vs pixelized 0.1487479
average tim pixel scale / coadd scale: 0.9909140115838412
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.34 s, CPU: 0.28 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 255 MB, VmData: 282 MB, maxrss: 0.261404 MB
Stage fit_on_coadds finished: 2020-08-07T10:18:33.609831
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.450 s worker CPU, 0.450 s worker Wall, Wall: 0.342 s, Cores in use: 2.14, Total efficiency (on 16 cores): 13.4 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T10:18:33.715585
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 72 potential peaks
Of 72 potential peaks: 33 in veto map, 6 cut by saddle test, 0 cut by aper test, 33 kept
SED z : 33 new peaks
Found 127 potential peaks
Of 127 potential peaks: 113 in veto map, 10 cut by saddle test, 1 cut by aper test, 3 kept
SED r : 3 new peaks
Found 66 potential peaks
Of 66 potential peaks: 62 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 122 potential peaks
Of 122 potential peaks: 99 in veto map, 12 cut by saddle test, 1 cut by aper test, 10 kept
SED Flat : 10 new peaks
Found 127 potential peaks
Of 127 potential peaks: 112 in veto map, 14 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 47 new sources
Median coadd sky for g : 0.00026177356
Median coadd sky for r : 0.0006752213
Median coadd sky for z : 7.407275e-05
Stage srcs : Wall: 1.05 s, CPU: 0.98 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 256 MB, VmData: 282 MB, maxrss: 0.261896 MB
Stage srcs finished: 2020-08-07T10:18:34.767105
Resources for stage srcs : 0.166 s worker CPU, 0.166 s worker Wall, Wall: 1.053 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T10:18:34.795961
Blob 1 of 30, id: 10, sources: 24, size: 338x307, npix 46000, brick X: 7,345, Y: 80,387, one pixel: 205 80
Blob 2 of 30, id: 16, sources: 5, size: 76x120, npix 4281, brick X: 329,405, Y: 178,298, one pixel: 368 178
Blob 3 of 30, id: 25, sources: 2, size: 30x51, npix 1135, brick X: 0,30, Y: 329,380, one pixel: 10 329
Blob 4 of 30, id: 0, sources: 3, size: 41x27, npix 826, brick X: 10,51, Y: 0,27, one pixel: 14 0
Blob 5 of 30, id: 5, sources: 1, size: 34x34, npix 789, brick X: 256,290, Y: 51,85, one pixel: 269 51
Blob 6 of 30, id: 17, sources: 1, size: 34x34, npix 742, brick X: 311,345, Y: 182,216, one pixel: 326 182
Blob 7 of 30, id: 15, sources: 1, size: 30x36, npix 687, brick X: 367,397, Y: 145,181, one pixel: 379 145
Blob 8 of 30, id: 1, sources: 1, size: 35x29, npix 649, brick X: 296,331, Y: 0,29, one pixel: 300 0
Blob 9 of 30, id: 20, sources: 1, size: 27x37, npix 647, brick X: 332,359, Y: 281,318, one pixel: 344 281
Blob 10 of 30, id: 2, sources: 1, size: 32x32, npix 641, brick X: 239,271, Y: 6,38, one pixel: 260 6
Blob 11 of 30, id: 29, sources: 1, size: 33x26, npix 626, brick X: 225,258, Y: 379,405, one pixel: 239 379
Blob 12 of 30, id: 27, sources: 1, size: 29x29, npix 581, brick X: 312,341, Y: 354,383, one pixel: 324 354
Blob 13 of 30, id: 26, sources: 1, size: 29x29, npix 559, brick X: 290,319, Y: 340,369, one pixel: 301 340
Blob 14 of 30, id: 12, sources: 2, size: 32x31, npix 528, brick X: 371,403, Y: 86,117, one pixel: 380 86
Blob 15 of 30, id: 23, sources: 1, size: 27x27, npix 482, brick X: 88,115, Y: 310,337, one pixel: 99 310
Blob 16 of 30, id: 14, sources: 1, size: 18x30, npix 392, brick X: 0,18, Y: 98,128, one pixel: 4 98
Blob 17 of 30, id: 19, sources: 1, size: 24x25, npix 376, brick X: 274,298, Y: 276,301, one pixel: 286 276
Blob 11 finished, total: Wall: 0.32 s, CPU: 0.31 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147792 MB
Blob 18 of 30, id: 7, sources: 1, size: 25x25, npix 368, brick X: 230,255, Y: 60,85, one pixel: 242 60
Blob 13 finished, total: Wall: 0.65 s, CPU: 0.63 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147376 MB
Blob 19 of 30, id: 24, sources: 1, size: 24x23, npix 336, brick X: 54,78, Y: 322,345, one pixel: 64 322
Blob 14 finished, total: Wall: 0.65 s, CPU: 0.64 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099032 MB
Blob 20 of 30, id: 6, sources: 1, size: 23x21, npix 311, brick X: 293,316, Y: 59,80, one pixel: 301 59
Blob 21 of 30, id: 4, sources: 1, size: 23x22, npix 293, brick X: 93,116, Y: 31,53, one pixel: 102 31
Blob 6 finished, total: Wall: 0.71 s, CPU: 0.70 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146872 MB
Blob 5 finished, total: Wall: 0.72 s, CPU: 0.71 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098688 MB
Blob 12 finished, total: Wall: 0.71 s, CPU: 0.70 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147996 MB
Blob 22 of 30, id: 21, sources: 1, size: 21x21, npix 250, brick X: 304,325, Y: 292,313, one pixel: 313 292
Blob 23 of 30, id: 9, sources: 1, size: 22x20, npix 247, brick X: 67,89, Y: 77,97, one pixel: 77 77
Blob 24 of 30, id: 3, sources: 1, size: 21x20, npix 240, brick X: 358,379, Y: 27,47, one pixel: 367 27
Blob 9 finished, total: Wall: 0.82 s, CPU: 0.80 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146992 MB
Blob 25 of 30, id: 11, sources: 1, size: 20x20, npix 237, brick X: 23,43, Y: 85,105, one pixel: 32 85
Blob 22 finished, total: Wall: 0.10 s, CPU: 0.09 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147996 MB
Blob 26 of 30, id: 13, sources: 1, size: 21x20, npix 228, brick X: 43,64, Y: 92,112, one pixel: 52 92
Blob 18 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147376 MB
Blob 27 of 30, id: 8, sources: 1, size: 19x19, npix 217, brick X: 172,191, Y: 76,95, one pixel: 180 76
Blob 24 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147996 MB
Blob 28 of 30, id: 22, sources: 1, size: 19x19, npix 199, brick X: 54,73, Y: 294,313, one pixel: 62 294
Blob 20 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146872 MB
Blob 29 of 30, id: 18, sources: 1, size: 15x20, npix 193, brick X: 0,15, Y: 197,217, one pixel: 3 197
Blob 21 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.09884 MB
Blob 30 of 30, id: 28, sources: 1, size: 18x17, npix 162, brick X: 170,188, Y: 375,392, one pixel: 178 375
Blob 25 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147376 MB
Blob 15 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097756 MB
Blob 19 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099304 MB
Blob 16 finished, total: Wall: 0.98 s, CPU: 0.96 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.096108 MB
Measuring 1 iterative sources
Blob 8 finished, total: Wall: 1.02 s, CPU: 1.01 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.09538 MB
Blob 27 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146872 MB
Blob 28 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.09884 MB
Blob 30 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099304 MB
Blob 17 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147792 MB
Blob 26 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147996 MB
Blob 10 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 810 MB, VmSize: 724 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148176 MB
Blob 23 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146992 MB
Blob 29 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147376 MB
Blob 7 finished, total: Wall: 1.40 s, CPU: 1.39 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147856 MB
Blob 3 finished, total: Wall: 1.69 s, CPU: 1.68 s, VmPeak: 676 MB, VmSize: 676 MB, VmRSS: 100 MB, VmData: 147 MB, maxrss: 0.101896 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.96451, 56.81635), pm (-3.5, 1.5), parallax 0.173 with NanoMaggies: g=18.1, r=17.7, z=17.6
Reset brightness to NanoMaggies: g=18.1, r=17.7, z=17.6
Blob 4 finished, total: Wall: 1.89 s, CPU: 1.87 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14674 MB
Measuring 2 iterative sources
Blob 2 finished, total: Wall: 3.84 s, CPU: 3.83 s, VmPeak: 673 MB, VmSize: 672 MB, VmRSS: 100 MB, VmData: 144 MB, maxrss: 0.102152 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.899698, ee1=-0.264581, ee2=0.0799456
Measuring 10 iterative sources
Blob 1 finished, total: Wall: 27.98 s, CPU: 27.98 s, VmPeak: 811 MB, VmSize: 734 MB, VmRSS: 158 MB, VmData: 189 MB, maxrss: 0.202656 MB
Old catalog: 68
New catalog: 61
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/metrics/cus/blobs-custom-273939p56835.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/metrics/cus/all-models-custom-273939p56835.fits
Stage fitblobs : Wall: 30.49 s, CPU: 0.72 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 256 MB, VmData: 282 MB, maxrss: 0.2623 MB
Stage fitblobs finished: 2020-08-07T10:19:05.289310
Resources for stage fitblobs : 49.100 s worker CPU, 49.352 s worker Wall, Wall: 30.495 s, Cores in use: 1.63, Total efficiency (on 16 cores): 10.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T10:19:05.308348
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/tmp-legacysurvey-custom-273939p56835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/tmp-legacysurvey-custom-273939p56835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/tmp-legacysurvey-custom-273939p56835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/tmp-legacysurvey-custom-273939p56835-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-resid.jpg
Stage coadds : Wall: 8.49 s, CPU: 0.77 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 265 MB, VmData: 294 MB, maxrss: 0.271664 MB
Stage coadds finished: 2020-08-07T10:19:13.798261
Resources for stage coadds : 10.249 s worker CPU, 10.781 s worker Wall, Wall: 8.491 s, Cores in use: 1.30, Total efficiency (on 16 cores): 8.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T10:19:13.817191
Cut to 1 unWISE tiles
Reading WISE tile 2741p575 band 2
Reading WISE tile 2741p575 band 1
Reading WISE tile 2741p575 band 3
Reading WISE tile 2741p575 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 809 MB, VmSize: 800 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.20752 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 810 MB, VmSize: 800 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208532 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 807 MB, VmSize: 803 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.192132 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p575/unwise-2741p575-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 806 MB, VmSize: 799 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.206544 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/tmp-legacysurvey-custom-273939p56835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/tmp-legacysurvey-custom-273939p56835-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 19.35 s, CPU: 0.68 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 266 MB, VmData: 294 MB, maxrss: 0.272196 MB
Stage wise_forced finished: 2020-08-07T10:19:33.162785
Resources for stage wise_forced : 3.126 s worker CPU, 36.723 s worker Wall, Wall: 19.347 s, Cores in use: 0.20, Total efficiency (on 16 cores): 1.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T10:19:33.183382
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/coadd/cus/custom-273939p56835/legacysurvey-custom-273939p56835-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/tractor-i/cus/tractor-custom-273939p56835.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/tractor/cus/tractor-custom-273939p56835.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/tractor/cus/brick-custom-273939p56835.sha256sum
Stage writecat : Wall: 6.02 s, CPU: 0.77 s, VmPeak: 1143 MB, VmSize: 1015 MB, VmRSS: 268 MB, VmData: 294 MB, maxrss: 0.40508 MB
Stage writecat finished: 2020-08-07T10:19:39.205957
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.024 s, Cores in use: 0.13, Total efficiency (on 16 cores): 0.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2549223/PGC2549223-largegalaxy-writecat.p
All done: 69.230 s worker CPU, 186.600 s worker Wall, Wall: 151.072 s, Cores in use: 0.53, Total efficiency (on 16 cores): 3.3 %
Finished galaxy PGC2549223 in 2.599 minutes.