Started working on galaxy PGC2320176 at Wed Aug  5 18:40:42 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.77686450000002 48.556893 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T18:40:43.094155
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '206.77686450000002', '48.556893', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.77686450000002 48.556893 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 206.77686450000002 48.556893
Starting process 49841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 49842 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 49843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 49844 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 49845 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 49846 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 49847 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 49849 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 49851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 49852 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 49854 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 49857 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 49859 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 49860 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 49862 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 49863 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 49864 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 49865 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 49866 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 49867 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 49869 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 49871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 49875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 49877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 49873 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 49880 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 49881 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 49883 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 49885 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 49889 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 49891 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 49887 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T18:40:43.542540
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 11 CCDs:
  k4m_160418_073440_ooi_zd_ls9-CCD1 z expnum 83031 exptime 80.107 propid 2016A-0453 seeing 1.12 MJD 57496.316 object MzLS_643700_z 
    mosaic/CP/V4.3/CP20160417/k4m_160418_073440_ooi_zd_ls9.fits.fz
  k4m_160525_053528_ooi_zd_ls9-CCD2 z expnum 91371 exptime 80.104 propid 2016A-0453 seeing 1.13 MJD 57533.233 object MzLS_642866_z 
    mosaic/CP/V4.3/CP20160524/k4m_160525_053528_ooi_zd_ls9.fits.fz
  k4m_170503_064021_ooi_zd_ls9-CCD1 z expnum 126126 exptime 80.103 propid 2016A-0453 seeing 0.89 MJD 57876.278 object MzLS_644529_z 
    mosaic/CP/V4.3/CP20170502/k4m_170503_064021_ooi_zd_ls9.fits.fz
  ksb_160527_034840_ooi_g_ls9-CCD4 g expnum 75350040 exptime 138.5 propid BASS seeing 1.24 MJD 57535.159 object 25601 
    90prime/CP/V2.3/CP20160526/ksb_160527_034840_ooi_g_ls9.fits.fz
  ksb_160510_064553_ooi_r_ls9-CCD4 r expnum 75180120 exptime 50.1 propid BASS seeing 1.26 MJD 57518.282 object 25601 
    90prime/CP/V2.3/CP20160509/ksb_160510_064553_ooi_r_ls9.fits.fz
  ksb_160313_094243_ooi_g_ls9-CCD4 g expnum 74600215 exptime 72.2 propid 2015A-0801 seeing 1.33 MJD 57460.405 object 25601 
    90prime/CP/V2.3/CP20160312/ksb_160313_094243_ooi_g_ls9.fits.fz
  ksb_160530_074058_ooi_r_ls9-CCD4 r expnum 75380144 exptime 64.099 propid BASS seeing 1.25 MJD 57538.320 object 25601 
    90prime/CP/V2.3/CP20160529/ksb_160530_074058_ooi_r_ls9.fits.fz
  ksb_170420_085329_ooi_r_ls9-CCD4 r expnum 78630150 exptime 70.61 propid BASS seeing 1.28 MJD 57863.370 object 25603 
    90prime/CP/V2.3/CP20170419/ksb_170420_085329_ooi_r_ls9.fits.fz
  ksb_170401_093036_ooi_g_ls9-CCD4 g expnum 78440126 exptime 121.283 propid BASS seeing 1.83 MJD 57844.396 object 25603 
    90prime/CP/V2.3/CP20170331/ksb_170401_093036_ooi_g_ls9.fits.fz
  ksb_160501_072902_ooi_g_ls9-CCD1 g expnum 75090100 exptime 190.5 propid BASS seeing 2.76 MJD 57509.312 object 24402 
    90prime/CP/V2.3/CP20160430/ksb_160501_072902_ooi_g_ls9.fits.fz
  ksb_160605_053231_ooi_r_ls9-CCD1 r expnum 75440062 exptime 60.5 propid BASS seeing 1.80 MJD 57544.231 object 24402 
    90prime/CP/V2.3/CP20160604/ksb_160605_053231_ooi_r_ls9.fits.fz
Faked up EXPNUM 75380144
Faked up EXPNUM 75380144
Faked up EXPNUM 75380144
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3449 3586 and amp range 2016 4031 and image y 3344 3481 and amp range 2048 4095
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp -0.0036899033 -> scaling image by 0.9966072419211972
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75440062
Faked up EXPNUM 75440062
Faked up EXPNUM 75440062
90prime get_fwhm: self.fwhm = 3.97
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1556 1694 and amp range 0 2015 and image y 850 987 and amp range 0 2047
Range in image: x 0 139 , y 0 138 (with image size 139 x 138)
dzp -0.01149955 -> scaling image by 0.9894644150522871
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75090100
Faked up EXPNUM 75090100
Faked up EXPNUM 75090100
90prime get_fwhm: self.fwhm = 6.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1556 1694 and amp range 0 2015 and image y 864 1001 and amp range 0 2047
Range in image: x 0 139 , y 0 138 (with image size 139 x 138)
dzp -0.011813398 -> scaling image by 0.989178436928226
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74600215
Faked up EXPNUM 74600215
Faked up EXPNUM 74600215
90prime get_fwhm: self.fwhm = 2.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3398 3535 and amp range 2016 4031 and image y 3351 3488 and amp range 2048 4095
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp 0.0013913503 -> scaling image by 1.001282302423891
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75350040
Faked up EXPNUM 75350040
Faked up EXPNUM 75350040
90prime get_fwhm: self.fwhm = 2.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3409 3546 and amp range 2016 4031 and image y 3380 3517 and amp range 2048 4095
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp 0.0013913503 -> scaling image by 1.001282302423891
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75180120
Faked up EXPNUM 75180120
Faked up EXPNUM 75180120
90prime get_fwhm: self.fwhm = 2.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3418 3554 and amp range 2016 4031 and image y 3361 3498 and amp range 2048 4095
Range in image: x 0 137 , y 0 138 (with image size 137 x 138)
dzp -0.0036899033 -> scaling image by 0.9966072419211972
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3517 3751 and amp range 2006 4053 and image y 1366 1603 and amp range 0 2039
Range in image: x 0 235 , y 0 238 (with image size 235 x 238)
dzp 0.001388291 -> scaling image by 1.0012794811153327
mosaic get_fwhm: self.fwhm = 3.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 812 1050 and amp range 0 2005 and image y 2830 3066 and amp range 2040 4078
Range in image: x 0 239 , y 0 237 (with image size 239 x 237)
dzp 0.032569118 -> scaling image by 1.0304517167935139
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1929 2164 and amp range 0 2047 and image y 3419 3653 and amp range 2040 4078
Range in image: x 0 119 , y 0 235 (with image size 236 x 235)
dzp 0.008550294 -> scaling image by 1.0079062018164673
Found overlap: image x 1929 2164 and amp range 2048 4095 and image y 3419 3653 and amp range 2040 4078
Range in image: x 119 236 , y 0 235 (with image size 236 x 235)
dzp -0.009154885 -> scaling image by 0.9916034885139223
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78630150
Faked up EXPNUM 78630150
Faked up EXPNUM 78630150
90prime get_fwhm: self.fwhm = 2.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1407 1542 and amp range 0 2015 and image y 1336 1471 and amp range 0 2047
Range in image: x 0 136 , y 0 136 (with image size 136 x 136)
dzp 0.004145757 -> scaling image by 1.0038256824624485
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78440126
Faked up EXPNUM 78440126
Faked up EXPNUM 78440126
90prime get_fwhm: self.fwhm = 4.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1418 1553 and amp range 0 2015 and image y 1334 1469 and amp range 0 2047
Range in image: x 0 136 , y 0 136 (with image size 136 x 136)
dzp 0.0029025706 -> scaling image by 1.002676942990926
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 24.08 s, CPU: 0.88 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.179064 MB
Stage tims finished: 2020-08-05T18:41:07.627409
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.549 s worker CPU, 76.961 s worker Wall, Wall: 24.088 s, Cores in use: 0.27, Total efficiency (on 32 cores): 0.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T18:41:07.687252
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01576.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01465.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/reference-custom-206776p48556.fits
Stage refs : Wall: 13.23 s, CPU: 1.33 s, VmPeak: 988 MB, VmSize: 970 MB, VmRSS: 188 MB, VmData: 219 MB, maxrss: 0.192416 MB
Stage refs finished: 2020-08-05T18:41:20.913667
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 13.229 s, Cores in use: 0.10, Total efficiency (on 32 cores): 0.3 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T18:41:20.938053
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outlier-mask-custom-206776p48556.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outliers-pre-custom-206776p48556.jpg
Image ksb_160313_094243_ooi_g_ls9-CCD4 g : masking 219 positive outlier pixels and 0 negative outlier pixels
Image k4m_170503_064021_ooi_zd_ls9-CCD1 z : masking 378 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outlier-mask-custom-206776p48556.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outliers-post-custom-206776p48556.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outliers-masked-pos-custom-206776p48556.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outliers-masked-neg-custom-206776p48556.jpg
Stage outliers : Wall: 1.20 s, CPU: 0.90 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.206968 MB
Stage outliers finished: 2020-08-05T18:41:22.141735
Resources for stage outliers : 0.800 s worker CPU, 1.046 s worker Wall, Wall: 1.206 s, Cores in use: 1.41, Total efficiency (on 32 cores): 4.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T18:41:22.170095
Stage halos : Wall: 0.53 s, CPU: 0.52 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 203 MB, VmData: 230 MB, maxrss: 0.207484 MB
Stage halos finished: 2020-08-05T18:41:22.705192
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.537 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T18:41:22.728834
PSF sigmas in coadd pixels: ['2.01', '2.16', '2.97', '4.48']
Using average PSF sigma 2.9045767004694287
Gaussian PSF norm 0.09712079275726714 vs pixelized 0.07741395
average tim pixel scale / coadd scale: 1.7303342871876248
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.04', '2.02', '2.08', '2.92']
Using average PSF sigma 2.266735157045397
Gaussian PSF norm 0.12444982418747941 vs pixelized 0.10954625
average tim pixel scale / coadd scale: 1.7296303632822
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.83', '1.83', '1.44']
Using average PSF sigma 1.6992844518803851
Gaussian PSF norm 0.16600798733944702 vs pixelized 0.14653462
average tim pixel scale / coadd scale: 0.9908948830357319
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.14 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.209676 MB
Stage fit_on_coadds finished: 2020-08-05T18:41:22.880707
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.134 s worker CPU, 0.134 s worker Wall, Wall: 0.154 s, Cores in use: 1.83, Total efficiency (on 32 cores): 5.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T18:41:22.891373
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 14 potential peaks
Of 14 potential peaks: 0 in veto map, 1 cut by saddle test, 0 cut by aper test, 13 kept
SED z : 13 new peaks
Found 17 potential peaks
Of 17 potential peaks: 13 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 17 potential peaks
Of 17 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 19 potential peaks
Of 19 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 19 potential peaks
Of 19 potential peaks: 16 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 17 new sources
Median coadd sky for g : 6.476407e-05
Median coadd sky for r : 2.8620211e-06
Median coadd sky for z : -9.1502574e-05
Stage srcs : Wall: 0.43 s, CPU: 0.39 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.210196 MB
Stage srcs finished: 2020-08-05T18:41:23.319854
Resources for stage srcs : 0.074 s worker CPU, 0.074 s worker Wall, Wall: 0.431 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T18:41:23.374394
Blob 1 of 8, id: 2, sources: 11, size: 170x158, npix 11896, brick X: 9,179, Y: 44,202, one pixel: 107 44
Blob 2 of 8, id: 4, sources: 1, size: 35x37, npix 792, brick X: 181,216, Y: 64,101, one pixel: 195 64
Blob 3 of 8, id: 7, sources: 1, size: 35x30, npix 758, brick X: 169,204, Y: 203,233, one pixel: 184 203
Blob 4 of 8, id: 5, sources: 1, size: 29x28, npix 516, brick X: 204,233, Y: 123,151, one pixel: 218 123
Blob 5 of 8, id: 1, sources: 1, size: 28x27, npix 497, brick X: 89,117, Y: 16,43, one pixel: 102 16
Blob 6 of 8, id: 3, sources: 1, size: 21x25, npix 354, brick X: 0,21, Y: 60,85, one pixel: 7 60
Blob 7 of 8, id: 0, sources: 1, size: 24x23, npix 340, brick X: 195,219, Y: 9,32, one pixel: 205 9
Blob 8 of 8, id: 6, sources: 1, size: 21x21, npix 241, brick X: 131,152, Y: 170,191, one pixel: 141 170
Blob 7 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09442 MB
Blob 8 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091732 MB
Blob 5 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093324 MB
Blob 6 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14958 MB
Blob 4 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149824 MB
Blob 2 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093612 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.0958 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.22694, ee1=0.155367, ee2=-0.140776
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 7.46 s, CPU: 7.46 s, VmPeak: 686 MB, VmSize: 684 MB, VmRSS: 111 MB, VmData: 155 MB, maxrss: 0.11382 MB
Old catalog: 19
New catalog: 19
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/blobs-custom-206776p48556.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/all-models-custom-206776p48556.fits
Stage fitblobs : Wall: 11.60 s, CPU: 0.29 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.210364 MB
Stage fitblobs finished: 2020-08-05T18:41:34.977873
Resources for stage fitblobs : 10.848 s worker CPU, 10.889 s worker Wall, Wall: 11.606 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T18:41:34.994269
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-resid.jpg
Stage coadds : Wall: 3.14 s, CPU: 0.68 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 206 MB, VmData: 231 MB, maxrss: 0.210876 MB
Stage coadds finished: 2020-08-05T18:41:38.131735
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 23.697 s worker CPU, 41.873 s worker Wall, Wall: 3.140 s, Cores in use: 7.76, Total efficiency (on 32 cores): 24.3 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T18:41:38.143369
Cut to 1 unWISE tiles
Reading WISE tile 2069p484 band 2
Reading WISE tile 2069p484 band 1
Reading WISE tile 2069p484 band 3
Reading WISE tile 2069p484 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 813 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.186716 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 807 MB, VmSize: 798 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.202188 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 812 MB, VmSize: 808 MB, VmRSS: 150 MB, VmData: 180 MB, maxrss: 0.207132 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 862 MB, VmSize: 862 MB, VmRSS: 201 MB, VmData: 234 MB, maxrss: 0.205644 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 9.44 s, CPU: 0.42 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 207 MB, VmData: 231 MB, maxrss: 0.211584 MB
Stage wise_forced finished: 2020-08-05T18:41:47.581732
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 2.908 s worker CPU, 18.844 s worker Wall, Wall: 9.441 s, Cores in use: 0.35, Total efficiency (on 32 cores): 1.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T18:41:47.596651
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/tractor-i/cus/tractor-custom-206776p48556.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/tractor/cus/tractor-custom-206776p48556.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/tractor/cus/brick-custom-206776p48556.sha256sum
Stage writecat : Wall: 0.83 s, CPU: 0.51 s, VmPeak: 1112 MB, VmSize: 984 MB, VmRSS: 208 MB, VmData: 231 MB, maxrss: 0.344576 MB
Stage writecat finished: 2020-08-05T18:41:48.425293
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.831 s, Cores in use: 0.61, Total efficiency (on 32 cores): 1.9 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-writecat.p
All done: 44.017 s worker CPU, 149.829 s worker Wall, Wall: 64.916 s, Cores in use: 0.77, Total efficiency (on 32 cores): 2.4 %
Finished galaxy PGC2320176 in 1.108 minutes.
Started working on galaxy PGC2320176 at Wed Aug  5 19:07:43 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.77686450000002 48.556893 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:07:46.890787
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '206.77686450000002', '48.556893', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.77686450000002 48.556893 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 206.77686450000002 48.556893
Starting process 54022 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 54023 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 54024 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 54025 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 54026 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 54027 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 54028 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 54029 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 54030 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 54031 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 54032 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 54034 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 54033 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 54035 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 54036 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 54037 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:07:48.317309
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 11 CCDs:
  k4m_160418_073440_ooi_zd_ls9-CCD1 z expnum 83031 exptime 80.107 propid 2016A-0453 seeing 1.12 MJD 57496.316 object MzLS_643700_z 
    mosaic/CP/V4.3/CP20160417/k4m_160418_073440_ooi_zd_ls9.fits.fz
  k4m_160525_053528_ooi_zd_ls9-CCD2 z expnum 91371 exptime 80.104 propid 2016A-0453 seeing 1.13 MJD 57533.233 object MzLS_642866_z 
    mosaic/CP/V4.3/CP20160524/k4m_160525_053528_ooi_zd_ls9.fits.fz
  k4m_170503_064021_ooi_zd_ls9-CCD1 z expnum 126126 exptime 80.103 propid 2016A-0453 seeing 0.89 MJD 57876.278 object MzLS_644529_z 
    mosaic/CP/V4.3/CP20170502/k4m_170503_064021_ooi_zd_ls9.fits.fz
  ksb_160527_034840_ooi_g_ls9-CCD4 g expnum 75350040 exptime 138.5 propid BASS seeing 1.24 MJD 57535.159 object 25601 
    90prime/CP/V2.3/CP20160526/ksb_160527_034840_ooi_g_ls9.fits.fz
  ksb_160510_064553_ooi_r_ls9-CCD4 r expnum 75180120 exptime 50.1 propid BASS seeing 1.26 MJD 57518.282 object 25601 
    90prime/CP/V2.3/CP20160509/ksb_160510_064553_ooi_r_ls9.fits.fz
  ksb_160313_094243_ooi_g_ls9-CCD4 g expnum 74600215 exptime 72.2 propid 2015A-0801 seeing 1.33 MJD 57460.405 object 25601 
    90prime/CP/V2.3/CP20160312/ksb_160313_094243_ooi_g_ls9.fits.fz
  ksb_160530_074058_ooi_r_ls9-CCD4 r expnum 75380144 exptime 64.099 propid BASS seeing 1.25 MJD 57538.320 object 25601 
    90prime/CP/V2.3/CP20160529/ksb_160530_074058_ooi_r_ls9.fits.fz
  ksb_170420_085329_ooi_r_ls9-CCD4 r expnum 78630150 exptime 70.61 propid BASS seeing 1.28 MJD 57863.370 object 25603 
    90prime/CP/V2.3/CP20170419/ksb_170420_085329_ooi_r_ls9.fits.fz
  ksb_170401_093036_ooi_g_ls9-CCD4 g expnum 78440126 exptime 121.283 propid BASS seeing 1.83 MJD 57844.396 object 25603 
    90prime/CP/V2.3/CP20170331/ksb_170401_093036_ooi_g_ls9.fits.fz
  ksb_160501_072902_ooi_g_ls9-CCD1 g expnum 75090100 exptime 190.5 propid BASS seeing 2.76 MJD 57509.312 object 24402 
    90prime/CP/V2.3/CP20160430/ksb_160501_072902_ooi_g_ls9.fits.fz
  ksb_160605_053231_ooi_r_ls9-CCD1 r expnum 75440062 exptime 60.5 propid BASS seeing 1.80 MJD 57544.231 object 24402 
    90prime/CP/V2.3/CP20160604/ksb_160605_053231_ooi_r_ls9.fits.fz
Faked up EXPNUM 75440062
Faked up EXPNUM 75440062
Faked up EXPNUM 75440062
90prime get_fwhm: self.fwhm = 3.97
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1556 1694 and amp range 0 2015 and image y 850 987 and amp range 0 2047
Range in image: x 0 139 , y 0 138 (with image size 139 x 138)
dzp -0.01149955 -> scaling image by 0.9894644150522871
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1929 2164 and amp range 0 2047 and image y 3419 3653 and amp range 2040 4078
Range in image: x 0 119 , y 0 235 (with image size 236 x 235)
dzp 0.008550294 -> scaling image by 1.0079062018164673
Found overlap: image x 1929 2164 and amp range 2048 4095 and image y 3419 3653 and amp range 2040 4078
Range in image: x 119 236 , y 0 235 (with image size 236 x 235)
dzp -0.009154885 -> scaling image by 0.9916034885139223
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78630150
Faked up EXPNUM 78630150
Faked up EXPNUM 78630150
90prime get_fwhm: self.fwhm = 2.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1407 1542 and amp range 0 2015 and image y 1336 1471 and amp range 0 2047
Range in image: x 0 136 , y 0 136 (with image size 136 x 136)
dzp 0.004145757 -> scaling image by 1.0038256824624485
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75380144
Faked up EXPNUM 75380144
Faked up EXPNUM 75380144
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3449 3586 and amp range 2016 4031 and image y 3344 3481 and amp range 2048 4095
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp -0.0036899033 -> scaling image by 0.9966072419211972
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75180120
Faked up EXPNUM 75180120
Faked up EXPNUM 75180120
90prime get_fwhm: self.fwhm = 2.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3418 3554 and amp range 2016 4031 and image y 3361 3498 and amp range 2048 4095
Range in image: x 0 137 , y 0 138 (with image size 137 x 138)
dzp -0.0036899033 -> scaling image by 0.9966072419211972
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74600215
Faked up EXPNUM 74600215
Faked up EXPNUM 74600215
90prime get_fwhm: self.fwhm = 2.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3398 3535 and amp range 2016 4031 and image y 3351 3488 and amp range 2048 4095
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp 0.0013913503 -> scaling image by 1.001282302423891
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3517 3751 and amp range 2006 4053 and image y 1366 1603 and amp range 0 2039
Range in image: x 0 235 , y 0 238 (with image size 235 x 238)
dzp 0.001388291 -> scaling image by 1.0012794811153327
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75090100
Faked up EXPNUM 75090100
Faked up EXPNUM 75090100
90prime get_fwhm: self.fwhm = 6.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1556 1694 and amp range 0 2015 and image y 864 1001 and amp range 0 2047
Range in image: x 0 139 , y 0 138 (with image size 139 x 138)
dzp -0.011813398 -> scaling image by 0.989178436928226
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 812 1050 and amp range 0 2005 and image y 2830 3066 and amp range 2040 4078
Range in image: x 0 239 , y 0 237 (with image size 239 x 237)
dzp 0.032569118 -> scaling image by 1.0304517167935139
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78440126
Faked up EXPNUM 78440126
Faked up EXPNUM 78440126
90prime get_fwhm: self.fwhm = 4.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1418 1553 and amp range 0 2015 and image y 1334 1469 and amp range 0 2047
Range in image: x 0 136 , y 0 136 (with image size 136 x 136)
dzp 0.0029025706 -> scaling image by 1.002676942990926
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75350040
Faked up EXPNUM 75350040
Faked up EXPNUM 75350040
90prime get_fwhm: self.fwhm = 2.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3409 3546 and amp range 2016 4031 and image y 3380 3517 and amp range 2048 4095
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp 0.0013913503 -> scaling image by 1.001282302423891
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 5.96 s, CPU: 1.04 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.178628 MB
Stage tims finished: 2020-08-05T19:07:54.274223
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 6.046 s worker CPU, 34.768 s worker Wall, Wall: 5.959 s, Cores in use: 1.19, Total efficiency (on 16 cores): 7.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:07:56.339568
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01576.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01465.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/reference-custom-206776p48556.fits
Stage refs : Wall: 6.21 s, CPU: 2.16 s, VmPeak: 988 MB, VmSize: 970 MB, VmRSS: 188 MB, VmData: 219 MB, maxrss: 0.192188 MB
Stage refs finished: 2020-08-05T19:08:02.548635
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.211 s, Cores in use: 0.35, Total efficiency (on 16 cores): 2.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:08:02.631878
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outlier-mask-custom-206776p48556.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outliers-pre-custom-206776p48556.jpg
Image ksb_160313_094243_ooi_g_ls9-CCD4 g : masking 219 positive outlier pixels and 0 negative outlier pixels
Image k4m_170503_064021_ooi_zd_ls9-CCD1 z : masking 378 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outlier-mask-custom-206776p48556.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outliers-post-custom-206776p48556.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outliers-masked-pos-custom-206776p48556.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/outliers-masked-neg-custom-206776p48556.jpg
Stage outliers : Wall: 1.46 s, CPU: 1.13 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.207664 MB
Stage outliers finished: 2020-08-05T19:08:04.088602
Resources for stage outliers : 0.638 s worker CPU, 0.740 s worker Wall, Wall: 1.458 s, Cores in use: 1.22, Total efficiency (on 16 cores): 7.6 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:08:04.197026
Stage halos : Wall: 0.81 s, CPU: 0.79 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.208216 MB
Stage halos finished: 2020-08-05T19:08:05.002545
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.807 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T19:08:05.121171
PSF sigmas in coadd pixels: ['2.01', '2.16', '2.97', '4.48']
Using average PSF sigma 2.9045767004694287
Gaussian PSF norm 0.09712079275726714 vs pixelized 0.07741395
average tim pixel scale / coadd scale: 1.7303342871876248
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.04', '2.02', '2.08', '2.92']
Using average PSF sigma 2.266735157045397
Gaussian PSF norm 0.12444982418747941 vs pixelized 0.109546244
average tim pixel scale / coadd scale: 1.7296303632822
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.83', '1.83', '1.44']
Using average PSF sigma 1.6992844518803851
Gaussian PSF norm 0.16600798733944702 vs pixelized 0.14653462
average tim pixel scale / coadd scale: 0.9908948830357319
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.15 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.209812 MB
Stage fit_on_coadds finished: 2020-08-05T19:08:05.289384
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.168 s worker CPU, 0.168 s worker Wall, Wall: 0.170 s, Cores in use: 1.87, Total efficiency (on 16 cores): 11.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:08:05.300449
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 14 potential peaks
Of 14 potential peaks: 0 in veto map, 1 cut by saddle test, 0 cut by aper test, 13 kept
SED z : 13 new peaks
Found 17 potential peaks
Of 17 potential peaks: 13 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 17 potential peaks
Of 17 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 19 potential peaks
Of 19 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 19 potential peaks
Of 19 potential peaks: 16 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 17 new sources
Median coadd sky for g : 6.476407e-05
Median coadd sky for r : 2.8619581e-06
Median coadd sky for z : -9.150218e-05
Stage srcs : Wall: 1.02 s, CPU: 0.93 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.210192 MB
Stage srcs finished: 2020-08-05T19:08:06.315604
Resources for stage srcs : 0.072 s worker CPU, 0.072 s worker Wall, Wall: 1.017 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:08:06.330905
Blob 1 of 8, id: 2, sources: 11, size: 170x158, npix 11896, brick X: 9,179, Y: 44,202, one pixel: 107 44
Blob 2 of 8, id: 4, sources: 1, size: 35x37, npix 792, brick X: 181,216, Y: 64,101, one pixel: 195 64
Blob 3 of 8, id: 7, sources: 1, size: 35x30, npix 758, brick X: 169,204, Y: 203,233, one pixel: 184 203
Blob 4 of 8, id: 5, sources: 1, size: 29x28, npix 516, brick X: 204,233, Y: 123,151, one pixel: 218 123
Blob 5 of 8, id: 1, sources: 1, size: 28x27, npix 497, brick X: 89,117, Y: 16,43, one pixel: 102 16
Blob 6 of 8, id: 3, sources: 1, size: 21x25, npix 354, brick X: 0,21, Y: 60,85, one pixel: 7 60
Blob 7 of 8, id: 0, sources: 1, size: 24x23, npix 340, brick X: 195,219, Y: 9,32, one pixel: 205 9
Blob 8 of 8, id: 6, sources: 1, size: 21x21, npix 241, brick X: 131,152, Y: 170,191, one pixel: 141 170
Blob 7 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093156 MB
Blob 8 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14904 MB
Blob 5 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1497 MB
Blob 6 finished, total: Wall: 0.39 s, CPU: 0.38 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.09366 MB
Blob 4 finished, total: Wall: 0.46 s, CPU: 0.45 s, VmPeak: 802 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1493 MB
Blob 2 finished, total: Wall: 0.75 s, CPU: 0.74 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151056 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.19 s, CPU: 1.18 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151048 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.22694, ee1=0.155366, ee2=-0.140776
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 7.32 s, CPU: 7.32 s, VmPeak: 687 MB, VmSize: 684 MB, VmRSS: 111 MB, VmData: 155 MB, maxrss: 0.114096 MB
Old catalog: 19
New catalog: 19
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/blobs-custom-206776p48556.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/metrics/cus/all-models-custom-206776p48556.fits
Stage fitblobs : Wall: 7.92 s, CPU: 0.49 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.21036 MB
Stage fitblobs finished: 2020-08-05T19:08:14.247615
Resources for stage fitblobs : 10.718 s worker CPU, 11.013 s worker Wall, Wall: 7.918 s, Cores in use: 1.42, Total efficiency (on 16 cores): 8.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:08:14.259314
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-resid.jpg
Stage coadds : Wall: 2.77 s, CPU: 0.83 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 206 MB, VmData: 231 MB, maxrss: 0.210876 MB
Stage coadds finished: 2020-08-05T19:08:17.029491
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 7.792 s worker CPU, 12.219 s worker Wall, Wall: 2.772 s, Cores in use: 3.11, Total efficiency (on 16 cores): 19.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T19:08:17.045430
Cut to 1 unWISE tiles
Reading WISE tile 2069p484 band 1
Reading WISE tile 2069p484 band 4
Reading WISE tile 2069p484 band 2
Reading WISE tile 2069p484 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 811 MB, VmSize: 809 MB, VmRSS: 150 MB, VmData: 177 MB, maxrss: 0.192368 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210052 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 863 MB, VmSize: 863 MB, VmRSS: 204 MB, VmData: 235 MB, maxrss: 0.208896 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.2094 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/tmp-legacysurvey-custom-206776p48556-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.33 s, CPU: 1.56 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 207 MB, VmData: 231 MB, maxrss: 0.21158 MB
Stage wise_forced finished: 2020-08-05T19:08:22.371285
Resources for stage wise_forced : 2.876 s worker CPU, 9.517 s worker Wall, Wall: 5.327 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:08:22.383907
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/coadd/cus/custom-206776p48556/legacysurvey-custom-206776p48556-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/tractor-i/cus/tractor-custom-206776p48556.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/tractor/cus/tractor-custom-206776p48556.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/tractor/cus/brick-custom-206776p48556.sha256sum
Stage writecat : Wall: 1.15 s, CPU: 0.64 s, VmPeak: 1112 MB, VmSize: 984 MB, VmRSS: 208 MB, VmData: 231 MB, maxrss: 0.344572 MB
Stage writecat finished: 2020-08-05T19:08:23.535749
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.153 s, Cores in use: 0.56, Total efficiency (on 16 cores): 3.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/206/PGC2320176/PGC2320176-largegalaxy-writecat.p
All done: 28.314 s worker CPU, 68.501 s worker Wall, Wall: 35.237 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.8 %
Finished galaxy PGC2320176 in 0.667 minutes.
Started working on galaxy PGC2320176 at Fri Aug  7 09:17:20 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.77663828396177 48.55711147768947 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T09:17:22.023189
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '206.77663828396177', '48.55711147768947', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.77663828396177 48.55711147768947 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 206.77663828396177 48.55711147768947
Starting process 7478 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 7480 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 7482 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 7484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 7486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB
Starting process 7488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB
Starting process 7490 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB
Starting process 7492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 7494 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 7496 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 7497 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 7499 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 7501 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 7505 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 7503 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 7507 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T09:17:32.937032
Keeping 11 CCDs:
  k4m_160418_073440_ooi_zd_ls9-CCD1 z expnum 83031 exptime 80.107 propid 2016A-0453 seeing 1.12 MJD 57496.316 object MzLS_643700_z 
    mosaic/CP/V4.3/CP20160417/k4m_160418_073440_ooi_zd_ls9.fits.fz
  k4m_160525_053528_ooi_zd_ls9-CCD2 z expnum 91371 exptime 80.104 propid 2016A-0453 seeing 1.13 MJD 57533.233 object MzLS_642866_z 
    mosaic/CP/V4.3/CP20160524/k4m_160525_053528_ooi_zd_ls9.fits.fz
  k4m_170503_064021_ooi_zd_ls9-CCD1 z expnum 126126 exptime 80.103 propid 2016A-0453 seeing 0.89 MJD 57876.278 object MzLS_644529_z 
    mosaic/CP/V4.3/CP20170502/k4m_170503_064021_ooi_zd_ls9.fits.fz
  ksb_160527_034840_ooi_g_ls9-CCD4 g expnum 75350040 exptime 138.5 propid BASS seeing 1.24 MJD 57535.159 object 25601 
    90prime/CP/V2.3/CP20160526/ksb_160527_034840_ooi_g_ls9.fits.fz
  ksb_160510_064553_ooi_r_ls9-CCD4 r expnum 75180120 exptime 50.1 propid BASS seeing 1.26 MJD 57518.282 object 25601 
    90prime/CP/V2.3/CP20160509/ksb_160510_064553_ooi_r_ls9.fits.fz
  ksb_160313_094243_ooi_g_ls9-CCD4 g expnum 74600215 exptime 72.2 propid 2015A-0801 seeing 1.33 MJD 57460.405 object 25601 
    90prime/CP/V2.3/CP20160312/ksb_160313_094243_ooi_g_ls9.fits.fz
  ksb_160530_074058_ooi_r_ls9-CCD4 r expnum 75380144 exptime 64.099 propid BASS seeing 1.25 MJD 57538.320 object 25601 
    90prime/CP/V2.3/CP20160529/ksb_160530_074058_ooi_r_ls9.fits.fz
  ksb_170420_085329_ooi_r_ls9-CCD4 r expnum 78630150 exptime 70.61 propid BASS seeing 1.28 MJD 57863.370 object 25603 
    90prime/CP/V2.3/CP20170419/ksb_170420_085329_ooi_r_ls9.fits.fz
  ksb_170401_093036_ooi_g_ls9-CCD4 g expnum 78440126 exptime 121.283 propid BASS seeing 1.83 MJD 57844.396 object 25603 
    90prime/CP/V2.3/CP20170331/ksb_170401_093036_ooi_g_ls9.fits.fz
  ksb_160501_072902_ooi_g_ls9-CCD1 g expnum 75090100 exptime 190.5 propid BASS seeing 2.76 MJD 57509.312 object 24402 
    90prime/CP/V2.3/CP20160430/ksb_160501_072902_ooi_g_ls9.fits.fz
  ksb_160605_053231_ooi_r_ls9-CCD1 r expnum 75440062 exptime 60.5 propid BASS seeing 1.80 MJD 57544.231 object 24402 
    90prime/CP/V2.3/CP20160604/ksb_160605_053231_ooi_r_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 4.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3520 3754 and amp range 2006 4053 and image y 1364 1601 and amp range 0 2039
Range in image: x 0 235 , y 0 238 (with image size 235 x 238)
dzp 0.001388291 -> scaling image by 1.0012794811153327
mosaic get_fwhm: self.fwhm = 3.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 815 1053 and amp range 0 2005 and image y 2828 3064 and amp range 2040 4078
Range in image: x 0 239 , y 0 237 (with image size 239 x 237)
dzp 0.032569118 -> scaling image by 1.0304517167935139
mosaic get_fwhm: self.fwhm = 4.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1932 2167 and amp range 0 2047 and image y 3417 3651 and amp range 2040 4078
Range in image: x 0 116 , y 0 235 (with image size 236 x 235)
dzp 0.008550294 -> scaling image by 1.0079062018164673
Found overlap: image x 1932 2167 and amp range 2048 4095 and image y 3417 3651 and amp range 2040 4078
Range in image: x 116 236 , y 0 235 (with image size 236 x 235)
dzp -0.009154885 -> scaling image by 0.9916034885139223
Faked up EXPNUM 75440062
Faked up EXPNUM 75440062
Faked up EXPNUM 75440062
90prime get_fwhm: self.fwhm = 3.97
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1554 1692 and amp range 0 2015 and image y 851 988 and amp range 0 2047
Range in image: x 0 139 , y 0 138 (with image size 139 x 138)
dzp -0.01149955 -> scaling image by 0.9894644150522871
Faked up EXPNUM 78440126
Faked up EXPNUM 78440126
Faked up EXPNUM 78440126
90prime get_fwhm: self.fwhm = 4.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1416 1552 and amp range 0 2015 and image y 1335 1470 and amp range 0 2047
Range in image: x 0 137 , y 0 136 (with image size 137 x 136)
dzp 0.0029025706 -> scaling image by 1.002676942990926
Faked up EXPNUM 78630150
Faked up EXPNUM 78630150
Faked up EXPNUM 78630150
90prime get_fwhm: self.fwhm = 2.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1405 1540 and amp range 0 2015 and image y 1337 1472 and amp range 0 2047
Range in image: x 0 136 , y 0 136 (with image size 136 x 136)
dzp 0.004145757 -> scaling image by 1.0038256824624485
Faked up EXPNUM 75090100
Faked up EXPNUM 75090100
Faked up EXPNUM 75090100
90prime get_fwhm: self.fwhm = 6.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1554 1692 and amp range 0 2015 and image y 865 1003 and amp range 0 2047
Range in image: x 0 139 , y 0 139 (with image size 139 x 139)
dzp -0.011813398 -> scaling image by 0.989178436928226
Faked up EXPNUM 75350040
Faked up EXPNUM 75350040
Faked up EXPNUM 75350040
90prime get_fwhm: self.fwhm = 2.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3408 3544 and amp range 2016 4031 and image y 3381 3518 and amp range 2048 4095
Range in image: x 0 137 , y 0 138 (with image size 137 x 138)
dzp 0.0013913503 -> scaling image by 1.001282302423891
Faked up EXPNUM 75380144
Faked up EXPNUM 75380144
Faked up EXPNUM 75380144
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3447 3584 and amp range 2016 4031 and image y 3345 3482 and amp range 2048 4095
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp -0.0036899033 -> scaling image by 0.9966072419211972
Faked up EXPNUM 74600215
Faked up EXPNUM 74600215
Faked up EXPNUM 74600215
90prime get_fwhm: self.fwhm = 2.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3397 3533 and amp range 2016 4031 and image y 3352 3489 and amp range 2048 4095
Range in image: x 0 137 , y 0 138 (with image size 137 x 138)
dzp 0.0013913503 -> scaling image by 1.001282302423891
Faked up EXPNUM 75180120
Faked up EXPNUM 75180120
Faked up EXPNUM 75180120
90prime get_fwhm: self.fwhm = 2.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3416 3553 and amp range 2016 4031 and image y 3362 3499 and amp range 2048 4095
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp -0.0036899033 -> scaling image by 0.9966072419211972
Stage tims : Wall: 96.57 s, CPU: 4.96 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.176848 MB
Stage tims finished: 2020-08-07T09:19:09.504550
Resources for stage tims : 5.933 s worker CPU, 462.102 s worker Wall, Wall: 96.569 s, Cores in use: 0.11, Total efficiency (on 16 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T09:19:09.527258
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01576.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01465.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/metrics/cus/reference-custom-206776p48557.fits
Stage refs : Wall: 5.67 s, CPU: 1.43 s, VmPeak: 982 MB, VmSize: 964 MB, VmRSS: 186 MB, VmData: 219 MB, maxrss: 0.1902 MB
Stage refs finished: 2020-08-07T09:19:15.198956
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.673 s, Cores in use: 0.25, Total efficiency (on 16 cores): 1.6 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T09:19:15.238393
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/metrics/cus/outlier-mask-custom-206776p48557.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/metrics/cus/outliers-pre-custom-206776p48557.jpg
Image ksb_160313_094243_ooi_g_ls9-CCD4 g : masking 219 positive outlier pixels and 0 negative outlier pixels
Image k4m_170503_064021_ooi_zd_ls9-CCD1 z : masking 480 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/metrics/cus/outlier-mask-custom-206776p48557.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/metrics/cus/outliers-post-custom-206776p48557.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/metrics/cus/outliers-masked-pos-custom-206776p48557.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/metrics/cus/outliers-masked-neg-custom-206776p48557.jpg
Stage outliers : Wall: 0.86 s, CPU: 0.65 s, VmPeak: 982 MB, VmSize: 973 MB, VmRSS: 200 MB, VmData: 230 MB, maxrss: 0.204856 MB
Stage outliers finished: 2020-08-07T09:19:16.098463
Resources for stage outliers : 0.645 s worker CPU, 0.757 s worker Wall, Wall: 0.861 s, Cores in use: 1.50, Total efficiency (on 16 cores): 9.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T09:19:16.218868
Stage halos : Wall: 0.26 s, CPU: 0.25 s, VmPeak: 982 MB, VmSize: 974 MB, VmRSS: 200 MB, VmData: 230 MB, maxrss: 0.205132 MB
Stage halos finished: 2020-08-07T09:19:16.477389
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.260 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T09:19:16.554477
PSF sigmas in coadd pixels: ['2.01', '2.16', '2.97', '4.48']
Using average PSF sigma 2.9045767004694287
Gaussian PSF norm 0.09712079275726714 vs pixelized 0.07741506
average tim pixel scale / coadd scale: 1.7303342871876248
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.04', '2.02', '2.08', '2.92']
Using average PSF sigma 2.266735157045397
Gaussian PSF norm 0.12444982418747941 vs pixelized 0.10954761
average tim pixel scale / coadd scale: 1.7296303632822
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.83', '1.83', '1.44']
Using average PSF sigma 1.6992844518803851
Gaussian PSF norm 0.16600798733944702 vs pixelized 0.146526
average tim pixel scale / coadd scale: 0.9908948830357319
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.15 s, VmPeak: 982 MB, VmSize: 974 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.207396 MB
Stage fit_on_coadds finished: 2020-08-07T09:19:16.707143
Resources for stage fit_on_coadds : 0.161 s worker CPU, 0.161 s worker Wall, Wall: 0.154 s, Cores in use: 2.01, Total efficiency (on 16 cores): 12.5 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T09:19:16.731613
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 15 potential peaks
Of 15 potential peaks: 1 in veto map, 2 cut by saddle test, 0 cut by aper test, 12 kept
SED z : 12 new peaks
Found 16 potential peaks
Of 16 potential peaks: 13 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 17 potential peaks
Of 17 potential peaks: 13 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 19 potential peaks
Of 19 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 19 potential peaks
Of 19 potential peaks: 16 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 16 new sources
Median coadd sky for g : 6.935659e-05
Median coadd sky for r : -2.6334934e-07
Median coadd sky for z : -8.2661085e-05
Stage srcs : Wall: 0.45 s, CPU: 0.41 s, VmPeak: 982 MB, VmSize: 974 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.207988 MB
Stage srcs finished: 2020-08-07T09:19:17.180510
Resources for stage srcs : 0.068 s worker CPU, 0.090 s worker Wall, Wall: 0.450 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T09:19:17.198800
Blob 1 of 9, id: 2, sources: 9, size: 148x158, npix 11080, brick X: 7,155, Y: 41,199, one pixel: 105 41
Blob 2 of 9, id: 8, sources: 1, size: 37x33, npix 854, brick X: 167,204, Y: 200,233, one pixel: 182 200
Blob 3 of 9, id: 5, sources: 1, size: 39x30, npix 812, brick X: 138,177, Y: 67,97, one pixel: 151 67
Blob 4 of 9, id: 4, sources: 1, size: 35x37, npix 791, brick X: 179,214, Y: 61,98, one pixel: 193 61
Blob 5 of 9, id: 6, sources: 1, size: 29x28, npix 516, brick X: 202,231, Y: 120,148, one pixel: 216 120
Blob 6 of 9, id: 1, sources: 1, size: 29x27, npix 498, brick X: 86,115, Y: 13,40, one pixel: 100 13
Blob 7 of 9, id: 0, sources: 1, size: 24x23, npix 340, brick X: 193,217, Y: 6,29, one pixel: 203 6
Blob 8 of 9, id: 3, sources: 1, size: 19x25, npix 310, brick X: 0,19, Y: 57,82, one pixel: 6 57
Blob 9 of 9, id: 7, sources: 1, size: 21x21, npix 250, brick X: 129,150, Y: 167,188, one pixel: 139 167
Blob 9 finished, total: Wall: 0.24 s, CPU: 0.17 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145724 MB
Blob 6 finished, total: Wall: 0.25 s, CPU: 0.18 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145508 MB
Blob 7 finished, total: Wall: 0.31 s, CPU: 0.24 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145476 MB
Blob 8 finished, total: Wall: 0.44 s, CPU: 0.36 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.1453 MB
Blob 5 finished, total: Wall: 0.58 s, CPU: 0.51 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094156 MB
Blob 4 finished, total: Wall: 0.88 s, CPU: 0.81 s, VmPeak: 802 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145264 MB
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.08 s, CPU: 1.00 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146772 MB
Blob 2 finished, total: Wall: 1.29 s, CPU: 1.22 s, VmPeak: 803 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.145992 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.978999, ee1=0.101721, ee2=-0.126708
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 6.39 s, CPU: 6.37 s, VmPeak: 686 MB, VmSize: 683 MB, VmRSS: 107 MB, VmData: 151 MB, maxrss: 0.111116 MB
Old catalog: 18
New catalog: 19
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/metrics/cus/blobs-custom-206776p48557.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/metrics/cus/all-models-custom-206776p48557.fits
Stage fitblobs : Wall: 14.92 s, CPU: 0.31 s, VmPeak: 982 MB, VmSize: 974 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.208152 MB
Stage fitblobs finished: 2020-08-07T09:19:32.122396
Resources for stage fitblobs : 10.992 s worker CPU, 11.724 s worker Wall, Wall: 14.925 s, Cores in use: 0.76, Total efficiency (on 16 cores): 4.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T09:19:32.149527
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/tmp-legacysurvey-custom-206776p48557-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/tmp-legacysurvey-custom-206776p48557-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/tmp-legacysurvey-custom-206776p48557-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/tmp-legacysurvey-custom-206776p48557-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-resid.jpg
Stage coadds : Wall: 8.94 s, CPU: 0.54 s, VmPeak: 982 MB, VmSize: 974 MB, VmRSS: 204 MB, VmData: 231 MB, maxrss: 0.208664 MB
Stage coadds finished: 2020-08-07T09:19:41.086606
Resources for stage coadds : 7.776 s worker CPU, 9.260 s worker Wall, Wall: 8.938 s, Cores in use: 0.93, Total efficiency (on 16 cores): 5.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T09:19:41.096475
Cut to 1 unWISE tiles
Reading WISE tile 2069p484 band 1
Reading WISE tile 2069p484 band 4
Reading WISE tile 2069p484 band 3
Reading WISE tile 2069p484 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.10 s, VmPeak: 811 MB, VmSize: 801 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.187804 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 809 MB, VmSize: 809 MB, VmRSS: 151 MB, VmData: 180 MB, maxrss: 0.206352 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 802 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.20696 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/206/2069p484/unwise-2069p484-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 814 MB, VmSize: 792 MB, VmRSS: 137 MB, VmData: 170 MB, maxrss: 0.200012 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/tmp-legacysurvey-custom-206776p48557-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/tmp-legacysurvey-custom-206776p48557-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.93 s, CPU: 0.43 s, VmPeak: 982 MB, VmSize: 974 MB, VmRSS: 204 MB, VmData: 231 MB, maxrss: 0.209312 MB
Stage wise_forced finished: 2020-08-07T09:19:45.021888
Resources for stage wise_forced : 3.162 s worker CPU, 8.789 s worker Wall, Wall: 3.927 s, Cores in use: 0.92, Total efficiency (on 16 cores): 5.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T09:19:45.032663
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/coadd/cus/custom-206776p48557/legacysurvey-custom-206776p48557-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/tractor-i/cus/tractor-custom-206776p48557.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/tractor/cus/tractor-custom-206776p48557.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/tractor/cus/brick-custom-206776p48557.sha256sum
Stage writecat : Wall: 0.78 s, CPU: 0.53 s, VmPeak: 1106 MB, VmSize: 978 MB, VmRSS: 206 MB, VmData: 231 MB, maxrss: 0.342304 MB
Stage writecat finished: 2020-08-07T09:19:45.810816
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.780 s, Cores in use: 0.68, Total efficiency (on 16 cores): 4.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC2320176/PGC2320176-largegalaxy-writecat.p
All done: 28.741 s worker CPU, 492.887 s worker Wall, Wall: 132.889 s, Cores in use: 0.29, Total efficiency (on 16 cores): 1.8 %
Finished galaxy PGC2320176 in 2.438 minutes.