Started working on galaxy PGC2313362 at Wed Aug  5 18:58:03 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.141418 48.2448158 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T18:58:04.928784
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.141418', '48.2448158', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.141418 48.2448158 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 272.141418 48.2448158
Starting process 46100 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 46101 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 46102 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 46103 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 46104 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 46105 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 46106 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 46107 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 46108 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 46109 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 46110 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 46111 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 46112 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 46113 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 46114 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 46115 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 46116 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 46117 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 46118 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 46119 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 46120 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 46121 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 46122 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 46123 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 46124 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 46125 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 46126 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 46127 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 46128 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 46129 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 46130 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 46131 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T18:58:05.466081
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 10 CCDs:
  k4m_160518_095133_ooi_zd_ls9-CCD2 z expnum 89996 exptime 80.105 propid 2016A-0453 seeing 1.14 MJD 57526.411 object MzLS_641267_z 
    mosaic/CP/V4.3/CP20160517/k4m_160518_095133_ooi_zd_ls9.fits.fz
  k4m_160516_100502_ooi_zd_ls9-CCD1 z expnum 89295 exptime 80.103 propid 2016A-0453 seeing 1.15 MJD 57524.420 object MzLS_642942_z 
    mosaic/CP/V4.3/CP20160515/k4m_160516_100502_ooi_zd_ls9.fits.fz
  k4m_170531_111320_ooi_zd_ls9-CCD4 z expnum 130990 exptime 250.105 propid 2016A-0453 seeing 1.50 MJD 57904.468 object MzLS_642106_z 
    mosaic/CP/V4.3/CP20170530/k4m_170531_111320_ooi_zd_ls9.fits.fz
  ksb_170527_091338_ooi_g_ls9-CCD1 g expnum 79000145 exptime 99.9 propid 2015A-0801 seeing 1.14 MJD 57900.384 object 24841 
    90prime/CP/V2.3/CP20170526/ksb_170527_091338_ooi_g_ls9.fits.fz
  ksb_180518_102810_ooi_r_ls9-CCD2 r expnum 82560198 exptime 87.08 propid NOTBASS seeing 1.16 MJD 58256.436 object 26023 
    90prime/CP/V2.3/CP20180517/ksb_180518_102810_ooi_r_ls9.fits.fz
  ksb_170619_054514_ooi_g_ls9-CCD2 g expnum 79230078 exptime 209.283 propid BASS seeing 1.61 MJD 57923.240 object 26023 
    90prime/CP/V2.3/CP20170618/ksb_170619_054514_ooi_g_ls9.fits.fz
  ksb_160706_074633_ooi_g_ls9-CCD4 g expnum 75750109 exptime 95.8 propid BASS seeing 1.86 MJD 57575.324 object 24842 
    90prime/CP/V2.3/CP20160705/ksb_160706_074633_ooi_g_ls9.fits.fz
  ksb_160612_102749_ooi_r_ls9-CCD4 r expnum 75510123 exptime 78.0 propid BASS seeing 1.21 MJD 57551.436 object 24842 
    90prime/CP/V2.3/CP20160611/ksb_160612_102749_ooi_r_ls9.fits.fz
  ksb_180518_103014_ooi_r_ls9-CCD1 r expnum 82560199 exptime 80.78 propid NOTBASS seeing 1.26 MJD 58256.438 object 24843 
    90prime/CP/V2.3/CP20180517/ksb_180518_103014_ooi_r_ls9.fits.fz
  ksb_170619_055312_ooi_g_ls9-CCD1 g expnum 79230080 exptime 159.498 propid BASS seeing 1.98 MJD 57923.245 object 24843 
    90prime/CP/V2.3/CP20170618/ksb_170619_055312_ooi_g_ls9.fits.fz
Faked up EXPNUM 82560199
Faked up EXPNUM 82560199
Faked up EXPNUM 82560199
90prime get_fwhm: self.fwhm = 2.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 73 212 and amp range 0 2015 and image y 2120 2257 and amp range 2048 4095
Range in image: x 0 140 , y 0 138 (with image size 140 x 138)
dzp -0.05213645 -> scaling image by 0.953115252660837
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75750109
Faked up EXPNUM 75750109
Faked up EXPNUM 75750109
90prime get_fwhm: self.fwhm = 4.11
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 60 and amp range 0 2015 and image y 1603 1739 and amp range 0 2047
Range in image: x 0 46 , y 0 137 (with image size 46 x 137)
dzp 0.009539392 -> scaling image by 1.0088248156909383
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79230080
Faked up EXPNUM 79230080
Faked up EXPNUM 79230080
90prime get_fwhm: self.fwhm = 4.37
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 75 214 and amp range 0 2015 and image y 2107 2244 and amp range 2048 4095
Range in image: x 0 140 , y 0 138 (with image size 140 x 138)
dzp -0.034377232 -> scaling image by 0.9688334104074875
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 5.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 335 570 and amp range 0 2047 and image y 203 437 and amp range 0 2021
Range in image: x 0 236 , y 0 235 (with image size 236 x 235)
dzp -0.018417627 -> scaling image by 0.9831798050134541
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3022 3259 and amp range 2048 4095 and image y 3702 3937 and amp range 2040 4078
Range in image: x 0 238 , y 0 236 (with image size 238 x 236)
dzp -0.009154885 -> scaling image by 0.9916034885139223
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1885 2122 and amp range 0 2005 and image y 1137 1376 and amp range 0 2039
Range in image: x 0 121 , y 0 240 (with image size 238 x 240)
dzp -0.011066288 -> scaling image by 0.989859339076806
Found overlap: image x 1885 2122 and amp range 2006 4053 and image y 1137 1376 and amp range 0 2039
Range in image: x 121 238 , y 0 240 (with image size 238 x 240)
dzp 0.001388291 -> scaling image by 1.0012794811153327
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 82560198
Faked up EXPNUM 82560198
Faked up EXPNUM 82560198
90prime get_fwhm: self.fwhm = 2.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3838 3976 and amp range 2016 4031 and image y 1596 1734 and amp range 0 2047
Range in image: x 0 139 , y 0 139 (with image size 139 x 139)
dzp 0.014483032 -> scaling image by 1.0134287315188357
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79230078
Faked up EXPNUM 79230078
Faked up EXPNUM 79230078
90prime get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3854 3992 and amp range 2016 4031 and image y 1606 1744 and amp range 0 2047
Range in image: x 0 139 , y 0 139 (with image size 139 x 139)
dzp 0.01918938 -> scaling image by 1.017831182878158
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75510123
Faked up EXPNUM 75510123
Faked up EXPNUM 75510123
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 69 and amp range 0 2015 and image y 1598 1734 and amp range 0 2047
Range in image: x 0 55 , y 0 137 (with image size 55 x 137)
dzp 0.009781551 -> scaling image by 1.0090498455107675
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 7.33 s, CPU: 0.88 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 173 MB, VmData: 205 MB, maxrss: 0.177264 MB
Stage tims finished: 2020-08-05T18:58:12.796703
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 4.803 s worker CPU, 28.474 s worker Wall, Wall: 7.334 s, Cores in use: 0.78, Total efficiency (on 32 cores): 2.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-tims.p
Running stage refs
Faked up EXPNUM 79000145
Faked up EXPNUM 79000145
Faked up EXPNUM 79000145
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T18:58:21.352726
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01596.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01485.fits
Matched 6 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/reference-custom-272141p48244.fits
Stage refs : Wall: 10.98 s, CPU: 4.14 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 222 MB, VmData: 252 MB, maxrss: 0.227336 MB
Stage refs finished: 2020-08-05T18:58:32.336330
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.986 s, Cores in use: 0.38, Total efficiency (on 32 cores): 1.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-refs.p
Running stage outliers
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage outliers at 2020-08-05T18:58:32.406004
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outlier-mask-custom-272141p48244.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outliers-pre-custom-272141p48244.jpg
Image ksb_170619_054514_ooi_g_ls9-CCD2 g : masking 75 positive outlier pixels and 0 negative outlier pixels
Image ksb_160706_074633_ooi_g_ls9-CCD4 g : masking 30 positive outlier pixels and 0 negative outlier pixels
Image ksb_170619_055312_ooi_g_ls9-CCD1 g : masking 46 positive outlier pixels and 0 negative outlier pixels
Image k4m_170531_111320_ooi_zd_ls9-CCD4 z : masking 768 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outlier-mask-custom-272141p48244.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outliers-post-custom-272141p48244.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outliers-masked-pos-custom-272141p48244.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outliers-masked-neg-custom-272141p48244.jpg
Stage outliers : Wall: 0.84 s, CPU: 0.56 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.239516 MB
Stage outliers finished: 2020-08-05T18:58:33.248344
Resources for stage outliers : 0.669 s worker CPU, 0.851 s worker Wall, Wall: 0.844 s, Cores in use: 1.45, Total efficiency (on 32 cores): 4.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T18:58:33.268068
Stage halos : Wall: 0.22 s, CPU: 0.22 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.239612 MB
Stage halos finished: 2020-08-05T18:58:33.491852
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.226 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T18:58:33.590464
PSF sigmas in coadd pixels: ['2.61', '3.03', '3.21']
Using average PSF sigma 2.9503719959381045
Gaussian PSF norm 0.09561329627662186 vs pixelized 0.08247775
average tim pixel scale / coadd scale: 1.7290551905015497
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.88', '1.97', '2.04']
Using average PSF sigma 1.960837988455338
Gaussian PSF norm 0.14386440564429295 vs pixelized 0.11690897
average tim pixel scale / coadd scale: 1.7301607139422805
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.85', '1.87', '2.43']
Using average PSF sigma 2.050803020145786
Gaussian PSF norm 0.13755333350046695 vs pixelized 0.1279782
average tim pixel scale / coadd scale: 0.9909627327290257
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.13 s, CPU: 0.11 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 236 MB, VmData: 261 MB, maxrss: 0.24126 MB
Stage fit_on_coadds finished: 2020-08-05T18:58:33.720252
Resources for stage fit_on_coadds : 0.105 s worker CPU, 0.119 s worker Wall, Wall: 0.132 s, Cores in use: 1.69, Total efficiency (on 32 cores): 5.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T18:58:33.730151
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 20 potential peaks
Of 20 potential peaks: 4 in veto map, 3 cut by saddle test, 0 cut by aper test, 13 kept
SED z : 13 new peaks
Found 29 potential peaks
Of 29 potential peaks: 21 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 16 potential peaks
Of 16 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 34 potential peaks
Of 34 potential peaks: 26 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 38 potential peaks
Of 38 potential peaks: 33 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 23 new sources
Median coadd sky for g : 0.000113990296
Median coadd sky for r : 0.00022629887
Median coadd sky for z : -5.586944e-06
Stage srcs : Wall: 0.47 s, CPU: 0.44 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 236 MB, VmData: 261 MB, maxrss: 0.241764 MB
Stage srcs finished: 2020-08-05T18:58:34.204390
Resources for stage srcs : 0.075 s worker CPU, 0.075 s worker Wall, Wall: 0.476 s, Cores in use: 1.08, Total efficiency (on 32 cores): 3.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T18:58:34.216666
Blob 1 of 8, id: 4, sources: 16, size: 200x163, npix 17542, brick X: 0,200, Y: 56,219, one pixel: 117 56
Blob 2 of 8, id: 0, sources: 5, size: 75x53, npix 2517, brick X: 2,77, Y: 0,53, one pixel: 20 0
Blob 3 of 8, id: 1, sources: 2, size: 45x41, npix 1031, brick X: 152,197, Y: 15,56, one pixel: 175 15
Blob 4 of 8, id: 6, sources: 1, size: 24x23, npix 340, brick X: 135,159, Y: 193,216, one pixel: 145 193
Blob 5 of 8, id: 5, sources: 1, size: 24x23, npix 339, brick X: 200,224, Y: 162,185, one pixel: 211 162
Blob 6 of 8, id: 3, sources: 1, size: 21x21, npix 259, brick X: 19,40, Y: 56,77, one pixel: 29 56
Blob 7 of 8, id: 2, sources: 1, size: 20x20, npix 229, brick X: 121,141, Y: 34,54, one pixel: 129 34
Blob 8 of 8, id: 7, sources: 1, size: 17x17, npix 145, brick X: 202,219, Y: 216,233, one pixel: 210 216
Blob 6 finished, total: Wall: 0.13 s, CPU: 0.12 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148448 MB
Blob 5 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149608 MB
Blob 8 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092192 MB
Blob 7 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 140 MB, maxrss: 0.09362 MB
Blob 4 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092308 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 117 MB, VmData: 161 MB, maxrss: 0.119792 MB
Blob 2 finished, total: Wall: 1.75 s, CPU: 1.75 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149708 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.17159, ee1=0.0711959, ee2=-0.0650319
Measuring 3 iterative sources
Blob 1 finished, total: Wall: 11.37 s, CPU: 11.37 s, VmPeak: 692 MB, VmSize: 687 MB, VmRSS: 119 MB, VmData: 158 MB, maxrss: 0.123128 MB
Old catalog: 29
New catalog: 28
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/blobs-custom-272141p48244.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/all-models-custom-272141p48244.fits
Stage fitblobs : Wall: 11.75 s, CPU: 0.35 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 237 MB, VmData: 262 MB, maxrss: 0.24262 MB
Stage fitblobs finished: 2020-08-05T18:58:45.962534
Resources for stage fitblobs : 15.512 s worker CPU, 15.565 s worker Wall, Wall: 11.748 s, Cores in use: 1.35, Total efficiency (on 32 cores): 4.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T18:58:45.975532
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-resid.jpg
Stage coadds : Wall: 9.03 s, CPU: 0.56 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 237 MB, VmData: 262 MB, maxrss: 0.24294 MB
Stage coadds finished: 2020-08-05T18:58:55.000729
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 28.188 s worker CPU, 48.601 s worker Wall, Wall: 9.028 s, Cores in use: 3.19, Total efficiency (on 32 cores): 10.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T18:58:55.016189
Cut to 1 unWISE tiles
Reading WISE tile 2722p484 band 2
Reading WISE tile 2722p484 band 3
Reading WISE tile 2722p484 band 1
Reading WISE tile 2722p484 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 811 MB, VmSize: 804 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.186328 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 812 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.206828 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.209992 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 802 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.207632 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 6.87 s, CPU: 0.54 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 238 MB, VmData: 262 MB, maxrss: 0.243456 MB
Stage wise_forced finished: 2020-08-05T18:59:01.882927
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.192 s worker CPU, 10.619 s worker Wall, Wall: 6.869 s, Cores in use: 0.54, Total efficiency (on 32 cores): 1.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T18:59:01.898631
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/tractor-i/cus/tractor-custom-272141p48244.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/tractor/cus/tractor-custom-272141p48244.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/tractor/cus/brick-custom-272141p48244.sha256sum
Stage writecat : Wall: 1.06 s, CPU: 0.57 s, VmPeak: 1146 MB, VmSize: 1018 MB, VmRSS: 240 MB, VmData: 262 MB, maxrss: 0.3764 MB
Stage writecat finished: 2020-08-05T18:59:02.963433
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.067 s, Cores in use: 0.53, Total efficiency (on 32 cores): 1.7 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-writecat.p
All done: 52.550 s worker CPU, 104.312 s worker Wall, Wall: 57.520 s, Cores in use: 1.06, Total efficiency (on 32 cores): 3.3 %
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Finished galaxy PGC2313362 in 1.006 minutes.
Started working on galaxy PGC2313362 at Wed Aug  5 19:04:45 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.141418 48.2448158 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:04:47.923233
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.141418', '48.2448158', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.141418 48.2448158 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 272.141418 48.2448158
Starting process 47363 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 47364 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47365 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47366 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47367 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB
Starting process 47368 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059428 MB
Starting process 47369 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059428 MB
Starting process 47370 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 47371 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 47372 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 47373 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 47374 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 47375 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 47376 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 47377 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 47378 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:04:49.755439
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 10 CCDs:
  k4m_160518_095133_ooi_zd_ls9-CCD2 z expnum 89996 exptime 80.105 propid 2016A-0453 seeing 1.14 MJD 57526.411 object MzLS_641267_z 
    mosaic/CP/V4.3/CP20160517/k4m_160518_095133_ooi_zd_ls9.fits.fz
  k4m_160516_100502_ooi_zd_ls9-CCD1 z expnum 89295 exptime 80.103 propid 2016A-0453 seeing 1.15 MJD 57524.420 object MzLS_642942_z 
    mosaic/CP/V4.3/CP20160515/k4m_160516_100502_ooi_zd_ls9.fits.fz
  k4m_170531_111320_ooi_zd_ls9-CCD4 z expnum 130990 exptime 250.105 propid 2016A-0453 seeing 1.50 MJD 57904.468 object MzLS_642106_z 
    mosaic/CP/V4.3/CP20170530/k4m_170531_111320_ooi_zd_ls9.fits.fz
  ksb_170527_091338_ooi_g_ls9-CCD1 g expnum 79000145 exptime 99.9 propid 2015A-0801 seeing 1.14 MJD 57900.384 object 24841 
    90prime/CP/V2.3/CP20170526/ksb_170527_091338_ooi_g_ls9.fits.fz
  ksb_180518_102810_ooi_r_ls9-CCD2 r expnum 82560198 exptime 87.08 propid NOTBASS seeing 1.16 MJD 58256.436 object 26023 
    90prime/CP/V2.3/CP20180517/ksb_180518_102810_ooi_r_ls9.fits.fz
  ksb_170619_054514_ooi_g_ls9-CCD2 g expnum 79230078 exptime 209.283 propid BASS seeing 1.61 MJD 57923.240 object 26023 
    90prime/CP/V2.3/CP20170618/ksb_170619_054514_ooi_g_ls9.fits.fz
  ksb_160706_074633_ooi_g_ls9-CCD4 g expnum 75750109 exptime 95.8 propid BASS seeing 1.86 MJD 57575.324 object 24842 
    90prime/CP/V2.3/CP20160705/ksb_160706_074633_ooi_g_ls9.fits.fz
  ksb_160612_102749_ooi_r_ls9-CCD4 r expnum 75510123 exptime 78.0 propid BASS seeing 1.21 MJD 57551.436 object 24842 
    90prime/CP/V2.3/CP20160611/ksb_160612_102749_ooi_r_ls9.fits.fz
  ksb_180518_103014_ooi_r_ls9-CCD1 r expnum 82560199 exptime 80.78 propid NOTBASS seeing 1.26 MJD 58256.438 object 24843 
    90prime/CP/V2.3/CP20180517/ksb_180518_103014_ooi_r_ls9.fits.fz
  ksb_170619_055312_ooi_g_ls9-CCD1 g expnum 79230080 exptime 159.498 propid BASS seeing 1.98 MJD 57923.245 object 24843 
    90prime/CP/V2.3/CP20170618/ksb_170619_055312_ooi_g_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 5.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 335 570 and amp range 0 2047 and image y 203 437 and amp range 0 2021
Range in image: x 0 236 , y 0 235 (with image size 236 x 235)
dzp -0.018417627 -> scaling image by 0.9831798050134541
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1885 2122 and amp range 0 2005 and image y 1137 1376 and amp range 0 2039
Range in image: x 0 121 , y 0 240 (with image size 238 x 240)
dzp -0.011066288 -> scaling image by 0.989859339076806
Found overlap: image x 1885 2122 and amp range 2006 4053 and image y 1137 1376 and amp range 0 2039
Range in image: x 121 238 , y 0 240 (with image size 238 x 240)
dzp 0.001388291 -> scaling image by 1.0012794811153327
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 82560199
Faked up EXPNUM 82560199
Faked up EXPNUM 82560199
90prime get_fwhm: self.fwhm = 2.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 73 212 and amp range 0 2015 and image y 2120 2257 and amp range 2048 4095
Range in image: x 0 140 , y 0 138 (with image size 140 x 138)
dzp -0.05213645 -> scaling image by 0.953115252660837
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75750109
Faked up EXPNUM 75750109
Faked up EXPNUM 75750109
90prime get_fwhm: self.fwhm = 4.11
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 60 and amp range 0 2015 and image y 1603 1739 and amp range 0 2047
Range in image: x 0 46 , y 0 137 (with image size 46 x 137)
dzp 0.009539392 -> scaling image by 1.0088248156909383
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3022 3259 and amp range 2048 4095 and image y 3702 3937 and amp range 2040 4078
Range in image: x 0 238 , y 0 236 (with image size 238 x 236)
dzp -0.009154885 -> scaling image by 0.9916034885139223
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79230080
Faked up EXPNUM 79230080
Faked up EXPNUM 79230080
90prime get_fwhm: self.fwhm = 4.37
Found 4 relevant rows in amp-corrections file.
Faked up EXPNUM 79230078
Faked up EXPNUM 79230078
Faked up EXPNUM 79230078
90prime get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 75 214 and amp range 0 2015 and image y 2107 2244 and amp range 2048 4095
Range in image: x 0 140 , y 0 138 (with image size 140 x 138)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Found overlap: image x 3854 3992 and amp range 2016 4031 and image y 1606 1744 and amp range 0 2047
Range in image: x 0 139 , y 0 139 (with image size 139 x 139)
dzp 0.01918938 -> scaling image by 1.017831182878158
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 82560198
Faked up EXPNUM 82560198
Faked up EXPNUM 82560198
90prime get_fwhm: self.fwhm = 2.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3838 3976 and amp range 2016 4031 and image y 1596 1734 and amp range 0 2047
Range in image: x 0 139 , y 0 139 (with image size 139 x 139)
dzp 0.014483032 -> scaling image by 1.0134287315188357
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75510123
Faked up EXPNUM 75510123
Faked up EXPNUM 75510123
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 69 and amp range 0 2015 and image y 1598 1734 and amp range 0 2047
Range in image: x 0 55 , y 0 137 (with image size 55 x 137)
dzp 0.009781551 -> scaling image by 1.0090498455107675
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 4.98 s, CPU: 1.53 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 173 MB, VmData: 205 MB, maxrss: 0.177148 MB
Stage tims finished: 2020-08-05T19:04:54.730951
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.336 s worker CPU, 20.507 s worker Wall, Wall: 4.977 s, Cores in use: 1.38, Total efficiency (on 16 cores): 8.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-tims.p
Running stage refs
Faked up EXPNUM 79000145
Faked up EXPNUM 79000145
Faked up EXPNUM 79000145
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:04:55.384865
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01596.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01485.fits
Matched 6 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/reference-custom-272141p48244.fits
Stage refs : Wall: 14.71 s, CPU: 4.64 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 222 MB, VmData: 252 MB, maxrss: 0.227168 MB
Stage refs finished: 2020-08-05T19:05:10.097714
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 14.714 s, Cores in use: 0.32, Total efficiency (on 16 cores): 2.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:05:10.185930
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outlier-mask-custom-272141p48244.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outliers-pre-custom-272141p48244.jpg
Image ksb_160706_074633_ooi_g_ls9-CCD4 g : masking 30 positive outlier pixels and 0 negative outlier pixels
Image ksb_170619_055312_ooi_g_ls9-CCD1 g : masking 46 positive outlier pixels and 0 negative outlier pixels
Image ksb_170619_054514_ooi_g_ls9-CCD2 g : masking 75 positive outlier pixels and 0 negative outlier pixels
Image k4m_170531_111320_ooi_zd_ls9-CCD4 z : masking 768 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outlier-mask-custom-272141p48244.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outliers-post-custom-272141p48244.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outliers-masked-pos-custom-272141p48244.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/outliers-masked-neg-custom-272141p48244.jpg
Stage outliers : Wall: 1.25 s, CPU: 0.89 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 233 MB, VmData: 260 MB, maxrss: 0.238724 MB
Stage outliers finished: 2020-08-05T19:05:11.438450
Resources for stage outliers : 0.569 s worker CPU, 0.742 s worker Wall, Wall: 1.254 s, Cores in use: 1.17, Total efficiency (on 16 cores): 7.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:05:11.508380
Stage halos : Wall: 0.89 s, CPU: 0.89 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 233 MB, VmData: 260 MB, maxrss: 0.23884 MB
Stage halos finished: 2020-08-05T19:05:12.398976
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.892 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:05:12.419364
PSF sigmas in coadd pixels: ['2.61', '3.03', '3.21']
Using average PSF sigma 2.9503719959381045
Gaussian PSF norm 0.09561329627662186 vs pixelized 0.08247775
average tim pixel scale / coadd scale: 1.7290551905015497
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.88', '1.97', '2.04']
Using average PSF sigma 1.960837988455338
Gaussian PSF norm 0.14386440564429295 vs pixelized 0.11690897
average tim pixel scale / coadd scale: 1.7301607139422805
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.85', '1.87', '2.43']
Using average PSF sigma 2.050803020145786
Gaussian PSF norm 0.13755333350046695 vs pixelized 0.1279782
average tim pixel scale / coadd scale: 0.9909627327290257
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.14 s, CPU: 0.12 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 235 MB, VmData: 260 MB, maxrss: 0.24062 MB
Stage fit_on_coadds finished: 2020-08-05T19:05:12.562893
Resources for stage fit_on_coadds : 0.111 s worker CPU, 0.111 s worker Wall, Wall: 0.145 s, Cores in use: 1.61, Total efficiency (on 16 cores): 10.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:05:12.575492
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 20 potential peaks
Of 20 potential peaks: 4 in veto map, 3 cut by saddle test, 0 cut by aper test, 13 kept
SED z : 13 new peaks
Found 29 potential peaks
Of 29 potential peaks: 21 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 16 potential peaks
Of 16 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 34 potential peaks
Of 34 potential peaks: 26 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 38 potential peaks
Of 38 potential peaks: 33 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 23 new sources
Median coadd sky for g : 0.000113990296
Median coadd sky for r : 0.00022629887
Median coadd sky for z : -5.586944e-06
Stage srcs : Wall: 1.36 s, CPU: 1.30 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 235 MB, VmData: 260 MB, maxrss: 0.241124 MB
Stage srcs finished: 2020-08-05T19:05:13.935531
Resources for stage srcs : 0.072 s worker CPU, 0.072 s worker Wall, Wall: 1.361 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:05:13.967681
Blob 1 of 8, id: 4, sources: 16, size: 200x163, npix 17542, brick X: 0,200, Y: 56,219, one pixel: 117 56
Blob 2 of 8, id: 0, sources: 5, size: 75x53, npix 2517, brick X: 2,77, Y: 0,53, one pixel: 20 0
Blob 3 of 8, id: 1, sources: 2, size: 45x41, npix 1031, brick X: 152,197, Y: 15,56, one pixel: 175 15
Blob 4 of 8, id: 6, sources: 1, size: 24x23, npix 340, brick X: 135,159, Y: 193,216, one pixel: 145 193
Blob 5 of 8, id: 5, sources: 1, size: 24x23, npix 339, brick X: 200,224, Y: 162,185, one pixel: 211 162
Blob 6 of 8, id: 3, sources: 1, size: 21x21, npix 259, brick X: 19,40, Y: 56,77, one pixel: 29 56
Blob 7 of 8, id: 2, sources: 1, size: 20x20, npix 229, brick X: 121,141, Y: 34,54, one pixel: 129 34
Blob 8 of 8, id: 7, sources: 1, size: 17x17, npix 145, brick X: 202,219, Y: 216,233, one pixel: 210 216
Blob 7 finished, total: Wall: 0.20 s, CPU: 0.18 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09436 MB
Blob 6 finished, total: Wall: 0.20 s, CPU: 0.17 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093328 MB
Blob 8 finished, total: Wall: 0.22 s, CPU: 0.18 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093136 MB
Blob 5 finished, total: Wall: 0.25 s, CPU: 0.22 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14912 MB
Blob 4 finished, total: Wall: 0.35 s, CPU: 0.31 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1497 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.29 s, CPU: 1.27 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.09504 MB
Blob 2 finished, total: Wall: 1.90 s, CPU: 1.86 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150328 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.17159, ee1=0.0711959, ee2=-0.065032
Measuring 3 iterative sources
Blob 1 finished, total: Wall: 11.23 s, CPU: 11.20 s, VmPeak: 692 MB, VmSize: 687 MB, VmRSS: 119 MB, VmData: 158 MB, maxrss: 0.12338 MB
Old catalog: 29
New catalog: 28
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/blobs-custom-272141p48244.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/metrics/cus/all-models-custom-272141p48244.fits
Stage fitblobs : Wall: 13.06 s, CPU: 1.69 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 236 MB, VmData: 261 MB, maxrss: 0.24198 MB
Stage fitblobs finished: 2020-08-05T19:05:27.027947
Resources for stage fitblobs : 15.498 s worker CPU, 16.353 s worker Wall, Wall: 13.062 s, Cores in use: 1.32, Total efficiency (on 16 cores): 8.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:05:27.043446
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-resid.jpg
Stage coadds : Wall: 3.21 s, CPU: 1.30 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 237 MB, VmData: 261 MB, maxrss: 0.242304 MB
Stage coadds finished: 2020-08-05T19:05:30.252819
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 9.210 s worker CPU, 14.838 s worker Wall, Wall: 3.211 s, Cores in use: 3.27, Total efficiency (on 16 cores): 20.5 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T19:05:30.272122
Cut to 1 unWISE tiles
Reading WISE tile 2722p484 band 1
Reading WISE tile 2722p484 band 4
Reading WISE tile 2722p484 band 3
Reading WISE tile 2722p484 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 809 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.19136 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 812 MB, VmSize: 799 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.2042 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 799 MB, VmSize: 799 MB, VmRSS: 139 MB, VmData: 171 MB, maxrss: 0.199496 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210244 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 16.23 s, CPU: 1.71 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 237 MB, VmData: 261 MB, maxrss: 0.242816 MB
Stage wise_forced finished: 2020-08-05T19:05:46.500860
Resources for stage wise_forced : 2.939 s worker CPU, 21.342 s worker Wall, Wall: 16.230 s, Cores in use: 0.29, Total efficiency (on 16 cores): 1.8 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:05:46.513627
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/tractor-i/cus/tractor-custom-272141p48244.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/tractor/cus/tractor-custom-272141p48244.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/tractor/cus/brick-custom-272141p48244.sha256sum
Stage writecat : Wall: 1.45 s, CPU: 0.70 s, VmPeak: 1146 MB, VmSize: 1018 MB, VmRSS: 239 MB, VmData: 261 MB, maxrss: 0.37576 MB
Stage writecat finished: 2020-08-05T19:05:47.960506
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.449 s, Cores in use: 0.49, Total efficiency (on 16 cores): 3.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2313362/PGC2313362-largegalaxy-writecat.p
All done: 33.738 s worker CPU, 73.968 s worker Wall, Wall: 58.250 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 %
Finished galaxy PGC2313362 in 1.048 minutes.
Started working on galaxy PGC2313362 at Fri Aug  7 09:17:19 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.14106923341956 48.24449310578651 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T09:17:21.761784
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.14106923341956', '48.24449310578651', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.14106923341956 48.24449310578651 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 272.14106923341956 48.24449310578651
Starting process 57151 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 57153 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 57155 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 57157 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 57159 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 57161 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB
Starting process 57163 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB
Starting process 57165 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 57167 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 57169 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 57170 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 57172 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 57175 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 57177 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 57179 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 57181 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T09:17:32.644491
Keeping 10 CCDs:
  k4m_160518_095133_ooi_zd_ls9-CCD2 z expnum 89996 exptime 80.105 propid 2016A-0453 seeing 1.14 MJD 57526.411 object MzLS_641267_z 
    mosaic/CP/V4.3/CP20160517/k4m_160518_095133_ooi_zd_ls9.fits.fz
  k4m_160516_100502_ooi_zd_ls9-CCD1 z expnum 89295 exptime 80.103 propid 2016A-0453 seeing 1.15 MJD 57524.420 object MzLS_642942_z 
    mosaic/CP/V4.3/CP20160515/k4m_160516_100502_ooi_zd_ls9.fits.fz
  k4m_170531_111320_ooi_zd_ls9-CCD4 z expnum 130990 exptime 250.105 propid 2016A-0453 seeing 1.50 MJD 57904.468 object MzLS_642106_z 
    mosaic/CP/V4.3/CP20170530/k4m_170531_111320_ooi_zd_ls9.fits.fz
  ksb_170527_091338_ooi_g_ls9-CCD1 g expnum 79000145 exptime 99.9 propid 2015A-0801 seeing 1.14 MJD 57900.384 object 24841 
    90prime/CP/V2.3/CP20170526/ksb_170527_091338_ooi_g_ls9.fits.fz
  ksb_180518_102810_ooi_r_ls9-CCD2 r expnum 82560198 exptime 87.08 propid NOTBASS seeing 1.16 MJD 58256.436 object 26023 
    90prime/CP/V2.3/CP20180517/ksb_180518_102810_ooi_r_ls9.fits.fz
  ksb_170619_054514_ooi_g_ls9-CCD2 g expnum 79230078 exptime 209.283 propid BASS seeing 1.61 MJD 57923.240 object 26023 
    90prime/CP/V2.3/CP20170618/ksb_170619_054514_ooi_g_ls9.fits.fz
  ksb_160706_074633_ooi_g_ls9-CCD4 g expnum 75750109 exptime 95.8 propid BASS seeing 1.86 MJD 57575.324 object 24842 
    90prime/CP/V2.3/CP20160705/ksb_160706_074633_ooi_g_ls9.fits.fz
  ksb_160612_102749_ooi_r_ls9-CCD4 r expnum 75510123 exptime 78.0 propid BASS seeing 1.21 MJD 57551.436 object 24842 
    90prime/CP/V2.3/CP20160611/ksb_160612_102749_ooi_r_ls9.fits.fz
  ksb_180518_103014_ooi_r_ls9-CCD1 r expnum 82560199 exptime 80.78 propid NOTBASS seeing 1.26 MJD 58256.438 object 24843 
    90prime/CP/V2.3/CP20180517/ksb_180518_103014_ooi_r_ls9.fits.fz
  ksb_170619_055312_ooi_g_ls9-CCD1 g expnum 79230080 exptime 159.498 propid BASS seeing 1.98 MJD 57923.245 object 24843 
    90prime/CP/V2.3/CP20170618/ksb_170619_055312_ooi_g_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 5.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 331 565 and amp range 0 2047 and image y 200 434 and amp range 0 2021
Range in image: x 0 235 , y 0 235 (with image size 235 x 235)
dzp -0.018417627 -> scaling image by 0.9831798050134541
mosaic get_fwhm: self.fwhm = 4.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3017 3255 and amp range 2048 4095 and image y 3699 3934 and amp range 2040 4078
Range in image: x 0 239 , y 0 236 (with image size 239 x 236)
dzp -0.009154885 -> scaling image by 0.9916034885139223
Faked up EXPNUM 79230080
Faked up EXPNUM 79230080
Faked up EXPNUM 79230080
90prime get_fwhm: self.fwhm = 4.37
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 78 216 and amp range 0 2015 and image y 2109 2246 and amp range 2048 4095
Range in image: x 0 139 , y 0 138 (with image size 139 x 138)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Faked up EXPNUM 82560198
Faked up EXPNUM 82560198
Faked up EXPNUM 82560198
90prime get_fwhm: self.fwhm = 2.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3841 3979 and amp range 2016 4031 and image y 1598 1736 and amp range 0 2047
Range in image: x 0 139 , y 0 139 (with image size 139 x 139)
dzp 0.014483032 -> scaling image by 1.0134287315188357
Faked up EXPNUM 75750109
Faked up EXPNUM 75750109
Faked up EXPNUM 75750109
90prime get_fwhm: self.fwhm = 4.11
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 63 and amp range 0 2015 and image y 1605 1740 and amp range 0 2047
Range in image: x 0 49 , y 0 136 (with image size 49 x 136)
dzp 0.009539392 -> scaling image by 1.0088248156909383
Faked up EXPNUM 75510123
Faked up EXPNUM 75510123
Faked up EXPNUM 75510123
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 71 and amp range 0 2015 and image y 1600 1735 and amp range 0 2047
Range in image: x 0 57 , y 0 136 (with image size 57 x 136)
dzp 0.009781551 -> scaling image by 1.0090498455107675
Faked up EXPNUM 82560199
Faked up EXPNUM 82560199
Faked up EXPNUM 82560199
90prime get_fwhm: self.fwhm = 2.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 76 215 and amp range 0 2015 and image y 2122 2259 and amp range 2048 4095
Range in image: x 0 140 , y 0 138 (with image size 140 x 138)
dzp -0.05213645 -> scaling image by 0.953115252660837
mosaic get_fwhm: self.fwhm = 4.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1880 2118 and amp range 0 2005 and image y 1134 1373 and amp range 0 2039
Range in image: x 0 126 , y 0 240 (with image size 239 x 240)
dzp -0.011066288 -> scaling image by 0.989859339076806
Found overlap: image x 1880 2118 and amp range 2006 4053 and image y 1134 1373 and amp range 0 2039
Range in image: x 126 239 , y 0 240 (with image size 239 x 240)
dzp 0.001388291 -> scaling image by 1.0012794811153327
Faked up EXPNUM 79230078
Faked up EXPNUM 79230078
Faked up EXPNUM 79230078
90prime get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3857 3994 and amp range 2016 4031 and image y 1608 1746 and amp range 0 2047
Range in image: x 0 138 , y 0 139 (with image size 138 x 139)
dzp 0.01918938 -> scaling image by 1.017831182878158
Stage tims : Wall: 105.28 s, CPU: 5.13 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.175728 MB
Stage tims finished: 2020-08-07T09:19:17.925718
Faked up EXPNUM 79000145
Faked up EXPNUM 79000145
Faked up EXPNUM 79000145
Resources for stage tims : 4.694 s worker CPU, 517.363 s worker Wall, Wall: 105.283 s, Cores in use: 0.09, Total efficiency (on 16 cores): 0.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T09:19:17.942710
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01596.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01485.fits
Matched 6 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/metrics/cus/reference-custom-272141p48244.fits
Stage refs : Wall: 13.89 s, CPU: 3.93 s, VmPeak: 1002 MB, VmSize: 997 MB, VmRSS: 220 MB, VmData: 252 MB, maxrss: 0.225336 MB
Stage refs finished: 2020-08-07T09:19:31.834649
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.894 s, Cores in use: 0.28, Total efficiency (on 16 cores): 1.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T09:19:32.082810
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/metrics/cus/outlier-mask-custom-272141p48244.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/metrics/cus/outliers-pre-custom-272141p48244.jpg
Image ksb_170619_055312_ooi_g_ls9-CCD1 g : masking 49 positive outlier pixels and 0 negative outlier pixels
Image ksb_160706_074633_ooi_g_ls9-CCD4 g : masking 30 positive outlier pixels and 0 negative outlier pixels
Image ksb_170619_054514_ooi_g_ls9-CCD2 g : masking 81 positive outlier pixels and 0 negative outlier pixels
Image k4m_170531_111320_ooi_zd_ls9-CCD4 z : masking 766 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/metrics/cus/outlier-mask-custom-272141p48244.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/metrics/cus/outliers-post-custom-272141p48244.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/metrics/cus/outliers-masked-pos-custom-272141p48244.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/metrics/cus/outliers-masked-neg-custom-272141p48244.jpg
Stage outliers : Wall: 1.72 s, CPU: 0.58 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 232 MB, VmData: 261 MB, maxrss: 0.2375 MB
Stage outliers finished: 2020-08-07T09:19:33.806914
Resources for stage outliers : 0.545 s worker CPU, 0.706 s worker Wall, Wall: 1.726 s, Cores in use: 0.65, Total efficiency (on 16 cores): 4.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T09:19:39.429640
Stage halos : Wall: 0.27 s, CPU: 0.27 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 232 MB, VmData: 261 MB, maxrss: 0.237676 MB
Stage halos finished: 2020-08-07T09:19:39.697535
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.269 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-07T09:19:39.800342
PSF sigmas in coadd pixels: ['2.61', '3.03', '3.21']
Using average PSF sigma 2.9503719959381045
Gaussian PSF norm 0.09561329627662186 vs pixelized 0.08247535
average tim pixel scale / coadd scale: 1.7290551905015497
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.88', '1.97', '2.04']
Using average PSF sigma 1.960837988455338
Gaussian PSF norm 0.14386440564429295 vs pixelized 0.116905116
average tim pixel scale / coadd scale: 1.7301607139422805
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.85', '1.87', '2.43']
Using average PSF sigma 2.050803020145786
Gaussian PSF norm 0.13755333350046695 vs pixelized 0.12797363
average tim pixel scale / coadd scale: 0.9909627327290257
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.12 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.239324 MB
Stage fit_on_coadds finished: 2020-08-07T09:19:39.976240
Resources for stage fit_on_coadds : 0.112 s worker CPU, 0.112 s worker Wall, Wall: 0.178 s, Cores in use: 1.30, Total efficiency (on 16 cores): 8.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T09:19:40.032945
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 19 potential peaks
Of 19 potential peaks: 5 in veto map, 3 cut by saddle test, 0 cut by aper test, 11 kept
SED z : 11 new peaks
Found 29 potential peaks
Of 29 potential peaks: 20 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 16 potential peaks
Of 16 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 36 potential peaks
Of 36 potential peaks: 26 in veto map, 5 cut by saddle test, 0 cut by aper test, 5 kept
SED Flat : 5 new peaks
Found 38 potential peaks
Of 38 potential peaks: 33 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 23 new sources
Median coadd sky for g : 0.00013242468
Median coadd sky for r : 0.00019749257
Median coadd sky for z : 4.4298602e-05
Stage srcs : Wall: 0.53 s, CPU: 0.50 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.239808 MB
Stage srcs finished: 2020-08-07T09:19:40.563766
Resources for stage srcs : 0.060 s worker CPU, 0.060 s worker Wall, Wall: 0.532 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T09:19:40.610225
Blob 1 of 9, id: 5, sources: 15, size: 197x163, npix 17511, brick X: 0,197, Y: 60,223, one pixel: 115 60
Blob 2 of 9, id: 0, sources: 5, size: 74x57, npix 2593, brick X: 0,74, Y: 0,57, one pixel: 22 0
Blob 3 of 9, id: 3, sources: 2, size: 45x40, npix 1024, brick X: 149,194, Y: 20,60, one pixel: 171 20
Blob 4 of 9, id: 8, sources: 1, size: 24x24, npix 350, brick X: 132,156, Y: 197,221, one pixel: 142 197
Blob 5 of 9, id: 7, sources: 1, size: 24x24, npix 329, brick X: 197,221, Y: 166,190, one pixel: 209 166
Blob 6 of 9, id: 6, sources: 1, size: 21x21, npix 260, brick X: 16,37, Y: 61,82, one pixel: 25 61
Blob 7 of 9, id: 4, sources: 1, size: 20x20, npix 237, brick X: 118,138, Y: 38,58, one pixel: 126 38
Blob 8 of 9, id: 1, sources: 1, size: 20x17, npix 203, brick X: 97,117, Y: 0,17, one pixel: 104 0
Blob 9 of 9, id: 2, sources: 1, size: 18x18, npix 179, brick X: 157,175, Y: 0,18, one pixel: 164 0
Blob 8 finished, total: Wall: 0.05 s, CPU: 0.04 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 138 MB, maxrss: 0.088332 MB
Blob 9 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 87 MB, VmData: 139 MB, maxrss: 0.088668 MB
Blob 5 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145372 MB
Blob 7 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.145956 MB
Blob 6 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145848 MB
Blob 4 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146052 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095088 MB
Blob 2 finished, total: Wall: 1.93 s, CPU: 1.93 s, VmPeak: 670 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.095192 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.743036, ee1=0.0611108, ee2=-0.0554399
Measuring 5 iterative sources
Blob 1 finished, total: Wall: 14.14 s, CPU: 14.13 s, VmPeak: 706 MB, VmSize: 706 MB, VmRSS: 138 MB, VmData: 172 MB, maxrss: 0.141572 MB
Old catalog: 29
New catalog: 30
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/metrics/cus/blobs-custom-272141p48244.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/metrics/cus/all-models-custom-272141p48244.fits
Stage fitblobs : Wall: 14.57 s, CPU: 0.36 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 235 MB, VmData: 261 MB, maxrss: 0.240588 MB
Stage fitblobs finished: 2020-08-07T09:19:55.177482
Resources for stage fitblobs : 18.600 s worker CPU, 18.682 s worker Wall, Wall: 14.568 s, Cores in use: 1.30, Total efficiency (on 16 cores): 8.1 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T09:19:55.223929
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-resid.jpg
Stage coadds : Wall: 1.89 s, CPU: 0.62 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 235 MB, VmData: 261 MB, maxrss: 0.240912 MB
Stage coadds finished: 2020-08-07T09:19:57.110943
Resources for stage coadds : 9.156 s worker CPU, 9.730 s worker Wall, Wall: 1.888 s, Cores in use: 5.18, Total efficiency (on 16 cores): 32.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T09:19:57.125306
Cut to 1 unWISE tiles
Reading WISE tile 2722p484 band 1
Reading WISE tile 2722p484 band 2
Reading WISE tile 2722p484 band 4
Reading WISE tile 2722p484 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 811 MB, VmSize: 798 MB, VmRSS: 145 MB, VmData: 176 MB, maxrss: 0.183412 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.204008 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 811 MB, VmSize: 792 MB, VmRSS: 139 MB, VmData: 170 MB, maxrss: 0.198988 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2722p484/unwise-2722p484-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 810 MB, VmSize: 793 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.2016 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/tmp-legacysurvey-custom-272141p48244-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 22.06 s, CPU: 0.47 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 236 MB, VmData: 261 MB, maxrss: 0.241424 MB
Stage wise_forced finished: 2020-08-07T09:20:19.189280
Resources for stage wise_forced : 2.894 s worker CPU, 47.953 s worker Wall, Wall: 22.065 s, Cores in use: 0.15, Total efficiency (on 16 cores): 1.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T09:20:19.201653
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/coadd/cus/custom-272141p48244/legacysurvey-custom-272141p48244-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/tractor-i/cus/tractor-custom-272141p48244.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/tractor/cus/tractor-custom-272141p48244.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/tractor/cus/brick-custom-272141p48244.sha256sum
Stage writecat : Wall: 0.69 s, CPU: 0.51 s, VmPeak: 1139 MB, VmSize: 1011 MB, VmRSS: 238 MB, VmData: 261 MB, maxrss: 0.374416 MB
Stage writecat finished: 2020-08-07T09:20:19.896275
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.696 s, Cores in use: 0.74, Total efficiency (on 16 cores): 4.6 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2313362/PGC2313362-largegalaxy-writecat.p
All done: 36.064 s worker CPU, 594.610 s worker Wall, Wall: 167.268 s, Cores in use: 0.29, Total efficiency (on 16 cores): 1.8 %
Finished galaxy PGC2313362 in 3.009 minutes.