Started working on galaxy PGC2391204 at Wed Aug  5 20:25:26 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.184662 51.26256179999999 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:25:27.034911
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.184662', '51.26256179999999', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.184662 51.26256179999999 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 273.184662 51.26256179999999
Starting process 33456 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 33457 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 33458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 33459 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 33460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 33461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 33462 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 33463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 33464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 33465 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 33466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 33467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 33468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 33469 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 33470 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 33471 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:25:27.894681
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 12 CCDs:
  k4m_160520_095056_ooi_zd_ls9-CCD1 z expnum 90516 exptime 80.103 propid 2016A-0453 seeing 1.06 MJD 57528.410 object MzLS_655097_z 
    mosaic/CP/V4.3/CP20160519/k4m_160520_095056_ooi_zd_ls9.fits.fz
  k4m_170901_054419_ooi_zd_ls9-CCD2 z expnum 137612 exptime 116.102 propid 2016A-0453 seeing 0.84 MJD 57997.239 object MzLS_654309_z 
    mosaic/CP/V4.3/CP20170831/k4m_170901_054419_ooi_zd_ls9.fits.fz
  k4m_160524_094704_ooi_zd_ls9-CCD1 z expnum 91252 exptime 80.103 propid 2016A-0453 seeing 1.08 MJD 57532.408 object MzLS_655880_z 
    mosaic/CP/V4.3/CP20160523/k4m_160524_094704_ooi_zd_ls9.fits.fz
  ksb_160707_091007_ooi_g_ls9-CCD3 g expnum 75760092 exptime 243.9 propid BASS seeing 2.65 MJD 57576.382 object 28332 
    90prime/CP/V2.3/CP20160706/ksb_160707_091007_ooi_g_ls9.fits.fz
  ksb_160706_104941_ooi_g_ls9-CCD3 g expnum 75750131 exptime 193.2 propid BASS seeing 1.81 MJD 57575.451 object 28332 
    90prime/CP/V2.3/CP20160705/ksb_160706_104941_ooi_g_ls9.fits.fz
  ksb_160711_072718_ooi_r_ls9-CCD3 r expnum 75800096 exptime 77.7 propid BASS seeing 1.64 MJD 57580.311 object 28332 
    90prime/CP/V2.3/CP20160710/ksb_160711_072718_ooi_r_ls9.fits.fz
  ksb_170624_062619_ooi_r_ls9-CCD1 r expnum 79280072 exptime 85.462 propid BASS seeing 1.20 MJD 57928.268 object 28333 
    90prime/CP/V2.3/CP20170623/ksb_170624_062619_ooi_r_ls9.fits.fz
  ksb_170618_061525_ooi_g_ls9-CCD1 g expnum 79220073 exptime 162.425 propid BASS seeing 1.60 MJD 57922.261 object 28333 
    90prime/CP/V2.3/CP20170617/ksb_170618_061525_ooi_g_ls9.fits.fz
  ksb_170618_061845_ooi_g_ls9-CCD2 g expnum 79220074 exptime 121.071 propid BASS seeing 1.46 MJD 57922.263 object 29463 
    90prime/CP/V2.3/CP20170617/ksb_170618_061845_ooi_g_ls9.fits.fz
  ksb_170624_062822_ooi_r_ls9-CCD2 r expnum 79280073 exptime 76.476 propid BASS seeing 1.20 MJD 57928.270 object 29463 
    90prime/CP/V2.3/CP20170623/ksb_170624_062822_ooi_r_ls9.fits.fz
  ksb_170527_091555_ooi_g_ls9-CCD1 g expnum 79000146 exptime 121.68 propid 2015A-0801 seeing 1.31 MJD 57900.386 object 28331 
    90prime/CP/V2.3/CP20170526/ksb_170527_091555_ooi_g_ls9.fits.fz
  ksb_170405_113113_ooi_r_ls9-CCD1 r expnum 78480179 exptime 62.653 propid BASS seeing 1.30 MJD 57848.480 object 28331 
    90prime/CP/V2.3/CP20170404/ksb_170405_113113_ooi_r_ls9.fits.fz
Faked up EXPNUM 75760092
Faked up EXPNUM 75760092
Faked up EXPNUM 75760092
90prime get_fwhm: self.fwhm = 5.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3954 4016 and amp range 2016 4031 and image y 1215 1367 and amp range 0 2047
Range in image: x 0 63 , y 0 153 (with image size 63 x 153)
dzp -0.0022715968 -> scaling image by 0.9979099691834846
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 337 608 and amp range 0 2005 and image y 2703 2971 and amp range 2040 4078
Range in image: x 0 272 , y 0 269 (with image size 272 x 269)
dzp -0.005990375 -> scaling image by 0.994497853444703
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79220073
Faked up EXPNUM 79220073
Faked up EXPNUM 79220073
90prime get_fwhm: self.fwhm = 3.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 46 and amp range 0 2015 and image y 1727 1881 and amp range 0 2047
Range in image: x 0 32 , y 0 155 (with image size 32 x 155)
dzp -0.023075538 -> scaling image by 0.9789709052881876
mosaic get_fwhm: self.fwhm = 4.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3062 3326 and amp range 2006 4053 and image y 3874 4072 and amp range 2040 4078
Range in image: x 0 265 , y 0 199 (with image size 265 x 199)
dzp -0.006092005 -> scaling image by 0.9944047680378836
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79000146
Faked up EXPNUM 79000146
Faked up EXPNUM 79000146
90prime get_fwhm: self.fwhm = 2.89
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1935 2089 and amp range 0 2015 and image y 3705 3858 and amp range 2048 4095
Range in image: x 0 81 , y 0 154 (with image size 155 x 154)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Found overlap: image x 1935 2089 and amp range 2016 4031 and image y 3705 3858 and amp range 2048 4095
Range in image: x 81 155 , y 0 154 (with image size 155 x 154)
dzp 0.020521455 -> scaling image by 1.0190807119283773
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79280073
Faked up EXPNUM 79280073
Faked up EXPNUM 79280073
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3695 3850 and amp range 2016 4031 and image y 1899 2054 and amp range 0 2047
Range in image: x 0 156 , y 0 149 (with image size 156 x 156)
dzp 0.032776505 -> scaling image by 1.0306485625912574
Found overlap: image x 3695 3850 and amp range 2016 4031 and image y 1899 2054 and amp range 2048 4095
Range in image: x 0 156 , y 149 156 (with image size 156 x 156)
dzp 0.021366077 -> scaling image by 1.0198737893800265
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78480179
Faked up EXPNUM 78480179
Faked up EXPNUM 78480179
90prime get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1928 2082 and amp range 0 2015 and image y 3713 3867 and amp range 2048 4095
Range in image: x 0 88 , y 0 155 (with image size 155 x 155)
dzp -0.041613504 -> scaling image by 0.9623977484321999
Found overlap: image x 1928 2082 and amp range 2016 4031 and image y 3713 3867 and amp range 2048 4095
Range in image: x 88 155 , y 0 155 (with image size 155 x 155)
dzp 0.02308583 -> scaling image by 1.021490500713915
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79220074
Faked up EXPNUM 79220074
Faked up EXPNUM 79220074
90prime get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3697 3852 and amp range 2016 4031 and image y 1896 2052 and amp range 0 2047
Range in image: x 0 156 , y 0 152 (with image size 156 x 157)
dzp 0.01918938 -> scaling image by 1.017831182878158
Found overlap: image x 3697 3852 and amp range 2016 4031 and image y 1896 2052 and amp range 2048 4095
Range in image: x 0 156 , y 152 157 (with image size 156 x 157)
dzp 0.010008041 -> scaling image by 1.0092603604948323
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75800096
Faked up EXPNUM 75800096
Faked up EXPNUM 75800096
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3943 4016 and amp range 2016 4031 and image y 1226 1379 and amp range 0 2047
Range in image: x 0 74 , y 0 154 (with image size 74 x 154)
dzp 0.004245165 -> scaling image by 1.0039175950705865
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75750131
Faked up EXPNUM 75750131
Faked up EXPNUM 75750131
90prime get_fwhm: self.fwhm = 3.99
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3942 4016 and amp range 2016 4031 and image y 1220 1372 and amp range 0 2047
Range in image: x 0 75 , y 0 153 (with image size 75 x 153)
dzp -0.0022715968 -> scaling image by 0.9979099691834846
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79280072
Faked up EXPNUM 79280072
Faked up EXPNUM 79280072
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 63 and amp range 0 2015 and image y 1718 1872 and amp range 0 2047
Range in image: x 0 49 , y 0 155 (with image size 49 x 155)
dzp -0.024106435 -> scaling image by 0.9780418215011345
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1469 1734 and amp range 0 2047 and image y 3305 3570 and amp range 2040 4078
Range in image: x 0 266 , y 0 266 (with image size 266 x 266)
dzp 0.003927584 -> scaling image by 1.0036239891963392
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 8.51 s, CPU: 1.26 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.179852 MB
Stage tims finished: 2020-08-05T20:25:36.400247
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 7.279 s worker CPU, 35.998 s worker Wall, Wall: 8.508 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:25:36.491420
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01378.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01379.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01486.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01275.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/reference-custom-273184p51262.fits
Stage refs : Wall: 17.92 s, CPU: 6.03 s, VmPeak: 1015 MB, VmSize: 1009 MB, VmRSS: 229 MB, VmData: 259 MB, maxrss: 0.234992 MB
Stage refs finished: 2020-08-05T20:25:54.410197
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 17.920 s, Cores in use: 0.34, Total efficiency (on 16 cores): 2.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:25:54.494736
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outlier-mask-custom-273184p51262.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outliers-pre-custom-273184p51262.jpg
Image ksb_170618_061525_ooi_g_ls9-CCD1 g : masking 1531 positive outlier pixels and 0 negative outlier pixels
Image ksb_170527_091555_ooi_g_ls9-CCD1 g : masking 0 positive outlier pixels and 155 negative outlier pixels
Image ksb_170618_061845_ooi_g_ls9-CCD2 g : masking 259 positive outlier pixels and 0 negative outlier pixels
Image ksb_170624_062619_ooi_r_ls9-CCD1 r : masking 1382 positive outlier pixels and 0 negative outlier pixels
Image ksb_160711_072718_ooi_r_ls9-CCD3 r : masking 129 positive outlier pixels and 0 negative outlier pixels
Image k4m_170901_054419_ooi_zd_ls9-CCD2 z : masking 236 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outlier-mask-custom-273184p51262.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outliers-post-custom-273184p51262.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outliers-masked-pos-custom-273184p51262.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outliers-masked-neg-custom-273184p51262.jpg
Stage outliers : Wall: 0.98 s, CPU: 0.74 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 244 MB, VmData: 272 MB, maxrss: 0.249488 MB
Stage outliers finished: 2020-08-05T20:25:55.475338
Resources for stage outliers : 0.827 s worker CPU, 0.894 s worker Wall, Wall: 0.982 s, Cores in use: 1.60, Total efficiency (on 16 cores): 10.0 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:25:55.625089
Stage halos : Wall: 0.53 s, CPU: 0.51 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 244 MB, VmData: 272 MB, maxrss: 0.249488 MB
Stage halos finished: 2020-08-05T20:25:56.151635
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.528 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T20:25:56.177617
PSF sigmas in coadd pixels: ['4.30', '2.94', '2.60', '2.38', '2.13']
Using average PSF sigma 2.8678505866700013
Gaussian PSF norm 0.09836453582521952 vs pixelized 0.07452092
average tim pixel scale / coadd scale: 1.728951443121804
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.66', '1.95', '1.95', '2.11']
Using average PSF sigma 2.16656021737239
Gaussian PSF norm 0.13020399318326056 vs pixelized 0.111484915
average tim pixel scale / coadd scale: 1.728828313923974
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.72', '1.36', '1.75']
Using average PSF sigma 1.6122289114821216
Gaussian PSF norm 0.1749719222653987 vs pixelized 0.1513123
average tim pixel scale / coadd scale: 0.9909493360803497
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.15 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 245 MB, VmData: 272 MB, maxrss: 0.25102 MB
Stage fit_on_coadds finished: 2020-08-05T20:25:56.383757
Resources for stage fit_on_coadds : 0.174 s worker CPU, 0.174 s worker Wall, Wall: 0.208 s, Cores in use: 1.58, Total efficiency (on 16 cores): 9.9 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:25:56.396023
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 30 potential peaks
Of 30 potential peaks: 8 in veto map, 6 cut by saddle test, 0 cut by aper test, 16 kept
SED z : 16 new peaks
Found 21 potential peaks
Of 21 potential peaks: 18 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 22 potential peaks
Of 22 potential peaks: 16 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 31 potential peaks
Of 31 potential peaks: 25 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 39 potential peaks
Of 39 potential peaks: 30 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 22 new sources
Median coadd sky for g : 0.00012808651
Median coadd sky for r : 0.00014789343
Median coadd sky for z : -0.0003439226
Stage srcs : Wall: 0.86 s, CPU: 0.81 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 246 MB, VmData: 272 MB, maxrss: 0.25152 MB
Stage srcs finished: 2020-08-05T20:25:57.258788
Resources for stage srcs : 0.083 s worker CPU, 0.083 s worker Wall, Wall: 0.864 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:25:57.272579
Blob 1 of 9, id: 1, sources: 15, size: 181x199, npix 20770, brick X: 66,247, Y: 0,199, one pixel: 207 0
Blob 2 of 9, id: 3, sources: 2, size: 49x56, npix 1632, brick X: 32,81, Y: 47,103, one pixel: 44 47
Blob 3 of 9, id: 4, sources: 2, size: 46x44, npix 1424, brick X: 215,261, Y: 119,163, one pixel: 235 119
Blob 4 of 9, id: 2, sources: 2, size: 55x39, npix 1361, brick X: 12,67, Y: 8,47, one pixel: 21 8
Blob 5 of 9, id: 5, sources: 2, size: 55x37, npix 1166, brick X: 15,70, Y: 149,186, one pixel: 24 149
Blob 6 of 9, id: 0, sources: 3, size: 35x21, npix 550, brick X: 110,145, Y: 0,21, one pixel: 116 0
Blob 7 of 9, id: 6, sources: 1, size: 25x26, npix 427, brick X: 7,32, Y: 210,236, one pixel: 17 210
Blob 8 of 9, id: 8, sources: 1, size: 24x23, npix 331, brick X: 193,217, Y: 240,263, one pixel: 203 240
Blob 9 of 9, id: 7, sources: 1, size: 19x19, npix 208, brick X: 221,240, Y: 232,251, one pixel: 229 232
Blob 9 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094112 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.18455, 51.25146), pm (-1.6, -15.8), parallax 0.910 with NanoMaggies: g=16.2, r=15, z=(flux -68.5)
Reset brightness to NanoMaggies: g=15.6, r=15, z=14.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.18576, 51.25150), pm (-2.0, -5.8), parallax 0.153 with NanoMaggies: g=16.9, r=16.9, z=(flux -29.2)
Reset brightness to NanoMaggies: g=17.4, r=16.8, z=16.6
Blob 6 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151232 MB
Blob 7 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.094844 MB
Blob 8 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 808 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150916 MB
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.152536 MB
Measuring 2 iterative sources
Measuring 3 iterative sources
Blob 2 finished, total: Wall: 1.56 s, CPU: 1.56 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095512 MB
Blob 4 finished, total: Wall: 1.57 s, CPU: 1.57 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097376 MB
Measuring 2 iterative sources
Blob 3 finished, total: Wall: 2.59 s, CPU: 2.59 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151236 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.29614, ee1=0.0473512, ee2=-0.0405205
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 14.26 s, CPU: 14.24 s, VmPeak: 805 MB, VmSize: 734 MB, VmRSS: 157 MB, VmData: 186 MB, maxrss: 0.160928 MB
Old catalog: 35
New catalog: 33
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/blobs-custom-273184p51262.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/all-models-custom-273184p51262.fits
Stage fitblobs : Wall: 15.05 s, CPU: 0.76 s, VmPeak: 1019 MB, VmSize: 991 MB, VmRSS: 219 MB, VmData: 244 MB, maxrss: 0.252052 MB
Stage fitblobs finished: 2020-08-05T20:26:12.325292
Resources for stage fitblobs : 22.507 s worker CPU, 22.621 s worker Wall, Wall: 15.054 s, Cores in use: 1.55, Total efficiency (on 16 cores): 9.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:26:12.339071
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-resid.jpg
Stage coadds : Wall: 2.58 s, CPU: 0.64 s, VmPeak: 1019 MB, VmSize: 991 MB, VmRSS: 219 MB, VmData: 244 MB, maxrss: 0.252052 MB
Stage coadds finished: 2020-08-05T20:26:14.920054
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 8.366 s worker CPU, 12.045 s worker Wall, Wall: 2.583 s, Cores in use: 3.49, Total efficiency (on 16 cores): 21.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T20:26:14.939378
Cut to 1 unWISE tiles
Reading WISE tile 2741p514 band 3
Reading WISE tile 2741p514 band 1
Reading WISE tile 2741p514 band 2
Reading WISE tile 2741p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 798 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.20238 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 809 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.189028 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 808 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.209232 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 808 MB, VmRSS: 149 MB, VmData: 180 MB, maxrss: 0.204672 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.50 s, CPU: 0.85 s, VmPeak: 1019 MB, VmSize: 991 MB, VmRSS: 220 MB, VmData: 244 MB, maxrss: 0.252052 MB
Stage wise_forced finished: 2020-08-05T20:26:17.435402
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.599 s worker CPU, 5.571 s worker Wall, Wall: 2.498 s, Cores in use: 1.78, Total efficiency (on 16 cores): 11.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:26:17.450623
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/tractor-i/cus/tractor-custom-273184p51262.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/tractor/cus/tractor-custom-273184p51262.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/tractor/cus/brick-custom-273184p51262.sha256sum
Stage writecat : Wall: 1.44 s, CPU: 0.56 s, VmPeak: 1124 MB, VmSize: 995 MB, VmRSS: 221 MB, VmData: 244 MB, maxrss: 0.357672 MB
Stage writecat finished: 2020-08-05T20:26:18.887635
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.439 s, Cores in use: 0.39, Total efficiency (on 16 cores): 2.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-writecat.p
All done: 42.839 s worker CPU, 77.392 s worker Wall, Wall: 51.026 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.8 %
Finished galaxy PGC2391204 in 0.890 minutes.
Started working on galaxy PGC2391204 at Wed Aug  5 22:07:09 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.184662 51.26256179999999 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T22:07:11.467052
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.184662', '51.26256179999999', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.184662 51.26256179999999 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 273.184662 51.26256179999999
Starting process 51539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 51540 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 51541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 51542 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 51543 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 51544 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 51545 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 51546 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 51547 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 51548 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 51549 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51550 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51551 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51552 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 51553 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 51554 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 51555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 51556 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 51557 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 51558 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 51559 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 51560 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 51561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 51562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 51563 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 51564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 51565 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 51566 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 51567 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 51568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 51569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 51570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T22:07:14.584711
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 12 CCDs:
  k4m_160520_095056_ooi_zd_ls9-CCD1 z expnum 90516 exptime 80.103 propid 2016A-0453 seeing 1.06 MJD 57528.410 object MzLS_655097_z 
    mosaic/CP/V4.3/CP20160519/k4m_160520_095056_ooi_zd_ls9.fits.fz
  k4m_170901_054419_ooi_zd_ls9-CCD2 z expnum 137612 exptime 116.102 propid 2016A-0453 seeing 0.84 MJD 57997.239 object MzLS_654309_z 
    mosaic/CP/V4.3/CP20170831/k4m_170901_054419_ooi_zd_ls9.fits.fz
  k4m_160524_094704_ooi_zd_ls9-CCD1 z expnum 91252 exptime 80.103 propid 2016A-0453 seeing 1.08 MJD 57532.408 object MzLS_655880_z 
    mosaic/CP/V4.3/CP20160523/k4m_160524_094704_ooi_zd_ls9.fits.fz
  ksb_160707_091007_ooi_g_ls9-CCD3 g expnum 75760092 exptime 243.9 propid BASS seeing 2.65 MJD 57576.382 object 28332 
    90prime/CP/V2.3/CP20160706/ksb_160707_091007_ooi_g_ls9.fits.fz
  ksb_160706_104941_ooi_g_ls9-CCD3 g expnum 75750131 exptime 193.2 propid BASS seeing 1.81 MJD 57575.451 object 28332 
    90prime/CP/V2.3/CP20160705/ksb_160706_104941_ooi_g_ls9.fits.fz
  ksb_160711_072718_ooi_r_ls9-CCD3 r expnum 75800096 exptime 77.7 propid BASS seeing 1.64 MJD 57580.311 object 28332 
    90prime/CP/V2.3/CP20160710/ksb_160711_072718_ooi_r_ls9.fits.fz
  ksb_170624_062619_ooi_r_ls9-CCD1 r expnum 79280072 exptime 85.462 propid BASS seeing 1.20 MJD 57928.268 object 28333 
    90prime/CP/V2.3/CP20170623/ksb_170624_062619_ooi_r_ls9.fits.fz
  ksb_170618_061525_ooi_g_ls9-CCD1 g expnum 79220073 exptime 162.425 propid BASS seeing 1.60 MJD 57922.261 object 28333 
    90prime/CP/V2.3/CP20170617/ksb_170618_061525_ooi_g_ls9.fits.fz
  ksb_170618_061845_ooi_g_ls9-CCD2 g expnum 79220074 exptime 121.071 propid BASS seeing 1.46 MJD 57922.263 object 29463 
    90prime/CP/V2.3/CP20170617/ksb_170618_061845_ooi_g_ls9.fits.fz
  ksb_170624_062822_ooi_r_ls9-CCD2 r expnum 79280073 exptime 76.476 propid BASS seeing 1.20 MJD 57928.270 object 29463 
    90prime/CP/V2.3/CP20170623/ksb_170624_062822_ooi_r_ls9.fits.fz
  ksb_170527_091555_ooi_g_ls9-CCD1 g expnum 79000146 exptime 121.68 propid 2015A-0801 seeing 1.31 MJD 57900.386 object 28331 
    90prime/CP/V2.3/CP20170526/ksb_170527_091555_ooi_g_ls9.fits.fz
  ksb_170405_113113_ooi_r_ls9-CCD1 r expnum 78480179 exptime 62.653 propid BASS seeing 1.30 MJD 57848.480 object 28331 
    90prime/CP/V2.3/CP20170404/ksb_170405_113113_ooi_r_ls9.fits.fz
Faked up EXPNUM 79220073
Faked up EXPNUM 79220073
Faked up EXPNUM 79220073
90prime get_fwhm: self.fwhm = 3.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 46 and amp range 0 2015 and image y 1727 1881 and amp range 0 2047
Range in image: x 0 32 , y 0 155 (with image size 32 x 155)
dzp -0.023075538 -> scaling image by 0.9789709052881876
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79000146
Faked up EXPNUM 79000146
Faked up EXPNUM 79000146
90prime get_fwhm: self.fwhm = 2.89
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1935 2089 and amp range 0 2015 and image y 3705 3858 and amp range 2048 4095
Range in image: x 0 81 , y 0 154 (with image size 155 x 154)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Found overlap: image x 1935 2089 and amp range 2016 4031 and image y 3705 3858 and amp range 2048 4095
Range in image: x 81 155 , y 0 154 (with image size 155 x 154)
dzp 0.020521455 -> scaling image by 1.0190807119283773
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78480179
Faked up EXPNUM 78480179
Faked up EXPNUM 78480179
90prime get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1928 2082 and amp range 0 2015 and image y 3713 3867 and amp range 2048 4095
Range in image: x 0 88 , y 0 155 (with image size 155 x 155)
dzp -0.041613504 -> scaling image by 0.9623977484321999
Found overlap: image x 1928 2082 and amp range 2016 4031 and image y 3713 3867 and amp range 2048 4095
Range in image: x 88 155 , y 0 155 (with image size 155 x 155)
dzp 0.02308583 -> scaling image by 1.021490500713915
Faked up EXPNUM 79220074
Faked up EXPNUM 79220074
Faked up EXPNUM 79220074
90prime get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3697 3852 and amp range 2016 4031 and image y 1896 2052 and amp range 0 2047
Range in image: x 0 156 , y 0 152 (with image size 156 x 157)
dzp 0.01918938 -> scaling image by 1.017831182878158
Found overlap: image x 3697 3852 and amp range 2016 4031 and image y 1896 2052 and amp range 2048 4095
Range in image: x 0 156 , y 152 157 (with image size 156 x 157)
dzp 0.010008041 -> scaling image by 1.0092603604948323
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75800096
Faked up EXPNUM 75800096
Faked up EXPNUM 75800096
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3943 4016 and amp range 2016 4031 and image y 1226 1379 and amp range 0 2047
Range in image: x 0 74 , y 0 154 (with image size 74 x 154)
dzp 0.004245165 -> scaling image by 1.0039175950705865
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75750131
Faked up EXPNUM 75750131
Faked up EXPNUM 75750131
90prime get_fwhm: self.fwhm = 3.99
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3942 4016 and amp range 2016 4031 and image y 1220 1372 and amp range 0 2047
Range in image: x 0 75 , y 0 153 (with image size 75 x 153)
dzp -0.0022715968 -> scaling image by 0.9979099691834846
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75760092
Faked up EXPNUM 75760092
Faked up EXPNUM 75760092
90prime get_fwhm: self.fwhm = 5.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3954 4016 and amp range 2016 4031 and image y 1215 1367 and amp range 0 2047
Range in image: x 0 63 , y 0 153 (with image size 63 x 153)
dzp -0.0022715968 -> scaling image by 0.9979099691834846
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79280073
Faked up EXPNUM 79280073
Faked up EXPNUM 79280073
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3695 3850 and amp range 2016 4031 and image y 1899 2054 and amp range 0 2047
Range in image: x 0 156 , y 0 149 (with image size 156 x 156)
dzp 0.032776505 -> scaling image by 1.0306485625912574
Found overlap: image x 3695 3850 and amp range 2016 4031 and image y 1899 2054 and amp range 2048 4095
Range in image: x 0 156 , y 149 156 (with image size 156 x 156)
dzp 0.021366077 -> scaling image by 1.0198737893800265
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3062 3326 and amp range 2006 4053 and image y 3874 4072 and amp range 2040 4078
Range in image: x 0 265 , y 0 199 (with image size 265 x 199)
dzp -0.006092005 -> scaling image by 0.9944047680378836
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 337 608 and amp range 0 2005 and image y 2703 2971 and amp range 2040 4078
Range in image: x 0 272 , y 0 269 (with image size 272 x 269)
dzp -0.005990375 -> scaling image by 0.994497853444703
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79280072
Faked up EXPNUM 79280072
Faked up EXPNUM 79280072
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 63 and amp range 0 2015 and image y 1718 1872 and amp range 0 2047
Range in image: x 0 49 , y 0 155 (with image size 49 x 155)
dzp -0.024106435 -> scaling image by 0.9780418215011345
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1469 1734 and amp range 0 2047 and image y 3305 3570 and amp range 2040 4078
Range in image: x 0 266 , y 0 266 (with image size 266 x 266)
dzp 0.003927584 -> scaling image by 1.0036239891963392
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 8.34 s, CPU: 2.08 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.179868 MB
Stage tims finished: 2020-08-05T22:07:22.927935
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 6.343 s worker CPU, 32.327 s worker Wall, Wall: 8.346 s, Cores in use: 1.01, Total efficiency (on 32 cores): 3.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T22:07:22.950616
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01378.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01379.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01486.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01275.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/reference-custom-273184p51262.fits
Stage refs : Wall: 11.26 s, CPU: 3.97 s, VmPeak: 1015 MB, VmSize: 1009 MB, VmRSS: 229 MB, VmData: 259 MB, maxrss: 0.23478 MB
Stage refs finished: 2020-08-05T22:07:34.214215
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 11.266 s, Cores in use: 0.35, Total efficiency (on 32 cores): 1.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T22:07:34.386609
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outlier-mask-custom-273184p51262.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outliers-pre-custom-273184p51262.jpg
Image ksb_170527_091555_ooi_g_ls9-CCD1 g : masking 0 positive outlier pixels and 155 negative outlier pixels
Image ksb_170618_061845_ooi_g_ls9-CCD2 g : masking 259 positive outlier pixels and 0 negative outlier pixels
Image ksb_170618_061525_ooi_g_ls9-CCD1 g : masking 1531 positive outlier pixels and 0 negative outlier pixels
Image ksb_160711_072718_ooi_r_ls9-CCD3 r : masking 129 positive outlier pixels and 0 negative outlier pixels
Image ksb_170624_062619_ooi_r_ls9-CCD1 r : masking 1382 positive outlier pixels and 0 negative outlier pixels
Image k4m_170901_054419_ooi_zd_ls9-CCD2 z : masking 236 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outlier-mask-custom-273184p51262.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outliers-post-custom-273184p51262.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outliers-masked-pos-custom-273184p51262.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/outliers-masked-neg-custom-273184p51262.jpg
Stage outliers : Wall: 0.98 s, CPU: 0.66 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 244 MB, VmData: 272 MB, maxrss: 0.249636 MB
Stage outliers finished: 2020-08-05T22:07:35.367557
Resources for stage outliers : 0.912 s worker CPU, 1.232 s worker Wall, Wall: 0.983 s, Cores in use: 1.60, Total efficiency (on 32 cores): 5.0 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T22:07:35.390741
Stage halos : Wall: 0.28 s, CPU: 0.27 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 244 MB, VmData: 272 MB, maxrss: 0.249852 MB
Stage halos finished: 2020-08-05T22:07:35.671571
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.283 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T22:07:35.696949
PSF sigmas in coadd pixels: ['4.30', '2.94', '2.60', '2.38', '2.13']
Using average PSF sigma 2.8678505866700013
Gaussian PSF norm 0.09836453582521952 vs pixelized 0.07452092
average tim pixel scale / coadd scale: 1.728951443121804
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.66', '1.95', '1.95', '2.11']
Using average PSF sigma 2.16656021737239
Gaussian PSF norm 0.13020399318326056 vs pixelized 0.111484915
average tim pixel scale / coadd scale: 1.728828313923974
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.72', '1.36', '1.75']
Using average PSF sigma 1.6122289114821216
Gaussian PSF norm 0.1749719222653987 vs pixelized 0.1513123
average tim pixel scale / coadd scale: 0.9909493360803497
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.15 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 245 MB, VmData: 272 MB, maxrss: 0.251316 MB
Stage fit_on_coadds finished: 2020-08-05T22:07:35.851180
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.168 s worker CPU, 0.168 s worker Wall, Wall: 0.156 s, Cores in use: 2.04, Total efficiency (on 32 cores): 6.4 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T22:07:35.862647
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 30 potential peaks
Of 30 potential peaks: 8 in veto map, 6 cut by saddle test, 0 cut by aper test, 16 kept
SED z : 16 new peaks
Found 21 potential peaks
Of 21 potential peaks: 18 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 22 potential peaks
Of 22 potential peaks: 16 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 31 potential peaks
Of 31 potential peaks: 25 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 39 potential peaks
Of 39 potential peaks: 30 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 22 new sources
Median coadd sky for g : 0.00012808651
Median coadd sky for r : 0.00014789343
Median coadd sky for z : -0.00034392264
Stage srcs : Wall: 0.53 s, CPU: 0.49 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 246 MB, VmData: 272 MB, maxrss: 0.251816 MB
Stage srcs finished: 2020-08-05T22:07:36.392291
Resources for stage srcs : 0.086 s worker CPU, 0.086 s worker Wall, Wall: 0.532 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T22:07:36.406583
Blob 1 of 9, id: 1, sources: 15, size: 181x199, npix 20770, brick X: 66,247, Y: 0,199, one pixel: 207 0
Blob 2 of 9, id: 3, sources: 2, size: 49x56, npix 1632, brick X: 32,81, Y: 47,103, one pixel: 44 47
Blob 3 of 9, id: 4, sources: 2, size: 46x44, npix 1424, brick X: 215,261, Y: 119,163, one pixel: 235 119
Blob 4 of 9, id: 2, sources: 2, size: 55x39, npix 1361, brick X: 12,67, Y: 8,47, one pixel: 21 8
Blob 5 of 9, id: 5, sources: 2, size: 55x37, npix 1166, brick X: 15,70, Y: 149,186, one pixel: 24 149
Blob 6 of 9, id: 0, sources: 3, size: 35x21, npix 550, brick X: 110,145, Y: 0,21, one pixel: 116 0
Blob 7 of 9, id: 6, sources: 1, size: 25x26, npix 427, brick X: 7,32, Y: 210,236, one pixel: 17 210
Blob 8 of 9, id: 8, sources: 1, size: 24x23, npix 331, brick X: 193,217, Y: 240,263, one pixel: 203 240
Blob 9 of 9, id: 7, sources: 1, size: 19x19, npix 208, brick X: 221,240, Y: 232,251, one pixel: 229 232
Blob 9 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 818 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150896 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.18455, 51.25146), pm (-1.6, -15.8), parallax 0.910 with NanoMaggies: g=16.2, r=15, z=(flux -68.5)
Reset brightness to NanoMaggies: g=15.6, r=15, z=14.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.18576, 51.25150), pm (-2.0, -5.8), parallax 0.153 with NanoMaggies: g=16.9, r=16.9, z=(flux -29.2)
Reset brightness to NanoMaggies: g=17.4, r=16.8, z=16.6
Blob 6 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.09518 MB
Blob 7 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.094812 MB
Blob 8 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092332 MB
Measuring 2 iterative sources
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.095956 MB
Measuring 3 iterative sources
Blob 4 finished, total: Wall: 1.51 s, CPU: 1.51 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.152584 MB
Blob 2 finished, total: Wall: 1.56 s, CPU: 1.56 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095344 MB
Measuring 2 iterative sources
Blob 3 finished, total: Wall: 2.63 s, CPU: 2.62 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.1506 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.29614, ee1=0.0473513, ee2=-0.0405206
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 15.11 s, CPU: 15.09 s, VmPeak: 693 MB, VmSize: 691 MB, VmRSS: 123 MB, VmData: 162 MB, maxrss: 0.12814 MB
Old catalog: 35
New catalog: 33
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/blobs-custom-273184p51262.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/metrics/cus/all-models-custom-273184p51262.fits
Stage fitblobs : Wall: 15.88 s, CPU: 0.49 s, VmPeak: 1019 MB, VmSize: 991 MB, VmRSS: 219 MB, VmData: 244 MB, maxrss: 0.252348 MB
Stage fitblobs finished: 2020-08-05T22:07:52.285392
Resources for stage fitblobs : 23.273 s worker CPU, 23.352 s worker Wall, Wall: 15.881 s, Cores in use: 1.50, Total efficiency (on 32 cores): 4.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T22:07:52.314767
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-resid.jpg
Stage coadds : Wall: 17.49 s, CPU: 0.58 s, VmPeak: 1019 MB, VmSize: 991 MB, VmRSS: 219 MB, VmData: 244 MB, maxrss: 0.252348 MB
Stage coadds finished: 2020-08-05T22:08:09.806660
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 24.968 s worker CPU, 44.819 s worker Wall, Wall: 17.494 s, Cores in use: 1.46, Total efficiency (on 32 cores): 4.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T22:08:09.823073
Cut to 1 unWISE tiles
Reading WISE tile 2741p514 band 1
Reading WISE tile 2741p514 band 2
Reading WISE tile 2741p514 band 3
Reading WISE tile 2741p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 818 MB, VmSize: 809 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.192452 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.208312 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 814 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 172 MB, maxrss: 0.204068 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 816 MB, VmSize: 799 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.202528 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.21 s, CPU: 0.61 s, VmPeak: 1019 MB, VmSize: 991 MB, VmRSS: 220 MB, VmData: 244 MB, maxrss: 0.252348 MB
Stage wise_forced finished: 2020-08-05T22:08:12.033777
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.436 s worker CPU, 4.974 s worker Wall, Wall: 2.213 s, Cores in use: 1.83, Total efficiency (on 32 cores): 5.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T22:08:12.050103
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/tractor-i/cus/tractor-custom-273184p51262.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/tractor/cus/tractor-custom-273184p51262.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/tractor/cus/brick-custom-273184p51262.sha256sum
Stage writecat : Wall: 0.70 s, CPU: 0.54 s, VmPeak: 1124 MB, VmSize: 995 MB, VmRSS: 222 MB, VmData: 244 MB, maxrss: 0.357968 MB
Stage writecat finished: 2020-08-05T22:08:12.755001
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.707 s, Cores in use: 0.76, Total efficiency (on 32 cores): 2.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2391204/PGC2391204-largegalaxy-writecat.p
All done: 59.192 s worker CPU, 106.964 s worker Wall, Wall: 58.207 s, Cores in use: 1.19, Total efficiency (on 32 cores): 3.7 %
Finished galaxy PGC2391204 in 1.060 minutes.
Started working on galaxy PGC2391204 at Fri Aug  7 10:05:35 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.18402225727357 51.26242676012468 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T10:08:22.473849
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.18402225727357', '51.26242676012468', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.18402225727357 51.26242676012468 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 273.18402225727357 51.26242676012468
Starting process 65372 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 65373 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 65374 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 65375 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 65376 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 65377 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 65378 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 65379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 65380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 65381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 65382 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 65383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 65384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 65385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 65386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 65387 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T10:09:18.202723
Keeping 12 CCDs:
  k4m_160520_095056_ooi_zd_ls9-CCD1 z expnum 90516 exptime 80.103 propid 2016A-0453 seeing 1.06 MJD 57528.410 object MzLS_655097_z 
    mosaic/CP/V4.3/CP20160519/k4m_160520_095056_ooi_zd_ls9.fits.fz
  k4m_170901_054419_ooi_zd_ls9-CCD2 z expnum 137612 exptime 116.102 propid 2016A-0453 seeing 0.84 MJD 57997.239 object MzLS_654309_z 
    mosaic/CP/V4.3/CP20170831/k4m_170901_054419_ooi_zd_ls9.fits.fz
  k4m_160524_094704_ooi_zd_ls9-CCD1 z expnum 91252 exptime 80.103 propid 2016A-0453 seeing 1.08 MJD 57532.408 object MzLS_655880_z 
    mosaic/CP/V4.3/CP20160523/k4m_160524_094704_ooi_zd_ls9.fits.fz
  ksb_160707_091007_ooi_g_ls9-CCD3 g expnum 75760092 exptime 243.9 propid BASS seeing 2.65 MJD 57576.382 object 28332 
    90prime/CP/V2.3/CP20160706/ksb_160707_091007_ooi_g_ls9.fits.fz
  ksb_160706_104941_ooi_g_ls9-CCD3 g expnum 75750131 exptime 193.2 propid BASS seeing 1.81 MJD 57575.451 object 28332 
    90prime/CP/V2.3/CP20160705/ksb_160706_104941_ooi_g_ls9.fits.fz
  ksb_160711_072718_ooi_r_ls9-CCD3 r expnum 75800096 exptime 77.7 propid BASS seeing 1.64 MJD 57580.311 object 28332 
    90prime/CP/V2.3/CP20160710/ksb_160711_072718_ooi_r_ls9.fits.fz
  ksb_170624_062619_ooi_r_ls9-CCD1 r expnum 79280072 exptime 85.462 propid BASS seeing 1.20 MJD 57928.268 object 28333 
    90prime/CP/V2.3/CP20170623/ksb_170624_062619_ooi_r_ls9.fits.fz
  ksb_170618_061525_ooi_g_ls9-CCD1 g expnum 79220073 exptime 162.425 propid BASS seeing 1.60 MJD 57922.261 object 28333 
    90prime/CP/V2.3/CP20170617/ksb_170618_061525_ooi_g_ls9.fits.fz
  ksb_170618_061845_ooi_g_ls9-CCD2 g expnum 79220074 exptime 121.071 propid BASS seeing 1.46 MJD 57922.263 object 29463 
    90prime/CP/V2.3/CP20170617/ksb_170618_061845_ooi_g_ls9.fits.fz
  ksb_170624_062822_ooi_r_ls9-CCD2 r expnum 79280073 exptime 76.476 propid BASS seeing 1.20 MJD 57928.270 object 29463 
    90prime/CP/V2.3/CP20170623/ksb_170624_062822_ooi_r_ls9.fits.fz
  ksb_170527_091555_ooi_g_ls9-CCD1 g expnum 79000146 exptime 121.68 propid 2015A-0801 seeing 1.31 MJD 57900.386 object 28331 
    90prime/CP/V2.3/CP20170526/ksb_170527_091555_ooi_g_ls9.fits.fz
  ksb_170405_113113_ooi_r_ls9-CCD1 r expnum 78480179 exptime 62.653 propid BASS seeing 1.30 MJD 57848.480 object 28331 
    90prime/CP/V2.3/CP20170404/ksb_170405_113113_ooi_r_ls9.fits.fz
Faked up EXPNUM 78480179
Faked up EXPNUM 78480179
Faked up EXPNUM 78480179
90prime get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1929 2083 and amp range 0 2015 and image y 3716 3870 and amp range 2048 4095
Range in image: x 0 87 , y 0 155 (with image size 155 x 155)
dzp -0.041613504 -> scaling image by 0.9623977484321999
Found overlap: image x 1929 2083 and amp range 2016 4031 and image y 3716 3870 and amp range 2048 4095
Range in image: x 87 155 , y 0 155 (with image size 155 x 155)
dzp 0.02308583 -> scaling image by 1.021490500713915
Faked up EXPNUM 79000146
Faked up EXPNUM 79000146
Faked up EXPNUM 79000146
90prime get_fwhm: self.fwhm = 2.89
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1936 2090 and amp range 0 2015 and image y 3708 3861 and amp range 2048 4095
Range in image: x 0 80 , y 0 154 (with image size 155 x 154)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Found overlap: image x 1936 2090 and amp range 2016 4031 and image y 3708 3861 and amp range 2048 4095
Range in image: x 80 155 , y 0 154 (with image size 155 x 154)
dzp 0.020521455 -> scaling image by 1.0190807119283773
Faked up EXPNUM 75750131
Faked up EXPNUM 75750131
Faked up EXPNUM 75750131
90prime get_fwhm: self.fwhm = 3.99
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3943 4016 and amp range 2016 4031 and image y 1223 1376 and amp range 0 2047
Range in image: x 0 74 , y 0 154 (with image size 74 x 154)
dzp -0.0022715968 -> scaling image by 0.9979099691834846
mosaic get_fwhm: self.fwhm = 4.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 335 606 and amp range 0 2005 and image y 2698 2965 and amp range 2040 4078
Range in image: x 0 272 , y 0 268 (with image size 272 x 268)
dzp -0.005990375 -> scaling image by 0.994497853444703
Faked up EXPNUM 75800096
Faked up EXPNUM 75800096
Faked up EXPNUM 75800096
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3944 4016 and amp range 2016 4031 and image y 1230 1382 and amp range 0 2047
Range in image: x 0 73 , y 0 153 (with image size 73 x 153)
dzp 0.004245165 -> scaling image by 1.0039175950705865
mosaic get_fwhm: self.fwhm = 4.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3060 3324 and amp range 2006 4053 and image y 3869 4072 and amp range 2040 4078
Range in image: x 0 265 , y 0 204 (with image size 265 x 204)
dzp -0.006092005 -> scaling image by 0.9944047680378836
Faked up EXPNUM 79280073
Faked up EXPNUM 79280073
Faked up EXPNUM 79280073
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3696 3851 and amp range 2016 4031 and image y 1902 2058 and amp range 0 2047
Range in image: x 0 156 , y 0 146 (with image size 156 x 157)
dzp 0.032776505 -> scaling image by 1.0306485625912574
Found overlap: image x 3696 3851 and amp range 2016 4031 and image y 1902 2058 and amp range 2048 4095
Range in image: x 0 156 , y 146 157 (with image size 156 x 157)
dzp 0.021366077 -> scaling image by 1.0198737893800265
Faked up EXPNUM 79220074
Faked up EXPNUM 79220074
Faked up EXPNUM 79220074
90prime get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3698 3853 and amp range 2016 4031 and image y 1900 2055 and amp range 0 2047
Range in image: x 0 156 , y 0 148 (with image size 156 x 156)
dzp 0.01918938 -> scaling image by 1.017831182878158
Found overlap: image x 3698 3853 and amp range 2016 4031 and image y 1900 2055 and amp range 2048 4095
Range in image: x 0 156 , y 148 156 (with image size 156 x 156)
dzp 0.010008041 -> scaling image by 1.0092603604948323
Faked up EXPNUM 79220073
Faked up EXPNUM 79220073
Faked up EXPNUM 79220073
90prime get_fwhm: self.fwhm = 3.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 47 and amp range 0 2015 and image y 1731 1884 and amp range 0 2047
Range in image: x 0 33 , y 0 154 (with image size 33 x 154)
dzp -0.023075538 -> scaling image by 0.9789709052881876
mosaic get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1467 1733 and amp range 0 2047 and image y 3299 3565 and amp range 2040 4078
Range in image: x 0 267 , y 0 267 (with image size 267 x 267)
dzp 0.003927584 -> scaling image by 1.0036239891963392
Faked up EXPNUM 75760092
Faked up EXPNUM 75760092
Faked up EXPNUM 75760092
90prime get_fwhm: self.fwhm = 5.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3955 4016 and amp range 2016 4031 and image y 1218 1371 and amp range 0 2047
Range in image: x 0 62 , y 0 154 (with image size 62 x 154)
dzp -0.0022715968 -> scaling image by 0.9979099691834846
Faked up EXPNUM 79280072
Faked up EXPNUM 79280072
Faked up EXPNUM 79280072
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 64 and amp range 0 2015 and image y 1721 1875 and amp range 0 2047
Range in image: x 0 50 , y 0 155 (with image size 50 x 155)
dzp -0.024106435 -> scaling image by 0.9780418215011345
Stage tims : Wall: 188.81 s, CPU: 21.40 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.177056 MB
Stage tims finished: 2020-08-07T10:12:27.010947
Resources for stage tims : 5.579 s worker CPU, 978.865 s worker Wall, Wall: 188.810 s, Cores in use: 0.14, Total efficiency (on 16 cores): 0.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T10:12:27.033476
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01378.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01379.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01486.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01275.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/metrics/cus/reference-custom-273184p51262.fits
Stage refs : Wall: 175.77 s, CPU: 39.38 s, VmPeak: 1008 MB, VmSize: 1003 MB, VmRSS: 227 MB, VmData: 258 MB, maxrss: 0.231968 MB
Stage refs finished: 2020-08-07T10:15:22.800594
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 175.769 s, Cores in use: 0.22, Total efficiency (on 16 cores): 1.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T10:15:22.822851
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/metrics/cus/outlier-mask-custom-273184p51262.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/metrics/cus/outliers-pre-custom-273184p51262.jpg
Image ksb_170618_061525_ooi_g_ls9-CCD1 g : masking 1528 positive outlier pixels and 0 negative outlier pixels
Image ksb_170618_061845_ooi_g_ls9-CCD2 g : masking 242 positive outlier pixels and 0 negative outlier pixels
Image ksb_170527_091555_ooi_g_ls9-CCD1 g : masking 0 positive outlier pixels and 152 negative outlier pixels
Image ksb_170624_062619_ooi_r_ls9-CCD1 r : masking 1365 positive outlier pixels and 0 negative outlier pixels
Image k4m_170901_054419_ooi_zd_ls9-CCD2 z : masking 244 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/metrics/cus/outlier-mask-custom-273184p51262.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/metrics/cus/outliers-post-custom-273184p51262.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/metrics/cus/outliers-masked-pos-custom-273184p51262.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/metrics/cus/outliers-masked-neg-custom-273184p51262.jpg
Stage outliers : Wall: 56.18 s, CPU: 43.60 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 241 MB, VmData: 270 MB, maxrss: 0.246708 MB
Stage outliers finished: 2020-08-07T10:16:19.003528
Resources for stage outliers : 0.715 s worker CPU, 0.805 s worker Wall, Wall: 56.182 s, Cores in use: 0.79, Total efficiency (on 16 cores): 4.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T10:16:19.025271
Stage halos : Wall: 51.65 s, CPU: 40.18 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 241 MB, VmData: 270 MB, maxrss: 0.247224 MB
Stage halos finished: 2020-08-07T10:17:10.673656
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 51.650 s, Cores in use: 0.78, Total efficiency (on 16 cores): 4.9 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T10:17:10.705722
PSF sigmas in coadd pixels: ['4.30', '2.94', '2.60', '2.38', '2.13']
Using average PSF sigma 2.8678505866700013
Gaussian PSF norm 0.09836453582521952 vs pixelized 0.07452161
average tim pixel scale / coadd scale: 1.728951443121804
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.66', '1.95', '1.95', '2.11']
Using average PSF sigma 2.16656021737239
Gaussian PSF norm 0.13020399318326056 vs pixelized 0.11148299
average tim pixel scale / coadd scale: 1.728828313923974
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.72', '1.36', '1.75']
Using average PSF sigma 1.6122289114821216
Gaussian PSF norm 0.1749719222653987 vs pixelized 0.15130402
average tim pixel scale / coadd scale: 0.9909493360803497
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.16 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 243 MB, VmData: 271 MB, maxrss: 0.249236 MB
Stage fit_on_coadds finished: 2020-08-07T10:17:10.869336
Resources for stage fit_on_coadds : 0.173 s worker CPU, 0.173 s worker Wall, Wall: 0.165 s, Cores in use: 2.04, Total efficiency (on 16 cores): 12.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-fit_on_coadds.p
Running stage srcs
Warning: Stellar halo subtraction is only implemented for DECam
Running stage srcs at 2020-08-07T10:17:10.911434
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 33 potential peaks
Of 33 potential peaks: 12 in veto map, 6 cut by saddle test, 0 cut by aper test, 15 kept
SED z : 15 new peaks
Found 21 potential peaks
Of 21 potential peaks: 17 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 22 potential peaks
Of 22 potential peaks: 17 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 30 potential peaks
Of 30 potential peaks: 24 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 40 potential peaks
Of 40 potential peaks: 30 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 22 new sources
Median coadd sky for g : 0.00013882456
Median coadd sky for r : 0.00015657213
Median coadd sky for z : -0.00031347957
Stage srcs : Wall: 34.60 s, CPU: 33.43 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 244 MB, VmData: 271 MB, maxrss: 0.24972 MB
Stage srcs finished: 2020-08-07T10:17:45.510508
Resources for stage srcs : 0.072 s worker CPU, 0.072 s worker Wall, Wall: 34.601 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T10:17:50.582988
Blob 1 of 10, id: 2, sources: 14, size: 181x198, npix 20790, brick X: 61,242, Y: 2,200, one pixel: 201 2
Blob 2 of 10, id: 4, sources: 2, size: 48x55, npix 1607, brick X: 27,75, Y: 49,104, one pixel: 38 49
Blob 3 of 10, id: 5, sources: 2, size: 47x44, npix 1456, brick X: 209,256, Y: 121,165, one pixel: 229 121
Blob 4 of 10, id: 3, sources: 2, size: 55x39, npix 1361, brick X: 7,62, Y: 10,49, one pixel: 15 10
Blob 5 of 10, id: 6, sources: 2, size: 55x38, npix 1163, brick X: 9,64, Y: 150,188, one pixel: 19 150
Blob 6 of 10, id: 1, sources: 3, size: 38x23, npix 650, brick X: 104,142, Y: 0,23, one pixel: 109 0
Blob 7 of 10, id: 7, sources: 1, size: 25x26, npix 426, brick X: 1,26, Y: 212,238, one pixel: 11 212
Blob 8 of 10, id: 9, sources: 1, size: 23x21, npix 330, brick X: 188,211, Y: 242,263, one pixel: 197 242
Blob 9 of 10, id: 8, sources: 1, size: 19x19, npix 199, brick X: 215,234, Y: 234,253, one pixel: 224 234
Blob 10 of 10, id: 0, sources: 1, size: 18x16, npix 167, brick X: 64,82, Y: 0,16, one pixel: 71 0
Blob 10 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146984 MB
Blob 9 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147528 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.18455, 51.25146), pm (-1.6, -15.8), parallax 0.910 with NanoMaggies: g=16.7, r=15.6, z=18.2
Reset brightness to NanoMaggies: g=15.6, r=15, z=14.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.18576, 51.25150), pm (-2.0, -5.8), parallax 0.153 with NanoMaggies: g=17.1, r=16.6, z=17.3
Reset brightness to NanoMaggies: g=17.4, r=16.8, z=16.6
Blob 6 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147336 MB
Blob 8 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 816 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147452 MB
Blob 7 finished, total: Wall: 0.50 s, CPU: 0.49 s, VmPeak: 818 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.145964 MB
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14842 MB
Measuring 3 iterative sources
Measuring 2 iterative sources
Blob 2 finished, total: Wall: 1.35 s, CPU: 1.35 s, VmPeak: 669 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.095832 MB
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 1.74 s, CPU: 1.74 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148168 MB
Blob 3 finished, total: Wall: 1.88 s, CPU: 1.87 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146604 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.415091, ee1=0.0426016, ee2=-0.00778704
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 16.24 s, CPU: 14.93 s, VmPeak: 809 MB, VmSize: 729 MB, VmRSS: 153 MB, VmData: 184 MB, maxrss: 0.156316 MB
Old catalog: 34
New catalog: 31
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/metrics/cus/blobs-custom-273184p51262.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/metrics/cus/all-models-custom-273184p51262.fits
Stage fitblobs : Wall: 46.91 s, CPU: 30.11 s, VmPeak: 1012 MB, VmSize: 986 MB, VmRSS: 218 MB, VmData: 244 MB, maxrss: 0.25024 MB
Stage fitblobs finished: 2020-08-07T10:18:37.491937
Resources for stage fitblobs : 22.678 s worker CPU, 24.018 s worker Wall, Wall: 46.910 s, Cores in use: 1.13, Total efficiency (on 16 cores): 7.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T10:18:37.505239
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-resid.jpg
Stage coadds : Wall: 153.65 s, CPU: 71.15 s, VmPeak: 1012 MB, VmSize: 986 MB, VmRSS: 218 MB, VmData: 244 MB, maxrss: 0.25024 MB
Stage coadds finished: 2020-08-07T10:21:11.153538
Resources for stage coadds : 4.683 s worker CPU, 449.751 s worker Wall, Wall: 153.650 s, Cores in use: 0.49, Total efficiency (on 16 cores): 3.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T10:21:12.636265
Cut to 1 unWISE tiles
Reading WISE tile 2741p514 band 1
Reading WISE tile 2741p514 band 2
Reading WISE tile 2741p514 band 3
Reading WISE tile 2741p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 798 MB, VmRSS: 145 MB, VmData: 176 MB, maxrss: 0.185 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 795 MB, VmRSS: 142 MB, VmData: 173 MB, maxrss: 0.202004 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 814 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.20558 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p514/unwise-2741p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 792 MB, VmSize: 792 MB, VmRSS: 135 MB, VmData: 170 MB, maxrss: 0.193288 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/tmp-legacysurvey-custom-273184p51262-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 50.27 s, CPU: 25.93 s, VmPeak: 1012 MB, VmSize: 986 MB, VmRSS: 219 MB, VmData: 244 MB, maxrss: 0.25024 MB
Stage wise_forced finished: 2020-08-07T10:22:02.905849
Resources for stage wise_forced : 2.964 s worker CPU, 32.488 s worker Wall, Wall: 50.271 s, Cores in use: 0.57, Total efficiency (on 16 cores): 3.6 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T10:22:02.919025
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/coadd/cus/custom-273184p51262/legacysurvey-custom-273184p51262-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/tractor-i/cus/tractor-custom-273184p51262.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/tractor/cus/tractor-custom-273184p51262.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/tractor/cus/brick-custom-273184p51262.sha256sum
Stage writecat : Wall: 37.29 s, CPU: 37.59 s, VmPeak: 1118 MB, VmSize: 990 MB, VmRSS: 221 MB, VmData: 244 MB, maxrss: 0.356888 MB
Stage writecat finished: 2020-08-07T10:22:40.213519
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 37.296 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2391204/PGC2391204-largegalaxy-writecat.p
All done: 36.868 s worker CPU, 1486.176 s worker Wall, Wall: 802.031 s, Cores in use: 0.47, Total efficiency (on 16 cores): 3.0 %
Finished galaxy PGC2391204 in 17.084 minutes.