Started working on galaxy PGC2406170 at Wed Aug  5 20:11:04 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.80435 52.074902 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:11:05.260918
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.80435', '52.074902', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.80435 52.074902 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 277.80435 52.074902
Starting process 39633 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 39634 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 39635 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 39636 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 39637 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 39638 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 39639 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 39640 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 39641 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 39642 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 39643 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 39644 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39645 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39647 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39646 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39648 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:11:06.277200
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 11 CCDs:
  k4m_160525_094208_ooi_zd_ls9-CCD3 z expnum 91475 exptime 104.105 propid 2016A-0453 seeing 1.17 MJD 57533.404 object MzLS_658217_z 
    mosaic/CP/V4.3/CP20160524/k4m_160525_094208_ooi_zd_ls9.fits.fz
  k4m_160527_095501_ooi_zd_ls9-CCD4 z expnum 91889 exptime 80.105 propid 2016A-0453 seeing 0.74 MJD 57535.413 object MzLS_657444_z 
    mosaic/CP/V4.3/CP20160526/k4m_160527_095501_ooi_zd_ls9.fits.fz
  k4m_170901_070845_ooi_zd_ls9-CCD3 z expnum 137640 exptime 136.105 propid 2016A-0453 seeing 0.87 MJD 57997.298 object MzLS_658988_z 
    mosaic/CP/V4.3/CP20170831/k4m_170901_070845_ooi_zd_ls9.fits.fz
  k4m_170929_053825_ooi_zd_ls9-CCD1 z expnum 141316 exptime 132.102 propid 2016A-0453 seeing 1.09 MJD 58025.235 object MzLS_658218_z 
    mosaic/CP/V4.3/CP20170928/k4m_170929_053825_ooi_zd_ls9.fits.fz
  ksb_180515_103318_ooi_g_ls9-CCD3 g expnum 82530163 exptime 95.238 propid NOTBASS seeing 1.42 MJD 58253.440 object 29491 
    90prime/CP/V2.3/CP20180514/ksb_180515_103318_ooi_g_ls9.fits.fz
  ksb_170405_114733_ooi_r_ls9-CCD3 r expnum 78480189 exptime 63.747 propid BASS seeing 1.26 MJD 57848.491 object 29491 
    90prime/CP/V2.3/CP20170404/ksb_170405_114733_ooi_r_ls9.fits.fz
  ksb_160707_095124_ooi_g_ls9-CCD4 g expnum 75760101 exptime 172.3 propid BASS seeing 2.10 MJD 57576.411 object 29492 
    90prime/CP/V2.3/CP20160706/ksb_160707_095124_ooi_g_ls9.fits.fz
  ksb_160706_103724_ooi_g_ls9-CCD4 g expnum 75750128 exptime 172.5 propid BASS seeing 1.70 MJD 57575.443 object 29492 
    90prime/CP/V2.3/CP20160705/ksb_160706_103724_ooi_g_ls9.fits.fz
  ksb_160712_070859_ooi_r_ls9-CCD4 r expnum 75810090 exptime 98.1 propid BASS seeing 1.64 MJD 57581.298 object 29492 
    90prime/CP/V2.3/CP20160711/ksb_160712_070859_ooi_r_ls9.fits.fz
  ksb_170624_065014_ooi_r_ls9-CCD1 r expnum 79280084 exptime 83.639 propid BASS seeing 1.20 MJD 57928.285 object 29493 
    90prime/CP/V2.3/CP20170623/ksb_170624_065014_ooi_r_ls9.fits.fz
  ksb_170619_080813_ooi_g_ls9-CCD1 g expnum 79230114 exptime 241.242 propid BASS seeing 2.45 MJD 57923.339 object 29493 
    90prime/CP/V2.3/CP20170618/ksb_170619_080813_ooi_g_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 3.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 774 1043 and amp range 0 2005 and image y 2546 2819 and amp range 2040 4078
Range in image: x 0 270 , y 0 274 (with image size 270 x 274)
dzp 0.01523814 -> scaling image by 1.014133796220052
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 82530163
Faked up EXPNUM 82530163
Faked up EXPNUM 82530163
90prime get_fwhm: self.fwhm = 3.13
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3467 3620 and amp range 2016 4031 and image y 933 1086 and amp range 0 2047
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp -0.0012233759 -> scaling image by 0.9988738637196966
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75810090
Faked up EXPNUM 75810090
Faked up EXPNUM 75810090
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1270 1423 and amp range 0 2015 and image y 2904 3057 and amp range 2048 4095
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp 0.004205519 -> scaling image by 1.0038809374310762
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75750128
Faked up EXPNUM 75750128
Faked up EXPNUM 75750128
90prime get_fwhm: self.fwhm = 3.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1275 1428 and amp range 0 2015 and image y 2897 3050 and amp range 2048 4095
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp 0.009255477 -> scaling image by 1.0085610475070432
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78480189
Faked up EXPNUM 78480189
Faked up EXPNUM 78480189
90prime get_fwhm: self.fwhm = 2.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3445 3598 and amp range 2016 4031 and image y 935 1087 and amp range 0 2047
Range in image: x 0 154 , y 0 153 (with image size 154 x 153)
dzp -0.0023383768 -> scaling image by 0.9978485929508539
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79280084
Faked up EXPNUM 79280084
Faked up EXPNUM 79280084
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1428 1583 and amp range 0 2015 and image y 3405 3559 and amp range 2048 4095
Range in image: x 0 156 , y 0 155 (with image size 156 x 155)
dzp -0.041613504 -> scaling image by 0.9623977484321999
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3508 3774 and amp range 2006 4053 and image y 3948 4072 and amp range 2040 4078
Range in image: x 0 267 , y 0 125 (with image size 267 x 125)
dzp -0.0026360443 -> scaling image by 0.99757505842151
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3480 3746 and amp range 2006 4053 and image y 299 569 and amp range 0 2039
Range in image: x 0 267 , y 0 271 (with image size 267 x 271)
dzp 0.0061123776 -> scaling image by 1.005645584425507
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 2.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1931 2202 and amp range 0 2047 and image y 2724 2992 and amp range 2022 4060
Range in image: x 0 117 , y 0 269 (with image size 272 x 269)
dzp 0.0033053984 -> scaling image by 1.0030490232713904
Found overlap: image x 1931 2202 and amp range 2048 4095 and image y 2724 2992 and amp range 2022 4060
Range in image: x 117 272 , y 0 269 (with image size 272 x 269)
dzp -0.0028835079 -> scaling image by 0.9973477146455455
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75760101
Faked up EXPNUM 75760101
Faked up EXPNUM 75760101
90prime get_fwhm: self.fwhm = 4.63
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1282 1435 and amp range 0 2015 and image y 2893 3046 and amp range 2048 4095
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp 0.009255477 -> scaling image by 1.0085610475070432
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79230114
Faked up EXPNUM 79230114
Faked up EXPNUM 79230114
90prime get_fwhm: self.fwhm = 5.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1427 1581 and amp range 0 2015 and image y 3416 3569 and amp range 2048 4095
Range in image: x 0 155 , y 0 154 (with image size 155 x 154)
dzp -0.034377232 -> scaling image by 0.9688334104074875
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 10.97 s, CPU: 1.32 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.179728 MB
Stage tims finished: 2020-08-05T20:11:17.248581
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 6.786 s worker CPU, 62.784 s worker Wall, Wall: 10.973 s, Cores in use: 0.74, Total efficiency (on 16 cores): 4.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:11:17.342666
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01380.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01277.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/reference-custom-277804p52074.fits
Stage refs : Wall: 17.80 s, CPU: 5.79 s, VmPeak: 1020 MB, VmSize: 1015 MB, VmRSS: 235 MB, VmData: 265 MB, maxrss: 0.240968 MB
Stage refs finished: 2020-08-05T20:11:35.146659
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 17.806 s, Cores in use: 0.33, Total efficiency (on 16 cores): 2.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:11:35.248141
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outlier-mask-custom-277804p52074.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outliers-pre-custom-277804p52074.jpg
Image ksb_170619_080813_ooi_g_ls9-CCD1 g : masking 194 positive outlier pixels and 0 negative outlier pixels
Image ksb_160712_070859_ooi_r_ls9-CCD4 r : masking 69 positive outlier pixels and 0 negative outlier pixels
Image k4m_160525_094208_ooi_zd_ls9-CCD3 z : masking 2820 positive outlier pixels and 0 negative outlier pixels
Image k4m_170929_053825_ooi_zd_ls9-CCD1 z : masking 337 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outlier-mask-custom-277804p52074.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outliers-post-custom-277804p52074.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outliers-masked-pos-custom-277804p52074.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outliers-masked-neg-custom-277804p52074.jpg
Stage outliers : Wall: 2.28 s, CPU: 1.95 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.25646 MB
Stage outliers finished: 2020-08-05T20:11:37.524841
Resources for stage outliers : 0.930 s worker CPU, 1.061 s worker Wall, Wall: 2.278 s, Cores in use: 1.27, Total efficiency (on 16 cores): 7.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:11:37.553061
Stage halos : Wall: 0.78 s, CPU: 0.77 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.25646 MB
Stage halos finished: 2020-08-05T20:11:38.337705
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.786 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:11:38.408072
PSF sigmas in coadd pixels: ['2.30', '3.41', '2.76', '3.98']
Using average PSF sigma 3.113091088063833
Gaussian PSF norm 0.09061565620597539 vs pixelized 0.072828814
average tim pixel scale / coadd scale: 1.729629463507289
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.05', '2.66', '1.95']
Using average PSF sigma 2.2197860041158166
Gaussian PSF norm 0.12708197603319962 vs pixelized 0.112600416
average tim pixel scale / coadd scale: 1.7291726944399357
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.90', '1.20', '1.41', '1.78']
Using average PSF sigma 1.5728350435456226
Gaussian PSF norm 0.17935434038775952 vs pixelized 0.15570295
average tim pixel scale / coadd scale: 0.9909269083575665
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.18 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 253 MB, VmData: 278 MB, maxrss: 0.25888 MB
Stage fit_on_coadds finished: 2020-08-05T20:11:38.607935
Resources for stage fit_on_coadds : 0.219 s worker CPU, 0.219 s worker Wall, Wall: 0.201 s, Cores in use: 1.96, Total efficiency (on 16 cores): 12.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:11:38.618951
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 53 potential peaks
Of 53 potential peaks: 15 in veto map, 6 cut by saddle test, 0 cut by aper test, 32 kept
SED z : 32 new peaks
Found 49 potential peaks
Of 49 potential peaks: 45 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 35 potential peaks
Of 35 potential peaks: 33 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 69 potential peaks
Of 69 potential peaks: 59 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 84 potential peaks
Of 84 potential peaks: 72 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 37 new sources
Median coadd sky for g : 0.00036309555
Median coadd sky for r : 0.0005244281
Median coadd sky for z : -3.4502977e-05
Stage srcs : Wall: 1.00 s, CPU: 0.93 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 253 MB, VmData: 278 MB, maxrss: 0.259528 MB
Stage srcs finished: 2020-08-05T20:11:39.615575
Resources for stage srcs : 0.095 s worker CPU, 0.095 s worker Wall, Wall: 0.998 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:11:39.647060
Blob 1 of 11, id: 7, sources: 34, size: 263x232, npix 37421, brick X: 0,263, Y: 31,263, one pixel: 31 31
Blob 2 of 11, id: 5, sources: 2, size: 55x40, npix 1473, brick X: 124,179, Y: 9,49, one pixel: 139 9
Blob 3 of 11, id: 9, sources: 1, size: 29x46, npix 1003, brick X: 234,263, Y: 73,119, one pixel: 251 73
Blob 4 of 11, id: 3, sources: 2, size: 31x38, npix 567, brick X: 205,236, Y: 3,41, one pixel: 216 3
Blob 5 of 11, id: 2, sources: 1, size: 27x24, npix 455, brick X: 235,262, Y: 0,24, one pixel: 243 0
Blob 6 of 11, id: 1, sources: 1, size: 29x21, npix 419, brick X: 46,75, Y: 0,21, one pixel: 51 0
Blob 7 of 11, id: 0, sources: 1, size: 25x20, npix 349, brick X: 20,45, Y: 0,20, one pixel: 27 0
Blob 8 of 11, id: 4, sources: 1, size: 25x22, npix 336, brick X: 92,117, Y: 9,31, one pixel: 102 9
Blob 9 of 11, id: 6, sources: 1, size: 20x19, npix 227, brick X: 13,33, Y: 16,35, one pixel: 21 16
Blob 10 of 11, id: 10, sources: 1, size: 20x19, npix 217, brick X: 84,104, Y: 242,261, one pixel: 94 242
Blob 11 of 11, id: 8, sources: 1, size: 15x20, npix 189, brick X: 0,15, Y: 47,67, one pixel: 5 47
Blob 8 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 88 MB, VmData: 139 MB, maxrss: 0.089728 MB
Blob 10 finished, total: Wall: 0.08 s, CPU: 0.06 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.08736 MB
Blob 9 finished, total: Wall: 0.28 s, CPU: 0.25 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150824 MB
Blob 6 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151468 MB
Blob 11 finished, total: Wall: 0.45 s, CPU: 0.44 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151228 MB
Blob 7 finished, total: Wall: 0.58 s, CPU: 0.54 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095116 MB
Blob 4 finished, total: Wall: 0.58 s, CPU: 0.57 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150812 MB
Blob 5 finished, total: Wall: 0.77 s, CPU: 0.75 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.096152 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 1.14 s, CPU: 1.11 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151136 MB
Blob 3 finished, total: Wall: 1.30 s, CPU: 1.29 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151428 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.54824, ee1=-0.170959, ee2=-0.164114
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.78250, 52.07950), pm (-0.2, -13.2), parallax 0.194 with NanoMaggies: g=18.7, r=18.1, z=17.8
Reset brightness to NanoMaggies: g=18.7, r=18.1, z=17.8
Measuring 15 iterative sources
Blob 1 finished, total: Wall: 28.58 s, CPU: 28.55 s, VmPeak: 812 MB, VmSize: 742 MB, VmRSS: 165 MB, VmData: 194 MB, maxrss: 0.175248 MB
Old catalog: 50
New catalog: 57
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/blobs-custom-277804p52074.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/all-models-custom-277804p52074.fits
Stage fitblobs : Wall: 30.72 s, CPU: 2.01 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 255 MB, VmData: 280 MB, maxrss: 0.260684 MB
Stage fitblobs finished: 2020-08-05T20:12:10.365406
Resources for stage fitblobs : 34.148 s worker CPU, 35.056 s worker Wall, Wall: 30.720 s, Cores in use: 1.18, Total efficiency (on 16 cores): 7.4 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:12:10.381140
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-resid.jpg
Stage coadds : Wall: 3.60 s, CPU: 0.85 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 255 MB, VmData: 280 MB, maxrss: 0.261008 MB
Stage coadds finished: 2020-08-05T20:12:13.978895
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 8.845 s worker CPU, 13.502 s worker Wall, Wall: 3.599 s, Cores in use: 2.69, Total efficiency (on 16 cores): 16.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T20:12:13.996499
Cut to 2 unWISE tiles
Reading WISE tile 2765p514 band 1
Reading WISE tile 2765p514 band 2
Reading WISE tile 2765p514 band 4
Reading WISE tile 2765p514 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 4
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 1
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.18 s, CPU: 0.18 s, VmPeak: 818 MB, VmSize: 818 MB, VmRSS: 166 MB, VmData: 186 MB, maxrss: 0.211244 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.209524 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 808 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 172 MB, maxrss: 0.207676 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 814 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 173 MB, maxrss: 0.20888 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 6.64 s, CPU: 0.99 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 255 MB, VmData: 280 MB, maxrss: 0.26152 MB
Stage wise_forced finished: 2020-08-05T20:12:20.638694
Resources for stage wise_forced : 6.492 s worker CPU, 16.572 s worker Wall, Wall: 6.644 s, Cores in use: 1.13, Total efficiency (on 16 cores): 7.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:12:20.673333
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/tractor-i/cus/tractor-custom-277804p52074.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/tractor/cus/tractor-custom-277804p52074.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/tractor/cus/brick-custom-277804p52074.sha256sum
Stage writecat : Wall: 3.12 s, CPU: 2.64 s, VmPeak: 1157 MB, VmSize: 1029 MB, VmRSS: 257 MB, VmData: 280 MB, maxrss: 0.3944 MB
Stage writecat finished: 2020-08-05T20:12:23.797361
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.126 s, Cores in use: 0.84, Total efficiency (on 16 cores): 5.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-writecat.p
All done: 57.520 s worker CPU, 129.293 s worker Wall, Wall: 77.544 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 %
Finished galaxy PGC2406170 in 1.334 minutes.
Started working on galaxy PGC2406170 at Wed Aug  5 21:38:15 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.80435 52.074902 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T21:38:16.942377
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.80435', '52.074902', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.80435 52.074902 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 277.80435 52.074902
Starting process 57301 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 57302 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 57303 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 57304 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 57305 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 57306 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 57307 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 57308 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 57309 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 57310 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 57311 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 57312 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 57313 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57314 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57315 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57316 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57317 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 57318 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 57319 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 57320 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 57321 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 57322 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 57323 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 57324 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 57325 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 57327 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 57328 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 57329 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 57330 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 57331 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 57332 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 57333 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T21:38:18.905568
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 11 CCDs:
  k4m_160525_094208_ooi_zd_ls9-CCD3 z expnum 91475 exptime 104.105 propid 2016A-0453 seeing 1.17 MJD 57533.404 object MzLS_658217_z 
    mosaic/CP/V4.3/CP20160524/k4m_160525_094208_ooi_zd_ls9.fits.fz
  k4m_160527_095501_ooi_zd_ls9-CCD4 z expnum 91889 exptime 80.105 propid 2016A-0453 seeing 0.74 MJD 57535.413 object MzLS_657444_z 
    mosaic/CP/V4.3/CP20160526/k4m_160527_095501_ooi_zd_ls9.fits.fz
  k4m_170901_070845_ooi_zd_ls9-CCD3 z expnum 137640 exptime 136.105 propid 2016A-0453 seeing 0.87 MJD 57997.298 object MzLS_658988_z 
    mosaic/CP/V4.3/CP20170831/k4m_170901_070845_ooi_zd_ls9.fits.fz
  k4m_170929_053825_ooi_zd_ls9-CCD1 z expnum 141316 exptime 132.102 propid 2016A-0453 seeing 1.09 MJD 58025.235 object MzLS_658218_z 
    mosaic/CP/V4.3/CP20170928/k4m_170929_053825_ooi_zd_ls9.fits.fz
  ksb_180515_103318_ooi_g_ls9-CCD3 g expnum 82530163 exptime 95.238 propid NOTBASS seeing 1.42 MJD 58253.440 object 29491 
    90prime/CP/V2.3/CP20180514/ksb_180515_103318_ooi_g_ls9.fits.fz
  ksb_170405_114733_ooi_r_ls9-CCD3 r expnum 78480189 exptime 63.747 propid BASS seeing 1.26 MJD 57848.491 object 29491 
    90prime/CP/V2.3/CP20170404/ksb_170405_114733_ooi_r_ls9.fits.fz
  ksb_160707_095124_ooi_g_ls9-CCD4 g expnum 75760101 exptime 172.3 propid BASS seeing 2.10 MJD 57576.411 object 29492 
    90prime/CP/V2.3/CP20160706/ksb_160707_095124_ooi_g_ls9.fits.fz
  ksb_160706_103724_ooi_g_ls9-CCD4 g expnum 75750128 exptime 172.5 propid BASS seeing 1.70 MJD 57575.443 object 29492 
    90prime/CP/V2.3/CP20160705/ksb_160706_103724_ooi_g_ls9.fits.fz
  ksb_160712_070859_ooi_r_ls9-CCD4 r expnum 75810090 exptime 98.1 propid BASS seeing 1.64 MJD 57581.298 object 29492 
    90prime/CP/V2.3/CP20160711/ksb_160712_070859_ooi_r_ls9.fits.fz
  ksb_170624_065014_ooi_r_ls9-CCD1 r expnum 79280084 exptime 83.639 propid BASS seeing 1.20 MJD 57928.285 object 29493 
    90prime/CP/V2.3/CP20170623/ksb_170624_065014_ooi_r_ls9.fits.fz
  ksb_170619_080813_ooi_g_ls9-CCD1 g expnum 79230114 exptime 241.242 propid BASS seeing 2.45 MJD 57923.339 object 29493 
    90prime/CP/V2.3/CP20170618/ksb_170619_080813_ooi_g_ls9.fits.fz
Faked up EXPNUM 82530163
Faked up EXPNUM 82530163
Faked up EXPNUM 82530163
90prime get_fwhm: self.fwhm = 3.13
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3467 3620 and amp range 2016 4031 and image y 933 1086 and amp range 0 2047
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp -0.0012233759 -> scaling image by 0.9988738637196966
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75760101
Faked up EXPNUM 75760101
Faked up EXPNUM 75760101
90prime get_fwhm: self.fwhm = 4.63
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1282 1435 and amp range 0 2015 and image y 2893 3046 and amp range 2048 4095
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp 0.009255477 -> scaling image by 1.0085610475070432
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79230114
Faked up EXPNUM 79230114
Faked up EXPNUM 79230114
90prime get_fwhm: self.fwhm = 5.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1427 1581 and amp range 0 2015 and image y 3416 3569 and amp range 2048 4095
Range in image: x 0 155 , y 0 154 (with image size 155 x 154)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Faked up EXPNUM 79280084
Faked up EXPNUM 79280084
Faked up EXPNUM 79280084
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Found overlap: image x 1428 1583 and amp range 0 2015 and image y 3405 3559 and amp range 2048 4095
Range in image: x 0 156 , y 0 155 (with image size 156 x 155)
dzp -0.041613504 -> scaling image by 0.9623977484321999
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75810090
Faked up EXPNUM 75810090
Faked up EXPNUM 75810090
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1270 1423 and amp range 0 2015 and image y 2904 3057 and amp range 2048 4095
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp 0.004205519 -> scaling image by 1.0038809374310762
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75750128
Faked up EXPNUM 75750128
Faked up EXPNUM 75750128
90prime get_fwhm: self.fwhm = 3.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1275 1428 and amp range 0 2015 and image y 2897 3050 and amp range 2048 4095
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp 0.009255477 -> scaling image by 1.0085610475070432
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3508 3774 and amp range 2006 4053 and image y 3948 4072 and amp range 2040 4078
Range in image: x 0 267 , y 0 125 (with image size 267 x 125)
dzp -0.0026360443 -> scaling image by 0.99757505842151
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 774 1043 and amp range 0 2005 and image y 2546 2819 and amp range 2040 4078
Range in image: x 0 270 , y 0 274 (with image size 270 x 274)
dzp 0.01523814 -> scaling image by 1.014133796220052
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3480 3746 and amp range 2006 4053 and image y 299 569 and amp range 0 2039
Range in image: x 0 267 , y 0 271 (with image size 267 x 271)
dzp 0.0061123776 -> scaling image by 1.005645584425507
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 2.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1931 2202 and amp range 0 2047 and image y 2724 2992 and amp range 2022 4060
Range in image: x 0 117 , y 0 269 (with image size 272 x 269)
dzp 0.0033053984 -> scaling image by 1.0030490232713904
Found overlap: image x 1931 2202 and amp range 2048 4095 and image y 2724 2992 and amp range 2022 4060
Range in image: x 117 272 , y 0 269 (with image size 272 x 269)
dzp -0.0028835079 -> scaling image by 0.9973477146455455
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78480189
Faked up EXPNUM 78480189
Faked up EXPNUM 78480189
90prime get_fwhm: self.fwhm = 2.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3445 3598 and amp range 2016 4031 and image y 935 1087 and amp range 0 2047
Range in image: x 0 154 , y 0 153 (with image size 154 x 153)
dzp -0.0023383768 -> scaling image by 0.9978485929508539
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 8.78 s, CPU: 1.75 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.179956 MB
Stage tims finished: 2020-08-05T21:38:27.680675
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.798 s worker CPU, 39.376 s worker Wall, Wall: 8.777 s, Cores in use: 0.86, Total efficiency (on 32 cores): 2.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T21:38:27.778890
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01380.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01277.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/reference-custom-277804p52074.fits
Stage refs : Wall: 13.65 s, CPU: 5.44 s, VmPeak: 1020 MB, VmSize: 1015 MB, VmRSS: 236 MB, VmData: 265 MB, maxrss: 0.241176 MB
Stage refs finished: 2020-08-05T21:38:41.431153
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 13.655 s, Cores in use: 0.40, Total efficiency (on 32 cores): 1.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T21:38:41.455838
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outlier-mask-custom-277804p52074.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outliers-pre-custom-277804p52074.jpg
Image ksb_170619_080813_ooi_g_ls9-CCD1 g : masking 194 positive outlier pixels and 0 negative outlier pixels
Image ksb_160712_070859_ooi_r_ls9-CCD4 r : masking 69 positive outlier pixels and 0 negative outlier pixels
Image k4m_160525_094208_ooi_zd_ls9-CCD3 z : masking 2820 positive outlier pixels and 0 negative outlier pixels
Image k4m_170929_053825_ooi_zd_ls9-CCD1 z : masking 337 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outlier-mask-custom-277804p52074.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outliers-post-custom-277804p52074.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outliers-masked-pos-custom-277804p52074.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/outliers-masked-neg-custom-277804p52074.jpg
Stage outliers : Wall: 2.54 s, CPU: 1.34 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.25878 MB
Stage outliers finished: 2020-08-05T21:38:43.991748
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage outliers : 1.133 s worker CPU, 1.769 s worker Wall, Wall: 2.538 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.0 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T21:38:44.022603
Stage halos : Wall: 1.06 s, CPU: 1.05 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.259064 MB
Stage halos finished: 2020-08-05T21:38:45.084877
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.065 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T21:38:45.197047
PSF sigmas in coadd pixels: ['2.30', '3.41', '2.76', '3.98']
Using average PSF sigma 3.113091088063833
Gaussian PSF norm 0.09061565620597539 vs pixelized 0.072828814
average tim pixel scale / coadd scale: 1.729629463507289
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.05', '2.66', '1.95']
Using average PSF sigma 2.2197860041158166
Gaussian PSF norm 0.12708197603319962 vs pixelized 0.11260041
average tim pixel scale / coadd scale: 1.7291726944399357
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.90', '1.20', '1.41', '1.78']
Using average PSF sigma 1.5728350435456226
Gaussian PSF norm 0.17935434038775952 vs pixelized 0.15570295
average tim pixel scale / coadd scale: 0.9909269083575665
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.21 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 254 MB, VmData: 280 MB, maxrss: 0.260536 MB
Stage fit_on_coadds finished: 2020-08-05T21:38:45.417776
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.265 s worker CPU, 0.265 s worker Wall, Wall: 0.223 s, Cores in use: 2.16, Total efficiency (on 32 cores): 6.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T21:38:45.431384
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 53 potential peaks
Of 53 potential peaks: 15 in veto map, 6 cut by saddle test, 0 cut by aper test, 32 kept
SED z : 32 new peaks
Found 49 potential peaks
Of 49 potential peaks: 45 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 35 potential peaks
Of 35 potential peaks: 33 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 69 potential peaks
Of 69 potential peaks: 59 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 84 potential peaks
Of 84 potential peaks: 72 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 37 new sources
Median coadd sky for g : 0.0003630954
Median coadd sky for r : 0.0005244281
Median coadd sky for z : -3.450283e-05
Stage srcs : Wall: 1.70 s, CPU: 1.63 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 255 MB, VmData: 280 MB, maxrss: 0.261036 MB
Stage srcs finished: 2020-08-05T21:38:47.127568
Resources for stage srcs : 0.152 s worker CPU, 0.152 s worker Wall, Wall: 1.699 s, Cores in use: 1.05, Total efficiency (on 32 cores): 3.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T21:38:47.144159
Blob 1 of 11, id: 7, sources: 34, size: 263x232, npix 37421, brick X: 0,263, Y: 31,263, one pixel: 31 31
Blob 2 of 11, id: 5, sources: 2, size: 55x40, npix 1473, brick X: 124,179, Y: 9,49, one pixel: 139 9
Blob 3 of 11, id: 9, sources: 1, size: 29x46, npix 1003, brick X: 234,263, Y: 73,119, one pixel: 251 73
Blob 4 of 11, id: 3, sources: 2, size: 31x38, npix 567, brick X: 205,236, Y: 3,41, one pixel: 216 3
Blob 5 of 11, id: 2, sources: 1, size: 27x24, npix 455, brick X: 235,262, Y: 0,24, one pixel: 243 0
Blob 6 of 11, id: 1, sources: 1, size: 29x21, npix 419, brick X: 46,75, Y: 0,21, one pixel: 51 0
Blob 7 of 11, id: 0, sources: 1, size: 25x20, npix 349, brick X: 20,45, Y: 0,20, one pixel: 27 0
Blob 8 of 11, id: 4, sources: 1, size: 25x22, npix 336, brick X: 92,117, Y: 9,31, one pixel: 102 9
Blob 9 of 11, id: 6, sources: 1, size: 20x19, npix 227, brick X: 13,33, Y: 16,35, one pixel: 21 16
Blob 10 of 11, id: 10, sources: 1, size: 20x19, npix 217, brick X: 84,104, Y: 242,261, one pixel: 94 242
Blob 11 of 11, id: 8, sources: 1, size: 15x20, npix 189, brick X: 0,15, Y: 47,67, one pixel: 5 47
Blob 8 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 87 MB, VmData: 139 MB, maxrss: 0.089356 MB
Blob 10 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 138 MB, maxrss: 0.087588 MB
Blob 9 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.0941 MB
Blob 6 finished, total: Wall: 0.37 s, CPU: 0.36 s, VmPeak: 814 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151144 MB
Blob 4 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.1507 MB
Blob 11 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096556 MB
Blob 7 finished, total: Wall: 0.58 s, CPU: 0.57 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094288 MB
Blob 5 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15134 MB
Blob 2 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151468 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.41 s, CPU: 1.41 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095128 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.54824, ee1=-0.170959, ee2=-0.164114
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.78250, 52.07950), pm (-0.2, -13.2), parallax 0.194 with NanoMaggies: g=18.7, r=18.1, z=17.8
Reset brightness to NanoMaggies: g=18.7, r=18.1, z=17.8
Measuring 15 iterative sources
Blob 1 finished, total: Wall: 29.61 s, CPU: 29.61 s, VmPeak: 715 MB, VmSize: 693 MB, VmRSS: 126 MB, VmData: 165 MB, maxrss: 0.146916 MB
Old catalog: 50
New catalog: 57
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/blobs-custom-277804p52074.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/metrics/cus/all-models-custom-277804p52074.fits
Stage fitblobs : Wall: 31.06 s, CPU: 1.43 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 256 MB, VmData: 282 MB, maxrss: 0.262192 MB
Stage fitblobs finished: 2020-08-05T21:39:18.208155
Resources for stage fitblobs : 35.203 s worker CPU, 35.984 s worker Wall, Wall: 31.066 s, Cores in use: 1.18, Total efficiency (on 32 cores): 3.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T21:39:18.225456
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-resid.jpg
Stage coadds : Wall: 3.66 s, CPU: 1.34 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 256 MB, VmData: 282 MB, maxrss: 0.262516 MB
Stage coadds finished: 2020-08-05T21:39:21.887157
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 25.171 s worker CPU, 43.870 s worker Wall, Wall: 3.664 s, Cores in use: 7.24, Total efficiency (on 32 cores): 22.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T21:39:21.904267
Cut to 2 unWISE tiles
Reading WISE tile 2765p514 band 1
Reading WISE tile 2765p514 band 2
Reading WISE tile 2765p514 band 3
Reading WISE tile 2765p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 4
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 1
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.18 s, CPU: 0.18 s, VmPeak: 814 MB, VmSize: 807 MB, VmRSS: 151 MB, VmData: 179 MB, maxrss: 0.186984 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 804 MB, VmSize: 802 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.204184 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 815 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.202892 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 808 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.20308 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.72 s, CPU: 1.22 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 257 MB, VmData: 282 MB, maxrss: 0.263028 MB
Stage wise_forced finished: 2020-08-05T21:39:27.626903
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 6.574 s worker CPU, 13.465 s worker Wall, Wall: 5.725 s, Cores in use: 1.36, Total efficiency (on 32 cores): 4.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T21:39:27.644447
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/tractor-i/cus/tractor-custom-277804p52074.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/tractor/cus/tractor-custom-277804p52074.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/tractor/cus/brick-custom-277804p52074.sha256sum
Stage writecat : Wall: 1.08 s, CPU: 0.87 s, VmPeak: 1157 MB, VmSize: 1029 MB, VmRSS: 259 MB, VmData: 282 MB, maxrss: 0.395908 MB
Stage writecat finished: 2020-08-05T21:39:28.720353
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.078 s, Cores in use: 0.81, Total efficiency (on 32 cores): 2.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2406170/PGC2406170-largegalaxy-writecat.p
All done: 74.303 s worker CPU, 134.889 s worker Wall, Wall: 69.838 s, Cores in use: 1.30, Total efficiency (on 32 cores): 4.1 %
Finished galaxy PGC2406170 in 1.221 minutes.
Started working on galaxy PGC2406170 at Fri Aug  7 09:24:55 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.80415628561155 52.07476853488881 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T09:24:56.393372
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.80415628561155', '52.07476853488881', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.80415628561155 52.07476853488881 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 277.80415628561155 52.07476853488881
Starting process 21815 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 21816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21817 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21819 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 21820 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 21821 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 21822 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 21823 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 21824 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 21825 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 21826 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21827 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21828 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 21829 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 21830 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T09:24:56.838123
Keeping 11 CCDs:
  k4m_160525_094208_ooi_zd_ls9-CCD3 z expnum 91475 exptime 104.105 propid 2016A-0453 seeing 1.17 MJD 57533.404 object MzLS_658217_z 
    mosaic/CP/V4.3/CP20160524/k4m_160525_094208_ooi_zd_ls9.fits.fz
  k4m_160527_095501_ooi_zd_ls9-CCD4 z expnum 91889 exptime 80.105 propid 2016A-0453 seeing 0.74 MJD 57535.413 object MzLS_657444_z 
    mosaic/CP/V4.3/CP20160526/k4m_160527_095501_ooi_zd_ls9.fits.fz
  k4m_170901_070845_ooi_zd_ls9-CCD3 z expnum 137640 exptime 136.105 propid 2016A-0453 seeing 0.87 MJD 57997.298 object MzLS_658988_z 
    mosaic/CP/V4.3/CP20170831/k4m_170901_070845_ooi_zd_ls9.fits.fz
  k4m_170929_053825_ooi_zd_ls9-CCD1 z expnum 141316 exptime 132.102 propid 2016A-0453 seeing 1.09 MJD 58025.235 object MzLS_658218_z 
    mosaic/CP/V4.3/CP20170928/k4m_170929_053825_ooi_zd_ls9.fits.fz
  ksb_180515_103318_ooi_g_ls9-CCD3 g expnum 82530163 exptime 95.238 propid NOTBASS seeing 1.42 MJD 58253.440 object 29491 
    90prime/CP/V2.3/CP20180514/ksb_180515_103318_ooi_g_ls9.fits.fz
  ksb_170405_114733_ooi_r_ls9-CCD3 r expnum 78480189 exptime 63.747 propid BASS seeing 1.26 MJD 57848.491 object 29491 
    90prime/CP/V2.3/CP20170404/ksb_170405_114733_ooi_r_ls9.fits.fz
  ksb_160707_095124_ooi_g_ls9-CCD4 g expnum 75760101 exptime 172.3 propid BASS seeing 2.10 MJD 57576.411 object 29492 
    90prime/CP/V2.3/CP20160706/ksb_160707_095124_ooi_g_ls9.fits.fz
  ksb_160706_103724_ooi_g_ls9-CCD4 g expnum 75750128 exptime 172.5 propid BASS seeing 1.70 MJD 57575.443 object 29492 
    90prime/CP/V2.3/CP20160705/ksb_160706_103724_ooi_g_ls9.fits.fz
  ksb_160712_070859_ooi_r_ls9-CCD4 r expnum 75810090 exptime 98.1 propid BASS seeing 1.64 MJD 57581.298 object 29492 
    90prime/CP/V2.3/CP20160711/ksb_160712_070859_ooi_r_ls9.fits.fz
  ksb_170624_065014_ooi_r_ls9-CCD1 r expnum 79280084 exptime 83.639 propid BASS seeing 1.20 MJD 57928.285 object 29493 
    90prime/CP/V2.3/CP20170623/ksb_170624_065014_ooi_r_ls9.fits.fz
  ksb_170619_080813_ooi_g_ls9-CCD1 g expnum 79230114 exptime 241.242 propid BASS seeing 2.45 MJD 57923.339 object 29493 
    90prime/CP/V2.3/CP20170618/ksb_170619_080813_ooi_g_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 4.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3478 3744 and amp range 2006 4053 and image y 297 567 and amp range 0 2039
Range in image: x 0 267 , y 0 271 (with image size 267 x 271)
dzp 0.0061123776 -> scaling image by 1.005645584425507
mosaic get_fwhm: self.fwhm = 3.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 772 1041 and amp range 0 2005 and image y 2544 2817 and amp range 2040 4078
Range in image: x 0 270 , y 0 274 (with image size 270 x 274)
dzp 0.01523814 -> scaling image by 1.014133796220052
mosaic get_fwhm: self.fwhm = 4.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3506 3773 and amp range 2006 4053 and image y 3946 4072 and amp range 2040 4078
Range in image: x 0 268 , y 0 127 (with image size 268 x 127)
dzp -0.0026360443 -> scaling image by 0.99757505842151
mosaic get_fwhm: self.fwhm = 2.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1929 2200 and amp range 0 2047 and image y 2722 2990 and amp range 2022 4060
Range in image: x 0 119 , y 0 269 (with image size 272 x 269)
dzp 0.0033053984 -> scaling image by 1.0030490232713904
Found overlap: image x 1929 2200 and amp range 2048 4095 and image y 2722 2990 and amp range 2022 4060
Range in image: x 119 272 , y 0 269 (with image size 272 x 269)
dzp -0.0028835079 -> scaling image by 0.9973477146455455
Faked up EXPNUM 79230114
Faked up EXPNUM 79230114
Faked up EXPNUM 79230114
90prime get_fwhm: self.fwhm = 5.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1428 1582 and amp range 0 2015 and image y 3417 3570 and amp range 2048 4095
Range in image: x 0 155 , y 0 154 (with image size 155 x 154)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Faked up EXPNUM 82530163
Faked up EXPNUM 82530163
Faked up EXPNUM 82530163
90prime get_fwhm: self.fwhm = 3.13
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3468 3621 and amp range 2016 4031 and image y 934 1087 and amp range 0 2047
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp -0.0012233759 -> scaling image by 0.9988738637196966
Faked up EXPNUM 79280084
Faked up EXPNUM 79280084
Faked up EXPNUM 79280084
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1429 1584 and amp range 0 2015 and image y 3406 3560 and amp range 2048 4095
Range in image: x 0 156 , y 0 155 (with image size 156 x 155)
dzp -0.041613504 -> scaling image by 0.9623977484321999
Faked up EXPNUM 78480189
Faked up EXPNUM 78480189
Faked up EXPNUM 78480189
90prime get_fwhm: self.fwhm = 2.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3446 3599 and amp range 2016 4031 and image y 935 1088 and amp range 0 2047
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp -0.0023383768 -> scaling image by 0.9978485929508539
Faked up EXPNUM 75810090
Faked up EXPNUM 75810090
Faked up EXPNUM 75810090
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1271 1424 and amp range 0 2015 and image y 2905 3058 and amp range 2048 4095
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp 0.004205519 -> scaling image by 1.0038809374310762
Faked up EXPNUM 75760101
Faked up EXPNUM 75760101
Faked up EXPNUM 75760101
90prime get_fwhm: self.fwhm = 4.63
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1283 1436 and amp range 0 2015 and image y 2893 3047 and amp range 2048 4095
Range in image: x 0 154 , y 0 155 (with image size 154 x 155)
dzp 0.009255477 -> scaling image by 1.0085610475070432
Faked up EXPNUM 75750128
Faked up EXPNUM 75750128
Faked up EXPNUM 75750128
90prime get_fwhm: self.fwhm = 3.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1276 1429 and amp range 0 2015 and image y 2898 3051 and amp range 2048 4095
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp 0.009255477 -> scaling image by 1.0085610475070432
Stage tims : Wall: 89.87 s, CPU: 0.92 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178152 MB
Stage tims finished: 2020-08-07T09:26:26.710207
Resources for stage tims : 5.681 s worker CPU, 308.332 s worker Wall, Wall: 89.873 s, Cores in use: 0.07, Total efficiency (on 16 cores): 0.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T09:26:26.814103
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01380.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01277.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/reference-custom-277804p52074.fits
Stage refs : Wall: 6.80 s, CPU: 4.52 s, VmPeak: 1014 MB, VmSize: 1009 MB, VmRSS: 234 MB, VmData: 265 MB, maxrss: 0.23944 MB
Stage refs finished: 2020-08-07T09:26:33.617084
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.804 s, Cores in use: 0.66, Total efficiency (on 16 cores): 4.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T09:26:33.685655
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outlier-mask-custom-277804p52074.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outliers-pre-custom-277804p52074.jpg
Image ksb_170619_080813_ooi_g_ls9-CCD1 g : masking 197 positive outlier pixels and 0 negative outlier pixels
Image ksb_160712_070859_ooi_r_ls9-CCD4 r : masking 76 positive outlier pixels and 0 negative outlier pixels
Image k4m_160525_094208_ooi_zd_ls9-CCD3 z : masking 2753 positive outlier pixels and 0 negative outlier pixels
Image k4m_170929_053825_ooi_zd_ls9-CCD1 z : masking 540 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outlier-mask-custom-277804p52074.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outliers-post-custom-277804p52074.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outliers-masked-pos-custom-277804p52074.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outliers-masked-neg-custom-277804p52074.jpg
Stage outliers : Wall: 0.96 s, CPU: 0.67 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 249 MB, VmData: 277 MB, maxrss: 0.254672 MB
Stage outliers finished: 2020-08-07T09:26:34.644684
Resources for stage outliers : 0.943 s worker CPU, 1.080 s worker Wall, Wall: 0.961 s, Cores in use: 1.68, Total efficiency (on 16 cores): 10.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T09:26:34.705462
Stage halos : Wall: 0.30 s, CPU: 0.29 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 249 MB, VmData: 277 MB, maxrss: 0.254792 MB
Stage halos finished: 2020-08-07T09:26:35.009375
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.305 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-07T09:26:35.062001
PSF sigmas in coadd pixels: ['2.30', '3.41', '2.76', '3.98']
Using average PSF sigma 3.113091088063833
Gaussian PSF norm 0.09061565620597539 vs pixelized 0.072828166
average tim pixel scale / coadd scale: 1.729629463507289
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.05', '2.66', '1.95']
Using average PSF sigma 2.2197860041158166
Gaussian PSF norm 0.12708197603319962 vs pixelized 0.112597294
average tim pixel scale / coadd scale: 1.7291726944399357
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.90', '1.20', '1.41', '1.78']
Using average PSF sigma 1.5728350435456226
Gaussian PSF norm 0.17935434038775952 vs pixelized 0.15570548
average tim pixel scale / coadd scale: 0.9909269083575665
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.17 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 251 MB, VmData: 278 MB, maxrss: 0.257192 MB
Stage fit_on_coadds finished: 2020-08-07T09:26:35.292814
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.206 s worker CPU, 0.206 s worker Wall, Wall: 0.232 s, Cores in use: 1.61, Total efficiency (on 16 cores): 10.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T09:26:35.322753
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 51 potential peaks
Of 51 potential peaks: 13 in veto map, 6 cut by saddle test, 0 cut by aper test, 32 kept
SED z : 32 new peaks
Found 49 potential peaks
Of 49 potential peaks: 46 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 35 potential peaks
Of 35 potential peaks: 32 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 67 potential peaks
Of 67 potential peaks: 59 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 83 potential peaks
Of 83 potential peaks: 72 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 36 new sources
Median coadd sky for g : 0.00035914392
Median coadd sky for r : 0.0005413625
Median coadd sky for z : -7.4141615e-05
Stage srcs : Wall: 0.56 s, CPU: 0.53 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.257764 MB
Stage srcs finished: 2020-08-07T09:26:35.882372
Resources for stage srcs : 0.081 s worker CPU, 0.081 s worker Wall, Wall: 0.561 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T09:26:35.915029
Blob 1 of 9, id: 6, sources: 34, size: 263x230, npix 37334, brick X: 0,263, Y: 33,263, one pixel: 29 33
Blob 2 of 9, id: 4, sources: 2, size: 56x40, npix 1476, brick X: 122,178, Y: 11,51, one pixel: 137 11
Blob 3 of 9, id: 7, sources: 1, size: 31x46, npix 1090, brick X: 232,263, Y: 74,120, one pixel: 252 74
Blob 4 of 9, id: 0, sources: 2, size: 55x22, npix 826, brick X: 19,74, Y: 0,22, one pixel: 27 0
Blob 5 of 9, id: 2, sources: 2, size: 31x38, npix 591, brick X: 203,234, Y: 5,43, one pixel: 214 5
Blob 6 of 9, id: 1, sources: 1, size: 27x26, npix 465, brick X: 233,260, Y: 0,26, one pixel: 244 0
Blob 7 of 9, id: 3, sources: 1, size: 25x22, npix 336, brick X: 91,116, Y: 11,33, one pixel: 100 11
Blob 8 of 9, id: 5, sources: 1, size: 20x19, npix 218, brick X: 11,31, Y: 18,37, one pixel: 20 18
Blob 9 of 9, id: 8, sources: 1, size: 19x19, npix 208, brick X: 83,102, Y: 244,263, one pixel: 92 244
Blob 9 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 89 MB, VmData: 139 MB, maxrss: 0.091016 MB
Blob 8 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 815 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147656 MB
Blob 5 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147028 MB
Blob 7 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.146964 MB
Blob 6 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093624 MB
Blob 4 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147076 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146804 MB
Blob 3 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 788 MB, VmSize: 712 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.133144 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.59552, ee1=-0.170562, ee2=-0.174581
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.78250, 52.07950), pm (-0.2, -13.2), parallax 0.194 with NanoMaggies: g=18.7, r=18.1, z=17.8
Reset brightness to NanoMaggies: g=18.7, r=18.1, z=17.8
Measuring 11 iterative sources
Blob 1 finished, total: Wall: 24.02 s, CPU: 24.02 s, VmPeak: 812 MB, VmSize: 739 MB, VmRSS: 163 MB, VmData: 194 MB, maxrss: 0.170404 MB
Old catalog: 49
New catalog: 53
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/blobs-custom-277804p52074.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/all-models-custom-277804p52074.fits
Stage fitblobs : Wall: 24.50 s, CPU: 0.37 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.258836 MB
Stage fitblobs finished: 2020-08-07T09:27:00.417872
Resources for stage fitblobs : 29.212 s worker CPU, 29.259 s worker Wall, Wall: 24.504 s, Cores in use: 1.21, Total efficiency (on 16 cores): 7.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T09:27:00.462827
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-resid.jpg
Stage coadds : Wall: 2.37 s, CPU: 0.62 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.259204 MB
Stage coadds finished: 2020-08-07T09:27:02.832471
Resources for stage coadds : 8.534 s worker CPU, 9.046 s worker Wall, Wall: 2.371 s, Cores in use: 3.86, Total efficiency (on 16 cores): 24.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T09:27:02.859241
Cut to 2 unWISE tiles
Reading WISE tile 2765p514 band 1
Reading WISE tile 2765p514 band 2
Reading WISE tile 2765p514 band 3
Reading WISE tile 2765p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 811 MB, VmSize: 793 MB, VmRSS: 139 MB, VmData: 172 MB, maxrss: 0.199288 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.15 s, CPU: 0.15 s, VmPeak: 805 MB, VmSize: 805 MB, VmRSS: 151 MB, VmData: 179 MB, maxrss: 0.188536 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 1
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 813 MB, VmSize: 796 MB, VmRSS: 140 MB, VmData: 174 MB, maxrss: 0.200124 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 814 MB, VmSize: 812 MB, VmRSS: 159 MB, VmData: 183 MB, maxrss: 0.223192 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 40.95 s, CPU: 0.59 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 254 MB, VmData: 280 MB, maxrss: 0.259716 MB
Stage wise_forced finished: 2020-08-07T09:27:43.808115
Resources for stage wise_forced : 5.895 s worker CPU, 61.528 s worker Wall, Wall: 40.950 s, Cores in use: 0.16, Total efficiency (on 16 cores): 1.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T09:27:43.838962
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/tractor-i/cus/tractor-custom-277804p52074.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/tractor/cus/tractor-custom-277804p52074.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/tractor/cus/brick-custom-277804p52074.sha256sum
Stage writecat : Wall: 1.43 s, CPU: 0.61 s, VmPeak: 1150 MB, VmSize: 1022 MB, VmRSS: 255 MB, VmData: 280 MB, maxrss: 0.3926 MB
Stage writecat finished: 2020-08-07T09:27:45.270833
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.433 s, Cores in use: 0.43, Total efficiency (on 16 cores): 2.7 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-writecat.p
All done: 50.556 s worker CPU, 409.537 s worker Wall, Wall: 168.461 s, Cores in use: 0.36, Total efficiency (on 16 cores): 2.2 %
Finished galaxy PGC2406170 in 2.885 minutes.
Started working on galaxy PGC2406170 at Sat Aug  8 09:46:09 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.80419563453455 52.074748477132246 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-08T09:46:10.172502
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.80419563453455', '52.074748477132246', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.80419563453455 52.074748477132246 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 277.80419563453455 52.074748477132246
Starting process 50839 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 50840 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 50841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 50842 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 50843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 50844 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 50845 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 50846 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 50847 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 50848 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 50849 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 50850 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 50851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 50852 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 50853 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 50854 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 50855 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 50856 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 50857 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 50858 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 50859 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 50860 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 50861 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 50862 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 50863 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 50864 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 50865 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 50866 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 50867 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 50868 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 50869 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 50871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-08T09:46:10.532638
Keeping 11 CCDs:
  k4m_160525_094208_ooi_zd_ls9-CCD3 z expnum 91475 exptime 104.105 propid 2016A-0453 seeing 1.17 MJD 57533.404 object MzLS_658217_z 
    mosaic/CP/V4.3/CP20160524/k4m_160525_094208_ooi_zd_ls9.fits.fz
  k4m_160527_095501_ooi_zd_ls9-CCD4 z expnum 91889 exptime 80.105 propid 2016A-0453 seeing 0.74 MJD 57535.413 object MzLS_657444_z 
    mosaic/CP/V4.3/CP20160526/k4m_160527_095501_ooi_zd_ls9.fits.fz
  k4m_170901_070845_ooi_zd_ls9-CCD3 z expnum 137640 exptime 136.105 propid 2016A-0453 seeing 0.87 MJD 57997.298 object MzLS_658988_z 
    mosaic/CP/V4.3/CP20170831/k4m_170901_070845_ooi_zd_ls9.fits.fz
  k4m_170929_053825_ooi_zd_ls9-CCD1 z expnum 141316 exptime 132.102 propid 2016A-0453 seeing 1.09 MJD 58025.235 object MzLS_658218_z 
    mosaic/CP/V4.3/CP20170928/k4m_170929_053825_ooi_zd_ls9.fits.fz
  ksb_180515_103318_ooi_g_ls9-CCD3 g expnum 82530163 exptime 95.238 propid NOTBASS seeing 1.42 MJD 58253.440 object 29491 
    90prime/CP/V2.3/CP20180514/ksb_180515_103318_ooi_g_ls9.fits.fz
  ksb_170405_114733_ooi_r_ls9-CCD3 r expnum 78480189 exptime 63.747 propid BASS seeing 1.26 MJD 57848.491 object 29491 
    90prime/CP/V2.3/CP20170404/ksb_170405_114733_ooi_r_ls9.fits.fz
  ksb_160707_095124_ooi_g_ls9-CCD4 g expnum 75760101 exptime 172.3 propid BASS seeing 2.10 MJD 57576.411 object 29492 
    90prime/CP/V2.3/CP20160706/ksb_160707_095124_ooi_g_ls9.fits.fz
  ksb_160706_103724_ooi_g_ls9-CCD4 g expnum 75750128 exptime 172.5 propid BASS seeing 1.70 MJD 57575.443 object 29492 
    90prime/CP/V2.3/CP20160705/ksb_160706_103724_ooi_g_ls9.fits.fz
  ksb_160712_070859_ooi_r_ls9-CCD4 r expnum 75810090 exptime 98.1 propid BASS seeing 1.64 MJD 57581.298 object 29492 
    90prime/CP/V2.3/CP20160711/ksb_160712_070859_ooi_r_ls9.fits.fz
  ksb_170624_065014_ooi_r_ls9-CCD1 r expnum 79280084 exptime 83.639 propid BASS seeing 1.20 MJD 57928.285 object 29493 
    90prime/CP/V2.3/CP20170623/ksb_170624_065014_ooi_r_ls9.fits.fz
  ksb_170619_080813_ooi_g_ls9-CCD1 g expnum 79230114 exptime 241.242 propid BASS seeing 2.45 MJD 57923.339 object 29493 
    90prime/CP/V2.3/CP20170618/ksb_170619_080813_ooi_g_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 4.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3506 3772 and amp range 2006 4053 and image y 3946 4072 and amp range 2040 4078
Range in image: x 0 267 , y 0 127 (with image size 267 x 127)
dzp -0.0026360443 -> scaling image by 0.99757505842151
mosaic get_fwhm: self.fwhm = 3.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 771 1041 and amp range 0 2005 and image y 2544 2818 and amp range 2040 4078
Range in image: x 0 271 , y 0 275 (with image size 271 x 275)
dzp 0.01523814 -> scaling image by 1.014133796220052
mosaic get_fwhm: self.fwhm = 2.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1929 2199 and amp range 0 2047 and image y 2722 2990 and amp range 2022 4060
Range in image: x 0 119 , y 0 269 (with image size 271 x 269)
dzp 0.0033053984 -> scaling image by 1.0030490232713904
Found overlap: image x 1929 2199 and amp range 2048 4095 and image y 2722 2990 and amp range 2022 4060
Range in image: x 119 271 , y 0 269 (with image size 271 x 269)
dzp -0.0028835079 -> scaling image by 0.9973477146455455
Faked up EXPNUM 75750128
Faked up EXPNUM 75750128
Faked up EXPNUM 75750128
90prime get_fwhm: self.fwhm = 3.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1276 1429 and amp range 0 2015 and image y 2897 3051 and amp range 2048 4095
Range in image: x 0 154 , y 0 155 (with image size 154 x 155)
dzp 0.009255477 -> scaling image by 1.0085610475070432
Faked up EXPNUM 75810090
Faked up EXPNUM 75810090
Faked up EXPNUM 75810090
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1272 1424 and amp range 0 2015 and image y 2905 3058 and amp range 2048 4095
Range in image: x 0 153 , y 0 154 (with image size 153 x 154)
dzp 0.004205519 -> scaling image by 1.0038809374310762
Faked up EXPNUM 78480189
Faked up EXPNUM 78480189
Faked up EXPNUM 78480189
90prime get_fwhm: self.fwhm = 2.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3447 3599 and amp range 2016 4031 and image y 935 1088 and amp range 0 2047
Range in image: x 0 153 , y 0 154 (with image size 153 x 154)
dzp -0.0023383768 -> scaling image by 0.9978485929508539
Faked up EXPNUM 79230114
Faked up EXPNUM 79230114
Faked up EXPNUM 79230114
90prime get_fwhm: self.fwhm = 5.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1428 1582 and amp range 0 2015 and image y 3416 3570 and amp range 2048 4095
Range in image: x 0 155 , y 0 155 (with image size 155 x 155)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Faked up EXPNUM 82530163
Faked up EXPNUM 82530163
Faked up EXPNUM 82530163
90prime get_fwhm: self.fwhm = 3.13
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3468 3621 and amp range 2016 4031 and image y 933 1086 and amp range 0 2047
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp -0.0012233759 -> scaling image by 0.9988738637196966
Faked up EXPNUM 79280084
Faked up EXPNUM 79280084
Faked up EXPNUM 79280084
90prime get_fwhm: self.fwhm = 2.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1429 1584 and amp range 0 2015 and image y 3406 3560 and amp range 2048 4095
Range in image: x 0 156 , y 0 155 (with image size 156 x 155)
dzp -0.041613504 -> scaling image by 0.9623977484321999
Faked up EXPNUM 75760101
Faked up EXPNUM 75760101
Faked up EXPNUM 75760101
90prime get_fwhm: self.fwhm = 4.63
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1283 1436 and amp range 0 2015 and image y 2893 3046 and amp range 2048 4095
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp 0.009255477 -> scaling image by 1.0085610475070432
mosaic get_fwhm: self.fwhm = 4.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3478 3744 and amp range 2006 4053 and image y 297 567 and amp range 0 2039
Range in image: x 0 267 , y 0 271 (with image size 267 x 271)
dzp 0.0061123776 -> scaling image by 1.005645584425507
Stage tims : Wall: 3.97 s, CPU: 0.74 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.178828 MB
Stage tims finished: 2020-08-08T09:46:14.506419
Resources for stage tims : 5.883 s worker CPU, 30.914 s worker Wall, Wall: 3.976 s, Cores in use: 1.67, Total efficiency (on 32 cores): 5.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-08T09:46:14.605711
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01380.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01277.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/reference-custom-277804p52074.fits
Stage refs : Wall: 4.54 s, CPU: 4.36 s, VmPeak: 1014 MB, VmSize: 1009 MB, VmRSS: 234 MB, VmData: 265 MB, maxrss: 0.23984 MB
Stage refs finished: 2020-08-08T09:46:19.143903
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 4.540 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-08T09:46:19.168332
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outlier-mask-custom-277804p52074.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outliers-pre-custom-277804p52074.jpg
Image ksb_170619_080813_ooi_g_ls9-CCD1 g : masking 194 positive outlier pixels and 0 negative outlier pixels
Image ksb_160712_070859_ooi_r_ls9-CCD4 r : masking 74 positive outlier pixels and 0 negative outlier pixels
Image k4m_160525_094208_ooi_zd_ls9-CCD3 z : masking 2758 positive outlier pixels and 0 negative outlier pixels
Image k4m_170929_053825_ooi_zd_ls9-CCD1 z : masking 776 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outlier-mask-custom-277804p52074.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outliers-post-custom-277804p52074.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outliers-masked-pos-custom-277804p52074.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/outliers-masked-neg-custom-277804p52074.jpg
Stage outliers : Wall: 0.79 s, CPU: 0.53 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 249 MB, VmData: 277 MB, maxrss: 0.254488 MB
Stage outliers finished: 2020-08-08T09:46:19.961771
Resources for stage outliers : 0.999 s worker CPU, 1.346 s worker Wall, Wall: 0.796 s, Cores in use: 1.92, Total efficiency (on 32 cores): 6.0 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-08T09:46:20.033204
Stage halos : Wall: 0.16 s, CPU: 0.15 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 249 MB, VmData: 277 MB, maxrss: 0.254708 MB
Stage halos finished: 2020-08-08T09:46:20.189108
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.158 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-08T09:46:20.220776
PSF sigmas in coadd pixels: ['2.30', '3.41', '2.76', '3.98']
Using average PSF sigma 3.113091088063833
Gaussian PSF norm 0.09061565620597539 vs pixelized 0.07282827
average tim pixel scale / coadd scale: 1.729629463507289
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.05', '2.66', '1.95']
Using average PSF sigma 2.2197860041158166
Gaussian PSF norm 0.12708197603319962 vs pixelized 0.112597294
average tim pixel scale / coadd scale: 1.7291726944399357
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.90', '1.20', '1.41', '1.78']
Using average PSF sigma 1.5728350435456226
Gaussian PSF norm 0.17935434038775952 vs pixelized 0.15570727
average tim pixel scale / coadd scale: 0.9909269083575665
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 251 MB, VmData: 278 MB, maxrss: 0.256884 MB
Stage fit_on_coadds finished: 2020-08-08T09:46:20.396609
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.246 s worker CPU, 0.246 s worker Wall, Wall: 0.178 s, Cores in use: 2.33, Total efficiency (on 32 cores): 7.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-08T09:46:20.420145
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 51 potential peaks
Of 51 potential peaks: 13 in veto map, 6 cut by saddle test, 0 cut by aper test, 32 kept
SED z : 32 new peaks
Found 49 potential peaks
Of 49 potential peaks: 45 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 35 potential peaks
Of 35 potential peaks: 33 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 67 potential peaks
Of 67 potential peaks: 57 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 83 potential peaks
Of 83 potential peaks: 71 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 36 new sources
Median coadd sky for g : 0.000365721
Median coadd sky for r : 0.00052191375
Median coadd sky for z : -9.69018e-06
Stage srcs : Wall: 0.49 s, CPU: 0.45 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.257604 MB
Stage srcs finished: 2020-08-08T09:46:20.912885
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage srcs : 0.110 s worker CPU, 0.110 s worker Wall, Wall: 0.495 s, Cores in use: 1.14, Total efficiency (on 32 cores): 3.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-08T09:46:20.927272
Blob 1 of 9, id: 6, sources: 34, size: 263x230, npix 37033, brick X: 0,263, Y: 33,263, one pixel: 30 33
Blob 2 of 9, id: 4, sources: 2, size: 55x40, npix 1472, brick X: 123,178, Y: 11,51, one pixel: 139 11
Blob 3 of 9, id: 7, sources: 1, size: 30x46, npix 1069, brick X: 233,263, Y: 75,121, one pixel: 250 75
Blob 4 of 9, id: 0, sources: 2, size: 55x23, npix 843, brick X: 19,74, Y: 0,23, one pixel: 27 0
Blob 5 of 9, id: 2, sources: 2, size: 30x37, npix 581, brick X: 204,234, Y: 6,43, one pixel: 213 6
Blob 6 of 9, id: 1, sources: 1, size: 28x25, npix 462, brick X: 233,261, Y: 1,26, one pixel: 243 1
Blob 7 of 9, id: 3, sources: 1, size: 25x22, npix 328, brick X: 91,116, Y: 11,33, one pixel: 101 11
Blob 8 of 9, id: 5, sources: 1, size: 19x20, npix 218, brick X: 12,31, Y: 18,38, one pixel: 20 18
Blob 9 of 9, id: 8, sources: 1, size: 19x18, npix 198, brick X: 83,102, Y: 245,263, one pixel: 91 245
Blob 7 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 89 MB, VmData: 140 MB, maxrss: 0.091304 MB
Blob 9 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 84 MB, VmData: 137 MB, maxrss: 0.08634 MB
Blob 8 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14712 MB
Blob 5 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14664 MB
Blob 6 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097184 MB
Blob 4 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096368 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146016 MB
Blob 3 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092532 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.73362, ee1=-0.151809, ee2=-0.139142
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.78250, 52.07950), pm (-0.2, -13.2), parallax 0.194 with NanoMaggies: g=18.7, r=18.1, z=17.8
Reset brightness to NanoMaggies: g=18.7, r=18.1, z=17.8
Measuring 9 iterative sources
Blob 1 finished, total: Wall: 22.67 s, CPU: 22.67 s, VmPeak: 811 MB, VmSize: 765 MB, VmRSS: 192 MB, VmData: 220 MB, maxrss: 0.196684 MB
Old catalog: 49
New catalog: 48
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/blobs-custom-277804p52074.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/metrics/cus/all-models-custom-277804p52074.fits
Stage fitblobs : Wall: 22.94 s, CPU: 0.26 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.2587 MB
Stage fitblobs finished: 2020-08-08T09:46:43.871705
Resources for stage fitblobs : 27.339 s worker CPU, 27.361 s worker Wall, Wall: 22.947 s, Cores in use: 1.20, Total efficiency (on 32 cores): 3.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-08T09:46:43.886566
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-resid.jpg
Stage coadds : Wall: 1.85 s, CPU: 0.45 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.259028 MB
Stage coadds finished: 2020-08-08T09:46:45.738328
Resources for stage coadds : 25.492 s worker CPU, 25.864 s worker Wall, Wall: 1.854 s, Cores in use: 13.99, Total efficiency (on 32 cores): 43.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-08T09:46:45.760842
Cut to 2 unWISE tiles
Reading WISE tile 2765p514 band 1
Reading WISE tile 2765p514 band 2
Reading WISE tile 2765p514 band 3
Reading WISE tile 2765p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2789p514 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 805 MB, VmSize: 800 MB, VmRSS: 147 MB, VmData: 179 MB, maxrss: 0.183552 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 813 MB, VmSize: 798 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.2032 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 814 MB, VmSize: 793 MB, VmRSS: 139 MB, VmData: 171 MB, maxrss: 0.198992 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2789p514/unwise-2789p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 144 MB, VmData: 176 MB, maxrss: 0.204948 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/tmp-legacysurvey-custom-277804p52074-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.92 s, CPU: 0.42 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.25954 MB
Stage wise_forced finished: 2020-08-08T09:46:48.677303
Resources for stage wise_forced : 6.374 s worker CPU, 8.169 s worker Wall, Wall: 2.919 s, Cores in use: 2.33, Total efficiency (on 32 cores): 7.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-08T09:46:48.693938
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/coadd/cus/custom-277804p52074/legacysurvey-custom-277804p52074-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/tractor-i/cus/tractor-custom-277804p52074.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/tractor/cus/tractor-custom-277804p52074.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/tractor/cus/brick-custom-277804p52074.sha256sum
Stage writecat : Wall: 0.56 s, CPU: 0.45 s, VmPeak: 1150 MB, VmSize: 1022 MB, VmRSS: 255 MB, VmData: 280 MB, maxrss: 0.392424 MB
Stage writecat finished: 2020-08-08T09:46:49.250250
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.559 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2406170/PGC2406170-largegalaxy-writecat.p
All done: 66.448 s worker CPU, 94.018 s worker Wall, Wall: 38.740 s, Cores in use: 1.93, Total efficiency (on 32 cores): 6.0 %
Finished galaxy PGC2406170 in 0.672 minutes.