Started working on galaxy PGC2310358 at Wed Aug  5 21:25:13 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 281.9937795 48.0944443 --width 315 --height 315 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T21:25:17.011803
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '281.9937795', '48.0944443', '--width', '315', '--height', '315', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 281.9937795 48.0944443 --width 315 --height 315 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 281.9937795 48.0944443
Starting process 54697 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 54698 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 54699 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 54700 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 54701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB
Starting process 54702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB
Starting process 54703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB
Starting process 54704 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 54705 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 54707 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 54708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 54706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 54709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 54710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 54712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 54711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T21:25:18.651959
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 12 CCDs:
  k4m_170906_054731_ooi_zd_ls9-CCD3 z expnum 138507 exptime 237.104 propid 2016A-0453 seeing 1.12 MJD 58002.241 object MzLS_642117_z 
    mosaic/CP/V4.3/CP20170905/k4m_170906_054731_ooi_zd_ls9.fits.fz
  k4m_160518_104944_ooi_zd_ls9-CCD4 z expnum 90025 exptime 80.105 propid 2016A-0453 seeing 0.88 MJD 57526.451 object MzLS_641278_z 
    mosaic/CP/V4.3/CP20160517/k4m_160518_104944_ooi_zd_ls9.fits.fz
  k4m_160513_111808_ooi_zd_ls9-CCD2 z expnum 88854 exptime 80.104 propid 2016A-0453 seeing 0.97 MJD 57521.471 object MzLS_640436_z 
    mosaic/CP/V4.3/CP20160512/k4m_160513_111808_ooi_zd_ls9.fits.fz
  k4m_160523_102345_ooi_zd_ls9-CCD3 z expnum 90956 exptime 83.103 propid 2016A-0453 seeing 0.91 MJD 57531.433 object MzLS_642953_z 
    mosaic/CP/V4.3/CP20160522/k4m_160523_102345_ooi_zd_ls9.fits.fz
  k4m_170809_083022_ooi_zd_ls9-CCD1 z expnum 136581 exptime 219.103 propid 2016A-0453 seeing 0.83 MJD 57974.354 object MzLS_642118_z 
    mosaic/CP/V4.3/CP20170808/k4m_170809_083022_ooi_zd_ls9.fits.fz
  k4m_160518_105530_ooi_zd_ls9-CCD2 z expnum 90028 exptime 80.104 propid 2016A-0453 seeing 0.93 MJD 57526.455 object MzLS_641279_z 
    mosaic/CP/V4.3/CP20160517/k4m_160518_105530_ooi_zd_ls9.fits.fz
  ksb_160605_102906_ooi_r_ls9-CCD2 r expnum 75440184 exptime 84.3 propid BASS seeing 1.62 MJD 57544.437 object 24902 
    90prime/CP/V2.3/CP20160604/ksb_160605_102906_ooi_r_ls9.fits.fz
  ksb_160704_090759_ooi_g_ls9-CCD2 g expnum 75730150 exptime 105.8 propid BASS seeing 1.26 MJD 57573.381 object 24902 
    90prime/CP/V2.3/CP20160703/ksb_160704_090759_ooi_g_ls9.fits.fz
  ksb_170624_080021_ooi_r_ls9-CCD3 r expnum 79280118 exptime 106.296 propid BASS seeing 1.15 MJD 57928.334 object 24913 
    90prime/CP/V2.3/CP20170623/ksb_170624_080021_ooi_r_ls9.fits.fz
  ksb_160705_083950_ooi_g_ls9-CCD3 g expnum 75740130 exptime 163.3 propid BASS seeing 1.44 MJD 57574.361 object 24913 
    90prime/CP/V2.3/CP20160704/ksb_160705_083950_ooi_g_ls9.fits.fz
  ksb_180510_095847_ooi_g_ls9-CCD3 g expnum 82480169 exptime 132.762 propid NOTBASS seeing 1.25 MJD 58248.416 object 24911 
    90prime/CP/V2.3/CP20180509/ksb_180510_095847_ooi_g_ls9.fits.fz
  ksb_160604_103140_ooi_r_ls9-CCD3 r expnum 75430206 exptime 68.7 propid BASS seeing 1.30 MJD 57543.439 object 24911 
    90prime/CP/V2.3/CP20160603/ksb_160604_103140_ooi_r_ls9.fits.fz
Faked up EXPNUM 82480169
Faked up EXPNUM 82480169
Faked up EXPNUM 82480169
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3295 3477 and amp range 2016 4031 and image y 3330 3514 and amp range 2048 4095
Range in image: x 0 183 , y 0 185 (with image size 183 x 185)
dzp -0.01723723 -> scaling image by 0.9842492857213068
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 906 1226 and amp range 0 2047 and image y 0 181 and amp range 0 2039
Range in image: x 0 321 , y 0 182 (with image size 321 x 182)
dzp -0.006320339 -> scaling image by 0.9941956631368829
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3633 3961 and amp range 2048 4095 and image y 1430 1755 and amp range 0 2039
Range in image: x 0 329 , y 0 326 (with image size 329 x 326)
dzp 0.0072022504 -> scaling image by 1.0066555682883527
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75440184
Faked up EXPNUM 75440184
Faked up EXPNUM 75440184
90prime get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1045 1230 and amp range 0 2015 and image y 1775 1960 and amp range 0 2047
Range in image: x 0 186 , y 0 186 (with image size 186 x 186)
dzp -0.006045583 -> scaling image by 0.9944472857505693
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 0 82 and amp range 0 2005 and image y 111 430 and amp range 0 2039
Range in image: x 0 83 , y 0 320 (with image size 83 x 320)
dzp -0.005856539 -> scaling image by 0.9946204500110131
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75730150
Faked up EXPNUM 75730150
Faked up EXPNUM 75730150
90prime get_fwhm: self.fwhm = 2.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1048 1232 and amp range 0 2015 and image y 1771 1956 and amp range 0 2047
Range in image: x 0 185 , y 0 186 (with image size 185 x 186)
dzp -0.008523628 -> scaling image by 0.992180183483648
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 933 1255 and amp range 0 2047 and image y 3478 3802 and amp range 2022 4060
Range in image: x 0 323 , y 0 325 (with image size 323 x 325)
dzp 0.0033053984 -> scaling image by 1.0030490232713904
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2512 2832 and amp range 2006 4053 and image y 3945 4072 and amp range 2040 4078
Range in image: x 0 321 , y 0 128 (with image size 321 x 128)
dzp 0.0056365696 -> scaling image by 1.005204971477435
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2427 2748 and amp range 2006 4053 and image y 258 583 and amp range 0 2039
Range in image: x 0 322 , y 0 326 (with image size 322 x 326)
dzp 0.0061123776 -> scaling image by 1.005645584425507
Faked up EXPNUM 75430206
Faked up EXPNUM 75430206
Faked up EXPNUM 75430206
90prime get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3298 3481 and amp range 2016 4031 and image y 3324 3508 and amp range 2048 4095
Range in image: x 0 184 , y 0 185 (with image size 184 x 185)
dzp -0.0005558773 -> scaling image by 0.99948814914245
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75740130
Faked up EXPNUM 75740130
Faked up EXPNUM 75740130
90prime get_fwhm: self.fwhm = 3.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1300 1483 and amp range 0 2015 and image y 1355 1538 and amp range 0 2047
Range in image: x 0 184 , y 0 184 (with image size 184 x 184)
dzp -0.03470582 -> scaling image by 0.9685402452207784
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79280118
Faked up EXPNUM 79280118
Faked up EXPNUM 79280118
90prime get_fwhm: self.fwhm = 2.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1296 1479 and amp range 0 2015 and image y 1342 1525 and amp range 0 2047
Range in image: x 0 184 , y 0 184 (with image size 184 x 184)
dzp -0.043123975 -> scaling image by 0.961059796099719
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 13.42 s, CPU: 1.34 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 179 MB, VmData: 210 MB, maxrss: 0.182872 MB
Stage tims finished: 2020-08-05T21:25:32.068019
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 6.780 s worker CPU, 61.865 s worker Wall, Wall: 13.418 s, Cores in use: 0.61, Total efficiency (on 16 cores): 3.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T21:25:32.208912
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01488.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01599.fits
Matched 9 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/metrics/cus/reference-custom-281993p48094.fits
Stage refs : Wall: 20.66 s, CPU: 7.78 s, VmPeak: 1039 MB, VmSize: 1033 MB, VmRSS: 256 MB, VmData: 286 MB, maxrss: 0.261836 MB
Stage refs finished: 2020-08-05T21:25:52.864460
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 20.657 s, Cores in use: 0.38, Total efficiency (on 16 cores): 2.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T21:25:52.890278
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/metrics/cus/outlier-mask-custom-281993p48094.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/metrics/cus/outliers-pre-custom-281993p48094.jpg
Image ksb_160705_083950_ooi_g_ls9-CCD3 g : masking 56 positive outlier pixels and 0 negative outlier pixels
Image ksb_180510_095847_ooi_g_ls9-CCD3 g : masking 50 positive outlier pixels and 0 negative outlier pixels
Image ksb_160605_102906_ooi_r_ls9-CCD2 r : masking 2472 positive outlier pixels and 0 negative outlier pixels
Image ksb_160604_103140_ooi_r_ls9-CCD3 r : masking 112 positive outlier pixels and 0 negative outlier pixels
Image k4m_170906_054731_ooi_zd_ls9-CCD3 z : masking 1700 positive outlier pixels and 0 negative outlier pixels
Image k4m_160523_102345_ooi_zd_ls9-CCD3 z : masking 0 positive outlier pixels and 141 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/metrics/cus/outlier-mask-custom-281993p48094.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/metrics/cus/outliers-post-custom-281993p48094.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/metrics/cus/outliers-masked-pos-custom-281993p48094.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/metrics/cus/outliers-masked-neg-custom-281993p48094.jpg
Stage outliers : Wall: 1.99 s, CPU: 1.45 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 277 MB, VmData: 304 MB, maxrss: 0.283592 MB
Stage outliers finished: 2020-08-05T21:25:54.879295
Resources for stage outliers : 1.194 s worker CPU, 1.241 s worker Wall, Wall: 1.991 s, Cores in use: 1.33, Total efficiency (on 16 cores): 8.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T21:25:54.904736
Stage halos : Wall: 1.17 s, CPU: 1.14 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 277 MB, VmData: 304 MB, maxrss: 0.284112 MB
Stage halos finished: 2020-08-05T21:25:56.071720
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.168 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T21:25:56.197165
PSF sigmas in coadd pixels: ['2.05', '2.33', '2.02']
Using average PSF sigma 2.1366952580973186
Gaussian PSF norm 0.13202387692153983 vs pixelized 0.10392866
average tim pixel scale / coadd scale: 1.729499879257597
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.63', '1.86', '2.11']
Using average PSF sigma 2.199675016926086
Gaussian PSF norm 0.12824384947922388 vs pixelized 0.097735986
average tim pixel scale / coadd scale: 1.7288205158747447
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.83', '1.43', '1.57', '1.47', '1.35', '1.51']
Using average PSF sigma 1.5278442314190157
Gaussian PSF norm 0.18463583261487135 vs pixelized 0.15403679
average tim pixel scale / coadd scale: 0.99092282604547
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.22 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 280 MB, VmData: 305 MB, maxrss: 0.28668 MB
Stage fit_on_coadds finished: 2020-08-05T21:25:56.437440
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.336 s worker CPU, 0.336 s worker Wall, Wall: 0.242 s, Cores in use: 2.31, Total efficiency (on 16 cores): 14.5 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T21:25:56.450380
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 79 potential peaks
Of 79 potential peaks: 41 in veto map, 9 cut by saddle test, 0 cut by aper test, 29 kept
SED z : 29 new peaks
Found 41 potential peaks
Of 41 potential peaks: 35 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 49 potential peaks
Of 49 potential peaks: 40 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 70 potential peaks
Of 70 potential peaks: 60 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 97 potential peaks
Of 97 potential peaks: 82 in veto map, 11 cut by saddle test, 0 cut by aper test, 4 kept
SED Red : 4 new peaks
Adding 38 new sources
Median coadd sky for g : 0.00033060243
Median coadd sky for r : 0.00051248097
Median coadd sky for z : -0.00016149861
Stage srcs : Wall: 1.49 s, CPU: 1.44 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 281 MB, VmData: 305 MB, maxrss: 0.287444 MB
Stage srcs finished: 2020-08-05T21:25:57.939921
Resources for stage srcs : 0.126 s worker CPU, 0.126 s worker Wall, Wall: 1.491 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T21:25:57.954838
Blob 1 of 21, id: 7, sources: 15, size: 203x178, npix 22126, brick X: 44,247, Y: 74,252, one pixel: 190 74
Blob 2 of 21, id: 13, sources: 7, size: 111x91, npix 4554, brick X: 35,146, Y: 224,315, one pixel: 51 224
Blob 3 of 21, id: 5, sources: 4, size: 48x88, npix 2660, brick X: 0,48, Y: 64,152, one pixel: 7 64
Blob 4 of 21, id: 0, sources: 2, size: 57x68, npix 2329, brick X: 20,77, Y: 3,71, one pixel: 47 3
Blob 5 of 21, id: 19, sources: 3, size: 46x43, npix 1534, brick X: 269,315, Y: 272,315, one pixel: 300 272
Blob 6 of 21, id: 2, sources: 1, size: 25x44, npix 820, brick X: 290,315, Y: 9,53, one pixel: 308 9
Blob 7 of 21, id: 3, sources: 2, size: 38x25, npix 627, brick X: 228,266, Y: 14,39, one pixel: 251 14
Blob 8 of 21, id: 1, sources: 1, size: 31x30, npix 622, brick X: 123,154, Y: 5,35, one pixel: 135 5
Blob 9 of 21, id: 11, sources: 1, size: 30x31, npix 602, brick X: 49,79, Y: 199,230, one pixel: 61 199
Blob 10 of 21, id: 16, sources: 1, size: 29x28, npix 536, brick X: 182,211, Y: 241,269, one pixel: 196 241
Blob 11 of 21, id: 4, sources: 1, size: 26x27, npix 418, brick X: 175,201, Y: 33,60, one pixel: 188 33
Blob 12 of 21, id: 9, sources: 1, size: 25x25, npix 404, brick X: 247,272, Y: 127,152, one pixel: 257 127
Blob 13 of 21, id: 8, sources: 1, size: 25x25, npix 403, brick X: 285,310, Y: 80,105, one pixel: 296 80
Blob 14 of 21, id: 20, sources: 1, size: 26x25, npix 391, brick X: 10,36, Y: 280,305, one pixel: 21 280
Blob 15 of 21, id: 18, sources: 1, size: 24x24, npix 362, brick X: 27,51, Y: 252,276, one pixel: 37 252
Blob 16 of 21, id: 12, sources: 1, size: 23x23, npix 347, brick X: 222,245, Y: 206,229, one pixel: 230 206
Blob 17 of 21, id: 14, sources: 1, size: 21x22, npix 281, brick X: 238,259, Y: 226,248, one pixel: 246 226
Blob 18 of 21, id: 17, sources: 1, size: 22x21, npix 271, brick X: 260,282, Y: 244,265, one pixel: 269 244
Blob 8 finished, total: Wall: 0.11 s, CPU: 0.11 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.089644 MB
Blob 19 of 21, id: 10, sources: 1, size: 18x20, npix 237, brick X: 0,18, Y: 184,204, one pixel: 6 184
Blob 6 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151096 MB
Blob 20 of 21, id: 6, sources: 1, size: 17x18, npix 162, brick X: 255,272, Y: 65,83, one pixel: 263 65
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (281.97192, 48.10499), pm (-6.3, -5.9), parallax 1.507 with NanoMaggies: g=12.4, r=12.1, z=12
Reset brightness to NanoMaggies: g=12.4, r=12.1, z=12
Blob 5 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150992 MB
Blob 21 of 21, id: 15, sources: 1, size: 17x17, npix 145, brick X: 292,309, Y: 234,251, one pixel: 300 234
Blob 17 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094544 MB
Blob 13 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150568 MB
Blob 16 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15002 MB
Blob 15 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 791 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.138116 MB
Blob 21 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151268 MB
Blob 19 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151564 MB
Blob 9 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 817 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150796 MB
Blob 20 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094544 MB
Blob 11 finished, total: Wall: 0.68 s, CPU: 0.67 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151608 MB
Blob 10 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 95 MB, VmData: 143 MB, maxrss: 0.097048 MB
Blob 18 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151096 MB
Blob 14 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15168 MB
Blob 12 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 790 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.13832 MB
Measuring 2 iterative sources
Blob 7 finished, total: Wall: 1.43 s, CPU: 1.42 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096272 MB
Blob 4 finished, total: Wall: 2.24 s, CPU: 2.24 s, VmPeak: 808 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.152988 MB
Blob 3 finished, total: Wall: 2.92 s, CPU: 2.92 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.15274 MB
Measuring 2 iterative sources
Blob 2 finished, total: Wall: 4.41 s, CPU: 4.41 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.098344 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.7521, ee1=-0.0407638, ee2=0.114153
Measuring 7 iterative sources
Blob 1 finished, total: Wall: 15.32 s, CPU: 15.32 s, VmPeak: 812 MB, VmSize: 736 MB, VmRSS: 160 MB, VmData: 188 MB, maxrss: 0.163436 MB
Old catalog: 55
New catalog: 50
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/metrics/cus/blobs-custom-281993p48094.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/metrics/cus/all-models-custom-281993p48094.fits
Stage fitblobs : Wall: 16.22 s, CPU: 0.91 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 281 MB, VmData: 305 MB, maxrss: 0.2878 MB
Stage fitblobs finished: 2020-08-05T21:26:14.178796
Resources for stage fitblobs : 34.238 s worker CPU, 35.275 s worker Wall, Wall: 16.225 s, Cores in use: 2.17, Total efficiency (on 16 cores): 13.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T21:26:14.193792
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-resid.jpg
Stage coadds : Wall: 3.51 s, CPU: 1.24 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 281 MB, VmData: 305 MB, maxrss: 0.288124 MB
Stage coadds finished: 2020-08-05T21:26:17.703605
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 8.163 s worker CPU, 12.256 s worker Wall, Wall: 3.511 s, Cores in use: 2.68, Total efficiency (on 16 cores): 16.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T21:26:17.732381
Cut to 1 unWISE tiles
Reading WISE tile 2812p484 band 1
Reading WISE tile 2812p484 band 3
Reading WISE tile 2812p484 band 2
Reading WISE tile 2812p484 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 804 MB, VmRSS: 145 MB, VmData: 172 MB, maxrss: 0.209044 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 810 MB, VmSize: 810 MB, VmRSS: 154 MB, VmData: 178 MB, maxrss: 0.1934 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 812 MB, VmSize: 810 MB, VmRSS: 157 MB, VmData: 178 MB, maxrss: 0.221176 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 871 MB, VmSize: 871 MB, VmRSS: 213 MB, VmData: 238 MB, maxrss: 0.217848 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.02 s, CPU: 3.00 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 282 MB, VmData: 305 MB, maxrss: 0.288636 MB
Stage wise_forced finished: 2020-08-05T21:26:22.752381
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.167 s worker CPU, 5.462 s worker Wall, Wall: 5.021 s, Cores in use: 1.23, Total efficiency (on 16 cores): 7.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T21:26:22.769547
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/tractor-i/cus/tractor-custom-281993p48094.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/tractor/cus/tractor-custom-281993p48094.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/tractor/cus/brick-custom-281993p48094.sha256sum
Stage writecat : Wall: 6.61 s, CPU: 3.26 s, VmPeak: 1175 MB, VmSize: 1047 MB, VmRSS: 284 MB, VmData: 305 MB, maxrss: 0.421516 MB
Stage writecat finished: 2020-08-05T21:26:29.379862
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.612 s, Cores in use: 0.49, Total efficiency (on 16 cores): 3.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/281/PGC2310358/PGC2310358-largegalaxy-writecat.p
All done: 54.009 s worker CPU, 116.567 s worker Wall, Wall: 71.002 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 %
Finished galaxy PGC2310358 in 1.460 minutes.
Started working on galaxy PGC2310358 at Fri Aug  7 09:50:34 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 281.99311021426206 48.09432157560733 --width 315 --height 315 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T09:50:36.129219
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '281.99311021426206', '48.09432157560733', '--width', '315', '--height', '315', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 281.99311021426206 48.09432157560733 --width 315 --height 315 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 281.99311021426206 48.09432157560733
Starting process 23569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 23570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 23571 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 23573 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 23574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 23575 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 23576 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 23577 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 23578 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 23579 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 23580 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 23581 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 23582 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 23584 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 23585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 23583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T09:50:36.648830
Keeping 12 CCDs:
  k4m_170906_054731_ooi_zd_ls9-CCD3 z expnum 138507 exptime 237.104 propid 2016A-0453 seeing 1.12 MJD 58002.241 object MzLS_642117_z 
    mosaic/CP/V4.3/CP20170905/k4m_170906_054731_ooi_zd_ls9.fits.fz
  k4m_160518_104944_ooi_zd_ls9-CCD4 z expnum 90025 exptime 80.105 propid 2016A-0453 seeing 0.88 MJD 57526.451 object MzLS_641278_z 
    mosaic/CP/V4.3/CP20160517/k4m_160518_104944_ooi_zd_ls9.fits.fz
  k4m_160513_111808_ooi_zd_ls9-CCD2 z expnum 88854 exptime 80.104 propid 2016A-0453 seeing 0.97 MJD 57521.471 object MzLS_640436_z 
    mosaic/CP/V4.3/CP20160512/k4m_160513_111808_ooi_zd_ls9.fits.fz
  k4m_160523_102345_ooi_zd_ls9-CCD3 z expnum 90956 exptime 83.103 propid 2016A-0453 seeing 0.91 MJD 57531.433 object MzLS_642953_z 
    mosaic/CP/V4.3/CP20160522/k4m_160523_102345_ooi_zd_ls9.fits.fz
  k4m_170809_083022_ooi_zd_ls9-CCD1 z expnum 136581 exptime 219.103 propid 2016A-0453 seeing 0.83 MJD 57974.354 object MzLS_642118_z 
    mosaic/CP/V4.3/CP20170808/k4m_170809_083022_ooi_zd_ls9.fits.fz
  k4m_160518_105530_ooi_zd_ls9-CCD2 z expnum 90028 exptime 80.104 propid 2016A-0453 seeing 0.93 MJD 57526.455 object MzLS_641279_z 
    mosaic/CP/V4.3/CP20160517/k4m_160518_105530_ooi_zd_ls9.fits.fz
  ksb_160605_102906_ooi_r_ls9-CCD2 r expnum 75440184 exptime 84.3 propid BASS seeing 1.62 MJD 57544.437 object 24902 
    90prime/CP/V2.3/CP20160604/ksb_160605_102906_ooi_r_ls9.fits.fz
  ksb_160704_090759_ooi_g_ls9-CCD2 g expnum 75730150 exptime 105.8 propid BASS seeing 1.26 MJD 57573.381 object 24902 
    90prime/CP/V2.3/CP20160703/ksb_160704_090759_ooi_g_ls9.fits.fz
  ksb_170624_080021_ooi_r_ls9-CCD3 r expnum 79280118 exptime 106.296 propid BASS seeing 1.15 MJD 57928.334 object 24913 
    90prime/CP/V2.3/CP20170623/ksb_170624_080021_ooi_r_ls9.fits.fz
  ksb_160705_083950_ooi_g_ls9-CCD3 g expnum 75740130 exptime 163.3 propid BASS seeing 1.44 MJD 57574.361 object 24913 
    90prime/CP/V2.3/CP20160704/ksb_160705_083950_ooi_g_ls9.fits.fz
  ksb_180510_095847_ooi_g_ls9-CCD3 g expnum 82480169 exptime 132.762 propid NOTBASS seeing 1.25 MJD 58248.416 object 24911 
    90prime/CP/V2.3/CP20180509/ksb_180510_095847_ooi_g_ls9.fits.fz
  ksb_160604_103140_ooi_r_ls9-CCD3 r expnum 75430206 exptime 68.7 propid BASS seeing 1.30 MJD 57543.439 object 24911 
    90prime/CP/V2.3/CP20160603/ksb_160604_103140_ooi_r_ls9.fits.fz
Faked up EXPNUM 75440184
Faked up EXPNUM 75440184
Faked up EXPNUM 75440184
90prime get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1046 1231 and amp range 0 2015 and image y 1779 1964 and amp range 0 2047
Range in image: x 0 186 , y 0 186 (with image size 186 x 186)
dzp -0.006045583 -> scaling image by 0.9944472857505693
Faked up EXPNUM 75740130
Faked up EXPNUM 75740130
Faked up EXPNUM 75740130
90prime get_fwhm: self.fwhm = 3.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1301 1484 and amp range 0 2015 and image y 1358 1542 and amp range 0 2047
Range in image: x 0 184 , y 0 185 (with image size 184 x 185)
dzp -0.03470582 -> scaling image by 0.9685402452207784
Faked up EXPNUM 75430206
Faked up EXPNUM 75430206
Faked up EXPNUM 75430206
90prime get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3299 3482 and amp range 2016 4031 and image y 3328 3512 and amp range 2048 4095
Range in image: x 0 184 , y 0 185 (with image size 184 x 185)
dzp -0.0005558773 -> scaling image by 0.99948814914245
Faked up EXPNUM 82480169
Faked up EXPNUM 82480169
Faked up EXPNUM 82480169
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3296 3478 and amp range 2016 4031 and image y 3333 3517 and amp range 2048 4095
Range in image: x 0 183 , y 0 185 (with image size 183 x 185)
dzp -0.01723723 -> scaling image by 0.9842492857213068
mosaic get_fwhm: self.fwhm = 4.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2510 2830 and amp range 2006 4053 and image y 3939 4072 and amp range 2040 4078
Range in image: x 0 321 , y 0 134 (with image size 321 x 134)
dzp 0.0056365696 -> scaling image by 1.005204971477435
mosaic get_fwhm: self.fwhm = 3.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 905 1225 and amp range 0 2047 and image y 0 175 and amp range 0 2039
Range in image: x 0 321 , y 0 176 (with image size 321 x 176)
dzp -0.006320339 -> scaling image by 0.9941956631368829
Faked up EXPNUM 75730150
Faked up EXPNUM 75730150
Faked up EXPNUM 75730150
90prime get_fwhm: self.fwhm = 2.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1049 1233 and amp range 0 2015 and image y 1775 1960 and amp range 0 2047
Range in image: x 0 185 , y 0 186 (with image size 185 x 186)
dzp -0.008523628 -> scaling image by 0.992180183483648
mosaic get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 0 80 and amp range 0 2005 and image y 105 424 and amp range 0 2039
Range in image: x 0 81 , y 0 320 (with image size 81 x 320)
dzp -0.005856539 -> scaling image by 0.9946204500110131
Faked up EXPNUM 79280118
Faked up EXPNUM 79280118
Faked up EXPNUM 79280118
90prime get_fwhm: self.fwhm = 2.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1297 1480 and amp range 0 2015 and image y 1345 1529 and amp range 0 2047
Range in image: x 0 184 , y 0 185 (with image size 184 x 185)
dzp -0.043123975 -> scaling image by 0.961059796099719
mosaic get_fwhm: self.fwhm = 3.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3631 3960 and amp range 2048 4095 and image y 1423 1749 and amp range 0 2039
Range in image: x 0 330 , y 0 327 (with image size 330 x 327)
dzp 0.0072022504 -> scaling image by 1.0066555682883527
mosaic get_fwhm: self.fwhm = 3.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2426 2747 and amp range 2006 4053 and image y 251 577 and amp range 0 2039
Range in image: x 0 322 , y 0 327 (with image size 322 x 327)
dzp 0.0061123776 -> scaling image by 1.005645584425507
mosaic get_fwhm: self.fwhm = 3.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 931 1253 and amp range 0 2047 and image y 3472 3796 and amp range 2022 4060
Range in image: x 0 323 , y 0 325 (with image size 323 x 325)
dzp 0.0033053984 -> scaling image by 1.0030490232713904
Stage tims : Wall: 12.92 s, CPU: 0.85 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 177 MB, VmData: 211 MB, maxrss: 0.18118 MB
Stage tims finished: 2020-08-07T09:50:49.571292
Resources for stage tims : 6.487 s worker CPU, 75.772 s worker Wall, Wall: 12.924 s, Cores in use: 0.57, Total efficiency (on 16 cores): 3.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T09:50:50.440010
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01488.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01599.fits
Matched 9 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/metrics/cus/reference-custom-281993p48094.fits
Stage refs : Wall: 21.91 s, CPU: 6.14 s, VmPeak: 1032 MB, VmSize: 1026 MB, VmRSS: 254 MB, VmData: 286 MB, maxrss: 0.2604 MB
Stage refs finished: 2020-08-07T09:51:12.354972
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 21.917 s, Cores in use: 0.28, Total efficiency (on 16 cores): 1.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T09:51:12.381429
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/metrics/cus/outlier-mask-custom-281993p48094.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/metrics/cus/outliers-pre-custom-281993p48094.jpg
Image ksb_160705_083950_ooi_g_ls9-CCD3 g : masking 57 positive outlier pixels and 0 negative outlier pixels
Image ksb_180510_095847_ooi_g_ls9-CCD3 g : masking 52 positive outlier pixels and 0 negative outlier pixels
Image ksb_160605_102906_ooi_r_ls9-CCD2 r : masking 2534 positive outlier pixels and 0 negative outlier pixels
Image ksb_160604_103140_ooi_r_ls9-CCD3 r : masking 111 positive outlier pixels and 0 negative outlier pixels
Image k4m_170906_054731_ooi_zd_ls9-CCD3 z : masking 1920 positive outlier pixels and 0 negative outlier pixels
Image k4m_160523_102345_ooi_zd_ls9-CCD3 z : masking 0 positive outlier pixels and 247 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/metrics/cus/outlier-mask-custom-281993p48094.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/metrics/cus/outliers-post-custom-281993p48094.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/metrics/cus/outliers-masked-pos-custom-281993p48094.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/metrics/cus/outliers-masked-neg-custom-281993p48094.jpg
Stage outliers : Wall: 1.12 s, CPU: 0.85 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 275 MB, VmData: 304 MB, maxrss: 0.28164 MB
Stage outliers finished: 2020-08-07T09:51:13.506369
Resources for stage outliers : 1.180 s worker CPU, 1.233 s worker Wall, Wall: 1.126 s, Cores in use: 1.80, Total efficiency (on 16 cores): 11.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T09:51:13.718502
Stage halos : Wall: 0.39 s, CPU: 0.38 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 275 MB, VmData: 304 MB, maxrss: 0.281964 MB
Stage halos finished: 2020-08-07T09:51:14.111437
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.394 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T09:51:14.155043
PSF sigmas in coadd pixels: ['2.05', '2.33', '2.02']
Using average PSF sigma 2.1366952580973186
Gaussian PSF norm 0.13202387692153983 vs pixelized 0.103928156
average tim pixel scale / coadd scale: 1.729499879257597
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.63', '1.86', '2.11']
Using average PSF sigma 2.199675016926086
Gaussian PSF norm 0.12824384947922388 vs pixelized 0.097729385
average tim pixel scale / coadd scale: 1.7288205158747447
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.83', '1.43', '1.57', '1.47', '1.35', '1.51']
Using average PSF sigma 1.5278442314190157
Gaussian PSF norm 0.18463583261487135 vs pixelized 0.15403295
average tim pixel scale / coadd scale: 0.99092282604547
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.31 s, CPU: 0.22 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 278 MB, VmData: 305 MB, maxrss: 0.284764 MB
Stage fit_on_coadds finished: 2020-08-07T09:51:14.466448
Resources for stage fit_on_coadds : 0.333 s worker CPU, 0.333 s worker Wall, Wall: 0.313 s, Cores in use: 1.77, Total efficiency (on 16 cores): 11.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T09:51:14.507658
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 78 potential peaks
Of 78 potential peaks: 42 in veto map, 9 cut by saddle test, 0 cut by aper test, 27 kept
SED z : 27 new peaks
Found 40 potential peaks
Of 40 potential peaks: 36 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 52 potential peaks
Of 52 potential peaks: 41 in veto map, 8 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 69 potential peaks
Of 69 potential peaks: 58 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 98 potential peaks
Of 98 potential peaks: 85 in veto map, 11 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 33 new sources
Median coadd sky for g : 0.0003530527
Median coadd sky for r : 0.00055000116
Median coadd sky for z : -0.00014861385
Stage srcs : Wall: 0.64 s, CPU: 0.60 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 279 MB, VmData: 305 MB, maxrss: 0.285444 MB
Stage srcs finished: 2020-08-07T09:51:15.148704
Resources for stage srcs : 0.128 s worker CPU, 0.128 s worker Wall, Wall: 0.642 s, Cores in use: 1.14, Total efficiency (on 16 cores): 7.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T09:51:15.172108
Blob 1 of 18, id: 7, sources: 14, size: 203x178, npix 22159, brick X: 38,241, Y: 76,254, one pixel: 183 76
Blob 2 of 18, id: 10, sources: 8, size: 110x114, npix 5101, brick X: 29,139, Y: 201,315, one pixel: 54 201
Blob 3 of 18, id: 0, sources: 2, size: 57x68, npix 2346, brick X: 14,71, Y: 5,73, one pixel: 40 5
Blob 4 of 18, id: 5, sources: 3, size: 42x86, npix 2174, brick X: 0,42, Y: 67,153, one pixel: 4 67
Blob 5 of 18, id: 16, sources: 2, size: 52x56, npix 1941, brick X: 263,315, Y: 259,315, one pixel: 308 259
Blob 6 of 18, id: 1, sources: 1, size: 31x52, npix 1162, brick X: 284,315, Y: 5,57, one pixel: 308 5
Blob 7 of 18, id: 3, sources: 2, size: 38x25, npix 627, brick X: 222,260, Y: 16,41, one pixel: 244 16
Blob 8 of 18, id: 2, sources: 1, size: 31x30, npix 622, brick X: 117,148, Y: 7,37, one pixel: 128 7
Blob 9 of 18, id: 13, sources: 1, size: 29x27, npix 540, brick X: 176,205, Y: 243,270, one pixel: 189 243
Blob 10 of 18, id: 9, sources: 1, size: 26x26, npix 416, brick X: 240,266, Y: 128,154, one pixel: 251 128
Blob 11 of 18, id: 4, sources: 1, size: 26x26, npix 414, brick X: 169,195, Y: 35,61, one pixel: 182 35
Blob 12 of 18, id: 8, sources: 1, size: 25x25, npix 402, brick X: 279,304, Y: 82,107, one pixel: 289 82
Blob 13 of 18, id: 17, sources: 1, size: 25x24, npix 400, brick X: 4,29, Y: 282,306, one pixel: 14 282
Blob 14 of 18, id: 15, sources: 1, size: 24x24, npix 352, brick X: 21,45, Y: 254,278, one pixel: 30 254
Blob 15 of 18, id: 11, sources: 1, size: 24x24, npix 342, brick X: 215,239, Y: 207,231, one pixel: 225 207
Blob 16 of 18, id: 12, sources: 1, size: 21x22, npix 281, brick X: 232,253, Y: 227,249, one pixel: 241 227
Blob 17 of 18, id: 14, sources: 1, size: 22x20, npix 269, brick X: 254,276, Y: 246,266, one pixel: 262 246
Blob 18 of 18, id: 6, sources: 1, size: 17x18, npix 162, brick X: 249,266, Y: 67,85, one pixel: 257 67
Blob 8 finished, total: Wall: 0.11 s, CPU: 0.11 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146712 MB
Blob 6 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146912 MB
Blob 16 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147608 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (281.97192, 48.10499), pm (-6.3, -5.9), parallax 1.507 with NanoMaggies: g=12.4, r=12.1, z=12
Reset brightness to NanoMaggies: g=12.4, r=12.1, z=12
Blob 5 finished, total: Wall: 0.36 s, CPU: 0.35 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 91 MB, VmData: 142 MB, maxrss: 0.09366 MB
Blob 18 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146912 MB
Blob 12 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093284 MB
Blob 15 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147692 MB
Blob 9 finished, total: Wall: 0.58 s, CPU: 0.57 s, VmPeak: 790 MB, VmSize: 712 MB, VmRSS: 131 MB, VmData: 170 MB, maxrss: 0.134036 MB
Blob 14 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147184 MB
Blob 10 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.094892 MB
Blob 11 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147224 MB
Blob 17 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147584 MB
Blob 13 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 817 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147696 MB
Measuring 2 iterative sources
Blob 7 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 806 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146868 MB
Blob 4 finished, total: Wall: 1.71 s, CPU: 1.71 s, VmPeak: 791 MB, VmSize: 712 MB, VmRSS: 132 MB, VmData: 170 MB, maxrss: 0.13544 MB
Blob 3 finished, total: Wall: 2.32 s, CPU: 2.31 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.098996 MB
Measuring 2 iterative sources
Blob 2 finished, total: Wall: 4.54 s, CPU: 4.54 s, VmPeak: 812 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148172 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.29808, ee1=-0.042136, ee2=0.119208
Measuring 11 iterative sources
Blob 1 finished, total: Wall: 22.06 s, CPU: 22.06 s, VmPeak: 807 MB, VmSize: 732 MB, VmRSS: 156 MB, VmData: 187 MB, maxrss: 0.16014 MB
Old catalog: 50
New catalog: 50
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/metrics/cus/blobs-custom-281993p48094.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/metrics/cus/all-models-custom-281993p48094.fits
Stage fitblobs : Wall: 22.47 s, CPU: 0.42 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 279 MB, VmData: 305 MB, maxrss: 0.2858 MB
Stage fitblobs finished: 2020-08-07T09:51:37.639893
Resources for stage fitblobs : 38.292 s worker CPU, 38.456 s worker Wall, Wall: 22.469 s, Cores in use: 1.72, Total efficiency (on 16 cores): 10.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T09:51:37.710223
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-resid.jpg
Stage coadds : Wall: 2.30 s, CPU: 0.65 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 279 MB, VmData: 305 MB, maxrss: 0.286124 MB
Stage coadds finished: 2020-08-07T09:51:40.005966
Resources for stage coadds : 8.097 s worker CPU, 8.693 s worker Wall, Wall: 2.297 s, Cores in use: 3.81, Total efficiency (on 16 cores): 23.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T09:51:40.097528
Cut to 1 unWISE tiles
Reading WISE tile 2812p484 band 1
Reading WISE tile 2812p484 band 3
Reading WISE tile 2812p484 band 2
Reading WISE tile 2812p484 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 808 MB, VmSize: 803 MB, VmRSS: 150 MB, VmData: 177 MB, maxrss: 0.188456 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 798 MB, VmRSS: 142 MB, VmData: 172 MB, maxrss: 0.204548 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 812 MB, VmSize: 800 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.207152 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2812p484/unwise-2812p484-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 813 MB, VmSize: 797 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.203748 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/tmp-legacysurvey-custom-281993p48094-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 26.20 s, CPU: 0.54 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 280 MB, VmData: 305 MB, maxrss: 0.286644 MB
Stage wise_forced finished: 2020-08-07T09:52:06.292950
Resources for stage wise_forced : 3.141 s worker CPU, 14.986 s worker Wall, Wall: 26.197 s, Cores in use: 0.14, Total efficiency (on 16 cores): 0.9 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T09:52:06.347982
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/coadd/cus/custom-281993p48094/legacysurvey-custom-281993p48094-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/tractor-i/cus/tractor-custom-281993p48094.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/tractor/cus/tractor-custom-281993p48094.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/tractor/cus/brick-custom-281993p48094.sha256sum
Stage writecat : Wall: 0.95 s, CPU: 0.57 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 282 MB, VmData: 305 MB, maxrss: 0.419528 MB
Stage writecat finished: 2020-08-07T09:52:07.302473
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.956 s, Cores in use: 0.60, Total efficiency (on 16 cores): 3.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2310358/PGC2310358-largegalaxy-writecat.p
All done: 57.662 s worker CPU, 139.606 s worker Wall, Wall: 90.863 s, Cores in use: 0.76, Total efficiency (on 16 cores): 4.8 %
Finished galaxy PGC2310358 in 1.569 minutes.