Started working on galaxy PGC2396739 at Wed Aug  5 19:12:51 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.57654149999996 51.5989075 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:12:53.539866
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '282.57654149999996', '51.5989075', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.57654149999996 51.5989075 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 282.57654149999996 51.5989075
Starting process 55189 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 55190 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 55191 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 55192 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 55193 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 55194 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 55195 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 55196 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 55197 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 55198 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 55199 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 55200 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 55201 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 55203 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 55204 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 55202 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:12:54.866938
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  k4m_160526_101310_ooi_zd_ls9-CCD4 z expnum 91655 exptime 80.102 propid 2016A-0453 seeing 0.91 MJD 57534.426 object MzLS_655107_z 
    mosaic/CP/V4.3/CP20160525/k4m_160526_101310_ooi_zd_ls9.fits.fz
  k4m_170910_071910_ooi_zd_ls9-CCD1 z expnum 139007 exptime 215.103 propid 2016A-0453 seeing 1.12 MJD 58006.305 object MzLS_656672_z 
    mosaic/CP/V4.3/CP20170909/k4m_170910_071910_ooi_zd_ls9.fits.fz
  k4m_160528_100637_ooi_zd_ls9-CCD4 z expnum 92017 exptime 80.103 propid 2016A-0453 seeing 0.89 MJD 57536.421 object MzLS_655890_z 
    mosaic/CP/V4.3/CP20160527/k4m_160528_100637_ooi_zd_ls9.fits.fz
  ksb_180519_092333_ooi_g_ls9-CCD4 g expnum 82570172 exptime 89.9 propid NOTBASS seeing 1.25 MJD 58257.391 object 29521 
    90prime/CP/V2.3/CP20180518/ksb_180519_092333_ooi_g_ls9.fits.fz
  ksb_170405_120720_ooi_r_ls9-CCD4 r expnum 78480198 exptime 133.666 propid BASS seeing 1.10 MJD 57848.505 object 29521 
    90prime/CP/V2.3/CP20170404/ksb_170405_120720_ooi_r_ls9.fits.fz
  ksb_160704_093744_ooi_g_ls9-CCD3 g expnum 75730161 exptime 101.3 propid BASS seeing 1.10 MJD 57573.401 object 28392 
    90prime/CP/V2.3/CP20160703/ksb_160704_093744_ooi_g_ls9.fits.fz
  ksb_160712_072426_ooi_r_ls9-CCD3 r expnum 75810096 exptime 98.3 propid BASS seeing 1.44 MJD 57581.309 object 28392 
    90prime/CP/V2.3/CP20160711/ksb_160712_072426_ooi_r_ls9.fits.fz
  ksb_160709_101035_ooi_g_ls9-CCD2 g expnum 75780121 exptime 155.8 propid BASS seeing 1.93 MJD 57578.424 object 29523 
    90prime/CP/V2.3/CP20160708/ksb_160709_101035_ooi_g_ls9.fits.fz
  ksb_170624_071521_ooi_r_ls9-CCD2 r expnum 79280097 exptime 74.905 propid BASS seeing 1.15 MJD 57928.302 object 29523 
    90prime/CP/V2.3/CP20170623/ksb_170624_071521_ooi_r_ls9.fits.fz
Faked up EXPNUM 75730161
Faked up EXPNUM 75730161
Faked up EXPNUM 75730161
90prime get_fwhm: self.fwhm = 2.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1283 1422 and amp range 0 2015 and image y 2298 2438 and amp range 2048 4095
Range in image: x 0 140 , y 0 141 (with image size 140 x 141)
dzp -0.0045482004 -> scaling image by 0.9958197144381092
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75810096
Faked up EXPNUM 75810096
Faked up EXPNUM 75810096
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1281 1421 and amp range 0 2015 and image y 2314 2454 and amp range 2048 4095
Range in image: x 0 141 , y 0 141 (with image size 141 x 141)
dzp -0.011545347 -> scaling image by 0.9894226798649194
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79280097
Faked up EXPNUM 79280097
Faked up EXPNUM 79280097
90prime get_fwhm: self.fwhm = 2.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1040 1179 and amp range 0 2015 and image y 4039 4080 and amp range 2048 4095
Range in image: x 0 140 , y 0 42 (with image size 140 x 42)
dzp 0.05525464 -> scaling image by 1.0522086198429996
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78480198
Faked up EXPNUM 78480198
Faked up EXPNUM 78480198
90prime get_fwhm: self.fwhm = 2.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3060 3200 and amp range 2016 4031 and image y 1584 1722 and amp range 0 2047
Range in image: x 0 141 , y 0 139 (with image size 141 x 139)
dzp 0.02499258 -> scaling image by 1.0232859986636875
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2324 2566 and amp range 2006 4053 and image y 3225 3466 and amp range 2040 4078
Range in image: x 0 243 , y 0 242 (with image size 243 x 242)
dzp 0.0036595785 -> scaling image by 1.003376283213225
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 750 990 and amp range 0 2047 and image y 0 238 and amp range 0 2021
Range in image: x 0 241 , y 0 239 (with image size 241 x 239)
dzp 0.005139143 -> scaling image by 1.0047445456970268
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 82570172
Faked up EXPNUM 82570172
Faked up EXPNUM 82570172
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3063 3203 and amp range 2016 4031 and image y 1518 1657 and amp range 0 2047
Range in image: x 0 141 , y 0 140 (with image size 141 x 140)
dzp 0.023266561 -> scaling image by 1.0216605511853067
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3480 3728 and amp range 2048 4095 and image y 1556 1799 and amp range 0 2021
Range in image: x 0 249 , y 0 244 (with image size 249 x 244)
dzp -0.0006399284 -> scaling image by 0.9994107778325068
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75780121
Faked up EXPNUM 75780121
Faked up EXPNUM 75780121
90prime get_fwhm: self.fwhm = 4.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1052 1191 and amp range 0 2015 and image y 4028 4080 and amp range 2048 4095
Range in image: x 0 140 , y 0 53 (with image size 140 x 53)
dzp 0.01693853 -> scaling image by 1.015723292931903
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 8.66 s, CPU: 1.51 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 174 MB, VmData: 206 MB, maxrss: 0.177992 MB
Stage tims finished: 2020-08-05T19:13:03.531228
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 4.925 s worker CPU, 33.454 s worker Wall, Wall: 8.666 s, Cores in use: 0.74, Total efficiency (on 16 cores): 4.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:13:03.673616
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01381.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01278.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/reference-custom-282576p51598.fits
Stage refs : Wall: 8.82 s, CPU: 7.00 s, VmPeak: 1032 MB, VmSize: 1026 MB, VmRSS: 245 MB, VmData: 275 MB, maxrss: 0.250708 MB
Stage refs finished: 2020-08-05T19:13:12.493045
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.821 s, Cores in use: 0.79, Total efficiency (on 16 cores): 5.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:13:12.619769
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outlier-mask-custom-282576p51598.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outliers-pre-custom-282576p51598.jpg
Image ksb_180519_092333_ooi_g_ls9-CCD4 g : masking 69 positive outlier pixels and 0 negative outlier pixels
Image ksb_160709_101035_ooi_g_ls9-CCD2 g : masking 116 positive outlier pixels and 0 negative outlier pixels
Image ksb_160712_072426_ooi_r_ls9-CCD3 r : masking 286 positive outlier pixels and 0 negative outlier pixels
Image k4m_170910_071910_ooi_zd_ls9-CCD1 z : masking 177 positive outlier pixels and 0 negative outlier pixels
Image k4m_160528_100637_ooi_zd_ls9-CCD4 z : masking 1114 positive outlier pixels and 360 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outlier-mask-custom-282576p51598.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outliers-post-custom-282576p51598.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outliers-masked-pos-custom-282576p51598.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outliers-masked-neg-custom-282576p51598.jpg
Stage outliers : Wall: 0.91 s, CPU: 0.62 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 257 MB, VmData: 283 MB, maxrss: 0.262908 MB
Stage outliers finished: 2020-08-05T19:13:13.529942
Resources for stage outliers : 0.674 s worker CPU, 0.778 s worker Wall, Wall: 0.912 s, Cores in use: 1.42, Total efficiency (on 16 cores): 8.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:13:13.587168
Stage halos : Wall: 0.35 s, CPU: 0.33 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 257 MB, VmData: 283 MB, maxrss: 0.263036 MB
Stage halos finished: 2020-08-05T19:13:13.932754
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.347 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T19:13:14.005212
PSF sigmas in coadd pixels: ['2.03', '1.79', '3.14']
Using average PSF sigma 2.3186590255216513
Gaussian PSF norm 0.12166290457925892 vs pixelized 0.09195725
average tim pixel scale / coadd scale: 1.7298381279741648
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.79', '2.35', '1.86']
Using average PSF sigma 1.9991835460267497
Gaussian PSF norm 0.14110499875537874 vs pixelized 0.11244203
average tim pixel scale / coadd scale: 1.7294240982150872
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.47', '1.83', '1.44']
Using average PSF sigma 1.5784965751473647
Gaussian PSF norm 0.17871105722705952 vs pixelized 0.14763707
average tim pixel scale / coadd scale: 0.9909494360553399
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.14 s, CPU: 0.13 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 258 MB, VmData: 283 MB, maxrss: 0.2645 MB
Stage fit_on_coadds finished: 2020-08-05T19:13:14.146136
Resources for stage fit_on_coadds : 0.144 s worker CPU, 0.144 s worker Wall, Wall: 0.142 s, Cores in use: 1.95, Total efficiency (on 16 cores): 12.2 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:13:14.157135
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 162 potential peaks
Of 162 potential peaks: 140 in veto map, 2 cut by saddle test, 0 cut by aper test, 20 kept
SED z : 20 new peaks
Found 981 potential peaks
Of 981 potential peaks: 978 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 22 potential peaks
Of 22 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 41 potential peaks
Of 41 potential peaks: 37 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 46 potential peaks
Of 46 potential peaks: 39 in veto map, 5 cut by saddle test, 1 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 26 new sources
Median coadd sky for g : 0.00037336908
Median coadd sky for r : 0.00094256236
Median coadd sky for z : 0.00016701069
Stage srcs : Wall: 0.67 s, CPU: 0.63 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 259 MB, VmData: 283 MB, maxrss: 0.265 MB
Stage srcs finished: 2020-08-05T19:13:14.828365
Resources for stage srcs : 0.084 s worker CPU, 0.084 s worker Wall, Wall: 0.673 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:13:16.015727
Blob 1 of 13, id: 0, sources: 16, size: 165x156, npix 17261, brick X: 74,239, Y: 0,156, one pixel: 109 0
Blob 2 of 13, id: 9, sources: 3, size: 37x41, npix 980, brick X: 0,37, Y: 171,212, one pixel: 4 171
Blob 3 of 13, id: 6, sources: 2, size: 33x45, npix 936, brick X: 206,239, Y: 141,186, one pixel: 232 141
Blob 4 of 13, id: 8, sources: 1, size: 33x32, npix 732, brick X: 124,157, Y: 162,194, one pixel: 137 162
Blob 5 of 13, id: 4, sources: 2, size: 29x42, npix 592, brick X: 33,62, Y: 76,118, one pixel: 46 76
Blob 6 of 13, id: 11, sources: 1, size: 29x25, npix 506, brick X: 165,194, Y: 214,239, one pixel: 176 214
Blob 7 of 13, id: 12, sources: 2, size: 35x21, npix 424, brick X: 49,84, Y: 218,239, one pixel: 74 218
Blob 8 of 13, id: 7, sources: 1, size: 26x25, npix 417, brick X: 48,74, Y: 162,187, one pixel: 58 162
Blob 9 of 13, id: 5, sources: 1, size: 24x24, npix 373, brick X: 58,82, Y: 117,141, one pixel: 68 117
Blob 10 of 13, id: 3, sources: 1, size: 22x21, npix 279, brick X: 28,50, Y: 52,73, one pixel: 36 52
Blob 11 of 13, id: 1, sources: 1, size: 20x20, npix 238, brick X: 35,55, Y: 20,40, one pixel: 43 20
Blob 12 of 13, id: 2, sources: 1, size: 20x20, npix 229, brick X: 15,35, Y: 41,61, one pixel: 24 41
Blob 13 of 13, id: 10, sources: 1, size: 17x18, npix 162, brick X: 86,103, Y: 204,222, one pixel: 94 204
Blob 13 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149168 MB
Blob 10 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149964 MB
Blob 7 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09332 MB
Blob 5 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14956 MB
Blob 12 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092608 MB
Blob 9 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092572 MB
Blob 11 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14988 MB
Blob 6 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149824 MB
Blob 8 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149812 MB
Blob 4 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.094996 MB
Blob 3 finished, total: Wall: 1.32 s, CPU: 1.32 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151072 MB
Blob 2 finished, total: Wall: 1.47 s, CPU: 1.47 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094084 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.55741, 51.59531), pm (-11.3, -7.0), parallax 0.972 with NanoMaggies: g=12, r=11.1, z=10.7
Reset brightness to NanoMaggies: g=12, r=11.1, z=10.7
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.04158, ee1=-0.437362, ee2=-0.33445
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 8.78 s, CPU: 8.73 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.152392 MB
Old catalog: 42
New catalog: 30
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/blobs-custom-282576p51598.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/all-models-custom-282576p51598.fits
Stage fitblobs : Wall: 14.62 s, CPU: 0.61 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 259 MB, VmData: 283 MB, maxrss: 0.265164 MB
Stage fitblobs finished: 2020-08-05T19:13:30.631600
Resources for stage fitblobs : 17.404 s worker CPU, 17.572 s worker Wall, Wall: 14.617 s, Cores in use: 1.23, Total efficiency (on 16 cores): 7.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:13:30.658399
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-resid.jpg
Stage coadds : Wall: 4.40 s, CPU: 1.63 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 259 MB, VmData: 283 MB, maxrss: 0.265488 MB
Stage coadds finished: 2020-08-05T19:13:35.058924
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 9.831 s worker CPU, 20.553 s worker Wall, Wall: 4.402 s, Cores in use: 2.60, Total efficiency (on 16 cores): 16.3 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T19:13:35.073296
Cut to 2 unWISE tiles
Reading WISE tile 2813p514 band 3
Reading WISE tile 2813p514 band 4
Reading WISE tile 2813p514 band 1
Reading WISE tile 2813p514 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.191972 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.209988 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 804 MB, VmRSS: 145 MB, VmData: 172 MB, maxrss: 0.208132 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 806 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.210348 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.54 s, CPU: 0.73 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 260 MB, VmData: 283 MB, maxrss: 0.266 MB
Stage wise_forced finished: 2020-08-05T19:13:40.616788
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 5.989 s worker CPU, 12.674 s worker Wall, Wall: 5.545 s, Cores in use: 1.21, Total efficiency (on 16 cores): 7.6 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:13:40.633148
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/tractor-i/cus/tractor-custom-282576p51598.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/tractor/cus/tractor-custom-282576p51598.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/tractor/cus/brick-custom-282576p51598.sha256sum
Stage writecat : Wall: 1.89 s, CPU: 1.31 s, VmPeak: 1167 MB, VmSize: 1039 MB, VmRSS: 262 MB, VmData: 283 MB, maxrss: 0.39888 MB
Stage writecat finished: 2020-08-05T19:13:42.522135
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.891 s, Cores in use: 0.69, Total efficiency (on 16 cores): 4.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-writecat.p
All done: 39.054 s worker CPU, 85.263 s worker Wall, Wall: 47.678 s, Cores in use: 1.13, Total efficiency (on 16 cores): 7.0 %
Finished galaxy PGC2396739 in 0.865 minutes.
Started working on galaxy PGC2396739 at Wed Aug  5 19:24:15 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.57654149999996 51.5989075 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:24:17.021676
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '282.57654149999996', '51.5989075', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.57654149999996 51.5989075 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 282.57654149999996 51.5989075
Starting process 58017 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 58018 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 58019 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 58020 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 58021 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB
Starting process 58022 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 58023 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 58024 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 58025 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 58026 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 58027 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 58028 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 58029 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 58030 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 58031 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 58032 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 58033 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 58034 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 58035 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 58036 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 58037 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 58038 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 58039 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 58040 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 58041 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 58042 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 58043 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 58045 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 58046 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 58044 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 58047 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 58048 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:24:18.131444
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  k4m_160526_101310_ooi_zd_ls9-CCD4 z expnum 91655 exptime 80.102 propid 2016A-0453 seeing 0.91 MJD 57534.426 object MzLS_655107_z 
    mosaic/CP/V4.3/CP20160525/k4m_160526_101310_ooi_zd_ls9.fits.fz
  k4m_170910_071910_ooi_zd_ls9-CCD1 z expnum 139007 exptime 215.103 propid 2016A-0453 seeing 1.12 MJD 58006.305 object MzLS_656672_z 
    mosaic/CP/V4.3/CP20170909/k4m_170910_071910_ooi_zd_ls9.fits.fz
  k4m_160528_100637_ooi_zd_ls9-CCD4 z expnum 92017 exptime 80.103 propid 2016A-0453 seeing 0.89 MJD 57536.421 object MzLS_655890_z 
    mosaic/CP/V4.3/CP20160527/k4m_160528_100637_ooi_zd_ls9.fits.fz
  ksb_180519_092333_ooi_g_ls9-CCD4 g expnum 82570172 exptime 89.9 propid NOTBASS seeing 1.25 MJD 58257.391 object 29521 
    90prime/CP/V2.3/CP20180518/ksb_180519_092333_ooi_g_ls9.fits.fz
  ksb_170405_120720_ooi_r_ls9-CCD4 r expnum 78480198 exptime 133.666 propid BASS seeing 1.10 MJD 57848.505 object 29521 
    90prime/CP/V2.3/CP20170404/ksb_170405_120720_ooi_r_ls9.fits.fz
  ksb_160704_093744_ooi_g_ls9-CCD3 g expnum 75730161 exptime 101.3 propid BASS seeing 1.10 MJD 57573.401 object 28392 
    90prime/CP/V2.3/CP20160703/ksb_160704_093744_ooi_g_ls9.fits.fz
  ksb_160712_072426_ooi_r_ls9-CCD3 r expnum 75810096 exptime 98.3 propid BASS seeing 1.44 MJD 57581.309 object 28392 
    90prime/CP/V2.3/CP20160711/ksb_160712_072426_ooi_r_ls9.fits.fz
  ksb_160709_101035_ooi_g_ls9-CCD2 g expnum 75780121 exptime 155.8 propid BASS seeing 1.93 MJD 57578.424 object 29523 
    90prime/CP/V2.3/CP20160708/ksb_160709_101035_ooi_g_ls9.fits.fz
  ksb_170624_071521_ooi_r_ls9-CCD2 r expnum 79280097 exptime 74.905 propid BASS seeing 1.15 MJD 57928.302 object 29523 
    90prime/CP/V2.3/CP20170623/ksb_170624_071521_ooi_r_ls9.fits.fz
Faked up EXPNUM 75810096
Faked up EXPNUM 75810096
Faked up EXPNUM 75810096
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1281 1421 and amp range 0 2015 and image y 2314 2454 and amp range 2048 4095
Range in image: x 0 141 , y 0 141 (with image size 141 x 141)
dzp -0.011545347 -> scaling image by 0.9894226798649194
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75730161
Faked up EXPNUM 75730161
Faked up EXPNUM 75730161
90prime get_fwhm: self.fwhm = 2.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1283 1422 and amp range 0 2015 and image y 2298 2438 and amp range 2048 4095
Range in image: x 0 140 , y 0 141 (with image size 140 x 141)
dzp -0.0045482004 -> scaling image by 0.9958197144381092
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3480 3728 and amp range 2048 4095 and image y 1556 1799 and amp range 0 2021
Range in image: x 0 249 , y 0 244 (with image size 249 x 244)
dzp -0.0006399284 -> scaling image by 0.9994107778325068
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 82570172
Faked up EXPNUM 82570172
Faked up EXPNUM 82570172
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3063 3203 and amp range 2016 4031 and image y 1518 1657 and amp range 0 2047
Range in image: x 0 141 , y 0 140 (with image size 141 x 140)
dzp 0.023266561 -> scaling image by 1.0216605511853067
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2324 2566 and amp range 2006 4053 and image y 3225 3466 and amp range 2040 4078
Range in image: x 0 243 , y 0 242 (with image size 243 x 242)
dzp 0.0036595785 -> scaling image by 1.003376283213225
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79280097
Faked up EXPNUM 79280097
Faked up EXPNUM 79280097
90prime get_fwhm: self.fwhm = 2.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1040 1179 and amp range 0 2015 and image y 4039 4080 and amp range 2048 4095
Range in image: x 0 140 , y 0 42 (with image size 140 x 42)
dzp 0.05525464 -> scaling image by 1.0522086198429996
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78480198
Faked up EXPNUM 78480198
Faked up EXPNUM 78480198
90prime get_fwhm: self.fwhm = 2.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3060 3200 and amp range 2016 4031 and image y 1584 1722 and amp range 0 2047
Range in image: x 0 141 , y 0 139 (with image size 141 x 139)
dzp 0.02499258 -> scaling image by 1.0232859986636875
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75780121
Faked up EXPNUM 75780121
Faked up EXPNUM 75780121
90prime get_fwhm: self.fwhm = 4.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1052 1191 and amp range 0 2015 and image y 4028 4080 and amp range 2048 4095
Range in image: x 0 140 , y 0 53 (with image size 140 x 53)
dzp 0.01693853 -> scaling image by 1.015723292931903
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 750 990 and amp range 0 2047 and image y 0 238 and amp range 0 2021
Range in image: x 0 241 , y 0 239 (with image size 241 x 239)
dzp 0.005139143 -> scaling image by 1.0047445456970268
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 14.01 s, CPU: 1.14 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 174 MB, VmData: 206 MB, maxrss: 0.178292 MB
Stage tims finished: 2020-08-05T19:24:32.136358
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 4.608 s worker CPU, 42.383 s worker Wall, Wall: 14.008 s, Cores in use: 0.41, Total efficiency (on 32 cores): 1.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:24:38.742420
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01381.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01278.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/reference-custom-282576p51598.fits
Stage refs : Wall: 10.61 s, CPU: 6.87 s, VmPeak: 1032 MB, VmSize: 1026 MB, VmRSS: 245 MB, VmData: 275 MB, maxrss: 0.251048 MB
Stage refs finished: 2020-08-05T19:24:49.354203
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 10.614 s, Cores in use: 0.65, Total efficiency (on 32 cores): 2.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:24:49.440772
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outlier-mask-custom-282576p51598.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outliers-pre-custom-282576p51598.jpg
Image ksb_160709_101035_ooi_g_ls9-CCD2 g : masking 116 positive outlier pixels and 0 negative outlier pixels
Image ksb_180519_092333_ooi_g_ls9-CCD4 g : masking 69 positive outlier pixels and 0 negative outlier pixels
Image ksb_160712_072426_ooi_r_ls9-CCD3 r : masking 286 positive outlier pixels and 0 negative outlier pixels
Image k4m_170910_071910_ooi_zd_ls9-CCD1 z : masking 177 positive outlier pixels and 0 negative outlier pixels
Image k4m_160528_100637_ooi_zd_ls9-CCD4 z : masking 1114 positive outlier pixels and 360 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outlier-mask-custom-282576p51598.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outliers-post-custom-282576p51598.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outliers-masked-pos-custom-282576p51598.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/outliers-masked-neg-custom-282576p51598.jpg
Stage outliers : Wall: 1.45 s, CPU: 1.02 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 257 MB, VmData: 284 MB, maxrss: 0.263336 MB
Stage outliers finished: 2020-08-05T19:24:50.887328
Resources for stage outliers : 0.734 s worker CPU, 1.076 s worker Wall, Wall: 1.449 s, Cores in use: 1.21, Total efficiency (on 32 cores): 3.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:24:50.909036
Stage halos : Wall: 0.58 s, CPU: 0.57 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 257 MB, VmData: 284 MB, maxrss: 0.263676 MB
Stage halos finished: 2020-08-05T19:24:51.488589
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.582 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T19:24:51.512926
PSF sigmas in coadd pixels: ['2.03', '1.79', '3.14']
Using average PSF sigma 2.3186590255216513
Gaussian PSF norm 0.12166290457925892 vs pixelized 0.09195725
average tim pixel scale / coadd scale: 1.7298381279741648
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.79', '2.35', '1.86']
Using average PSF sigma 1.9991835460267497
Gaussian PSF norm 0.14110499875537874 vs pixelized 0.11244203
average tim pixel scale / coadd scale: 1.7294240982150872
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.47', '1.83', '1.44']
Using average PSF sigma 1.5784965751473647
Gaussian PSF norm 0.17871105722705952 vs pixelized 0.14763707
average tim pixel scale / coadd scale: 0.9909494360553399
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.12 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 259 MB, VmData: 284 MB, maxrss: 0.265156 MB
Stage fit_on_coadds finished: 2020-08-05T19:24:51.658427
Resources for stage fit_on_coadds : 0.130 s worker CPU, 0.162 s worker Wall, Wall: 0.148 s, Cores in use: 1.74, Total efficiency (on 32 cores): 5.4 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:24:51.671608
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 162 potential peaks
Of 162 potential peaks: 140 in veto map, 2 cut by saddle test, 0 cut by aper test, 20 kept
SED z : 20 new peaks
Found 981 potential peaks
Of 981 potential peaks: 978 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 22 potential peaks
Of 22 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 41 potential peaks
Of 41 potential peaks: 37 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 46 potential peaks
Of 46 potential peaks: 39 in veto map, 5 cut by saddle test, 1 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 26 new sources
Median coadd sky for g : 0.00037336908
Median coadd sky for r : 0.00094256236
Median coadd sky for z : 0.00016701069
Stage srcs : Wall: 0.87 s, CPU: 0.77 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 259 MB, VmData: 284 MB, maxrss: 0.265656 MB
Stage srcs finished: 2020-08-05T19:24:52.543624
Resources for stage srcs : 0.109 s worker CPU, 0.162 s worker Wall, Wall: 0.875 s, Cores in use: 1.01, Total efficiency (on 32 cores): 3.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:24:52.561520
Blob 1 of 13, id: 0, sources: 16, size: 165x156, npix 17261, brick X: 74,239, Y: 0,156, one pixel: 109 0
Blob 2 of 13, id: 9, sources: 3, size: 37x41, npix 980, brick X: 0,37, Y: 171,212, one pixel: 4 171
Blob 3 of 13, id: 6, sources: 2, size: 33x45, npix 936, brick X: 206,239, Y: 141,186, one pixel: 232 141
Blob 4 of 13, id: 8, sources: 1, size: 33x32, npix 732, brick X: 124,157, Y: 162,194, one pixel: 137 162
Blob 5 of 13, id: 4, sources: 2, size: 29x42, npix 592, brick X: 33,62, Y: 76,118, one pixel: 46 76
Blob 6 of 13, id: 11, sources: 1, size: 29x25, npix 506, brick X: 165,194, Y: 214,239, one pixel: 176 214
Blob 7 of 13, id: 12, sources: 2, size: 35x21, npix 424, brick X: 49,84, Y: 218,239, one pixel: 74 218
Blob 8 of 13, id: 7, sources: 1, size: 26x25, npix 417, brick X: 48,74, Y: 162,187, one pixel: 58 162
Blob 9 of 13, id: 5, sources: 1, size: 24x24, npix 373, brick X: 58,82, Y: 117,141, one pixel: 68 117
Blob 10 of 13, id: 3, sources: 1, size: 22x21, npix 279, brick X: 28,50, Y: 52,73, one pixel: 36 52
Blob 11 of 13, id: 1, sources: 1, size: 20x20, npix 238, brick X: 35,55, Y: 20,40, one pixel: 43 20
Blob 12 of 13, id: 2, sources: 1, size: 20x20, npix 229, brick X: 15,35, Y: 41,61, one pixel: 24 41
Blob 13 of 13, id: 10, sources: 1, size: 17x18, npix 162, brick X: 86,103, Y: 204,222, one pixel: 94 204
Blob 13 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.087404 MB
Blob 10 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093408 MB
Blob 9 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091864 MB
Blob 7 finished, total: Wall: 0.37 s, CPU: 0.36 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092388 MB
Blob 11 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094224 MB
Blob 12 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093356 MB
Blob 5 finished, total: Wall: 0.49 s, CPU: 0.48 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148984 MB
Blob 6 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.0933 MB
Blob 8 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.09376 MB
Blob 4 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149184 MB
Blob 2 finished, total: Wall: 1.32 s, CPU: 1.32 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150172 MB
Blob 3 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095024 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.55741, 51.59531), pm (-11.3, -7.0), parallax 0.972 with NanoMaggies: g=12, r=11.1, z=10.7
Reset brightness to NanoMaggies: g=12, r=11.1, z=10.7
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.04158, ee1=-0.437362, ee2=-0.33445
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 9.20 s, CPU: 9.20 s, VmPeak: 687 MB, VmSize: 682 MB, VmRSS: 108 MB, VmData: 153 MB, maxrss: 0.113156 MB
Old catalog: 42
New catalog: 30
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/blobs-custom-282576p51598.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/metrics/cus/all-models-custom-282576p51598.fits
Stage fitblobs : Wall: 12.19 s, CPU: 0.92 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 260 MB, VmData: 284 MB, maxrss: 0.26582 MB
Stage fitblobs finished: 2020-08-05T19:25:04.749063
Resources for stage fitblobs : 16.618 s worker CPU, 16.702 s worker Wall, Wall: 12.190 s, Cores in use: 1.44, Total efficiency (on 32 cores): 4.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:25:04.795699
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-resid.jpg
Stage coadds : Wall: 4.59 s, CPU: 0.65 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 260 MB, VmData: 284 MB, maxrss: 0.266144 MB
Stage coadds finished: 2020-08-05T19:25:09.390224
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 29.479 s worker CPU, 81.991 s worker Wall, Wall: 4.597 s, Cores in use: 6.55, Total efficiency (on 32 cores): 20.5 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:25:09.410623
Cut to 2 unWISE tiles
Reading WISE tile 2813p514 band 3
Reading WISE tile 2813p514 band 4
Reading WISE tile 2813p514 band 2
Reading WISE tile 2813p514 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 811 MB, VmSize: 811 MB, VmRSS: 151 MB, VmData: 179 MB, maxrss: 0.189804 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 810 MB, VmSize: 799 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.201852 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 799 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.201924 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210036 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/tmp-legacysurvey-custom-282576p51598-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.66 s, CPU: 1.10 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 260 MB, VmData: 284 MB, maxrss: 0.266656 MB
Stage wise_forced finished: 2020-08-05T19:25:14.075083
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 6.354 s worker CPU, 10.178 s worker Wall, Wall: 4.667 s, Cores in use: 1.60, Total efficiency (on 32 cores): 5.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T19:25:14.090605
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/coadd/cus/custom-282576p51598/legacysurvey-custom-282576p51598-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/tractor-i/cus/tractor-custom-282576p51598.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/tractor/cus/tractor-custom-282576p51598.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/tractor/cus/brick-custom-282576p51598.sha256sum
Stage writecat : Wall: 1.16 s, CPU: 0.89 s, VmPeak: 1168 MB, VmSize: 1040 MB, VmRSS: 262 MB, VmData: 284 MB, maxrss: 0.399536 MB
Stage writecat finished: 2020-08-05T19:25:15.255148
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.167 s, Cores in use: 0.76, Total efficiency (on 32 cores): 2.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2396739/PGC2396739-largegalaxy-writecat.p
All done: 58.039 s worker CPU, 152.663 s worker Wall, Wall: 57.150 s, Cores in use: 1.26, Total efficiency (on 32 cores): 4.0 %
Finished galaxy PGC2396739 in 1.008 minutes.
Started working on galaxy PGC2396739 at Fri Aug  7 09:16:52 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.5758568640306 51.59891712048298 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T09:16:54.555115
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '282.5758568640306', '51.59891712048298', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.5758568640306 51.59891712048298 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 282.5758568640306 51.59891712048298
Starting process 32023 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 32025 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 32027 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 32029 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 32031 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059324 MB
Starting process 32033 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 32035 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 32037 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 32039 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 32041 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 32043 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 32045 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 32047 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 32049 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 32051 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 32053 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T09:16:57.098422
Keeping 9 CCDs:
  k4m_160526_101310_ooi_zd_ls9-CCD4 z expnum 91655 exptime 80.102 propid 2016A-0453 seeing 0.91 MJD 57534.426 object MzLS_655107_z 
    mosaic/CP/V4.3/CP20160525/k4m_160526_101310_ooi_zd_ls9.fits.fz
  k4m_170910_071910_ooi_zd_ls9-CCD1 z expnum 139007 exptime 215.103 propid 2016A-0453 seeing 1.12 MJD 58006.305 object MzLS_656672_z 
    mosaic/CP/V4.3/CP20170909/k4m_170910_071910_ooi_zd_ls9.fits.fz
  k4m_160528_100637_ooi_zd_ls9-CCD4 z expnum 92017 exptime 80.103 propid 2016A-0453 seeing 0.89 MJD 57536.421 object MzLS_655890_z 
    mosaic/CP/V4.3/CP20160527/k4m_160528_100637_ooi_zd_ls9.fits.fz
  ksb_180519_092333_ooi_g_ls9-CCD4 g expnum 82570172 exptime 89.9 propid NOTBASS seeing 1.25 MJD 58257.391 object 29521 
    90prime/CP/V2.3/CP20180518/ksb_180519_092333_ooi_g_ls9.fits.fz
  ksb_170405_120720_ooi_r_ls9-CCD4 r expnum 78480198 exptime 133.666 propid BASS seeing 1.10 MJD 57848.505 object 29521 
    90prime/CP/V2.3/CP20170404/ksb_170405_120720_ooi_r_ls9.fits.fz
  ksb_160704_093744_ooi_g_ls9-CCD3 g expnum 75730161 exptime 101.3 propid BASS seeing 1.10 MJD 57573.401 object 28392 
    90prime/CP/V2.3/CP20160703/ksb_160704_093744_ooi_g_ls9.fits.fz
  ksb_160712_072426_ooi_r_ls9-CCD3 r expnum 75810096 exptime 98.3 propid BASS seeing 1.44 MJD 57581.309 object 28392 
    90prime/CP/V2.3/CP20160711/ksb_160712_072426_ooi_r_ls9.fits.fz
  ksb_160709_101035_ooi_g_ls9-CCD2 g expnum 75780121 exptime 155.8 propid BASS seeing 1.93 MJD 57578.424 object 29523 
    90prime/CP/V2.3/CP20160708/ksb_160709_101035_ooi_g_ls9.fits.fz
  ksb_170624_071521_ooi_r_ls9-CCD2 r expnum 79280097 exptime 74.905 propid BASS seeing 1.15 MJD 57928.302 object 29523 
    90prime/CP/V2.3/CP20170623/ksb_170624_071521_ooi_r_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3480 3728 and amp range 2048 4095 and image y 1550 1793 and amp range 0 2021
Range in image: x 0 249 , y 0 244 (with image size 249 x 244)
dzp -0.0006399284 -> scaling image by 0.9994107778325068
mosaic get_fwhm: self.fwhm = 4.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2324 2566 and amp range 2006 4053 and image y 3220 3460 and amp range 2040 4078
Range in image: x 0 243 , y 0 241 (with image size 243 x 241)
dzp 0.0036595785 -> scaling image by 1.003376283213225
mosaic get_fwhm: self.fwhm = 3.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 750 990 and amp range 0 2047 and image y 0 232 and amp range 0 2021
Range in image: x 0 241 , y 0 233 (with image size 241 x 233)
dzp 0.005139143 -> scaling image by 1.0047445456970268
Faked up EXPNUM 75730161
Faked up EXPNUM 75730161
Faked up EXPNUM 75730161
90prime get_fwhm: self.fwhm = 2.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1283 1422 and amp range 0 2015 and image y 2302 2441 and amp range 2048 4095
Range in image: x 0 140 , y 0 140 (with image size 140 x 140)
dzp -0.0045482004 -> scaling image by 0.9958197144381092
Faked up EXPNUM 75780121
Faked up EXPNUM 75780121
Faked up EXPNUM 75780121
90prime get_fwhm: self.fwhm = 4.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1052 1191 and amp range 0 2015 and image y 4031 4080 and amp range 2048 4095
Range in image: x 0 140 , y 0 50 (with image size 140 x 50)
dzp 0.01693853 -> scaling image by 1.015723292931903
Faked up EXPNUM 82570172
Faked up EXPNUM 82570172
Faked up EXPNUM 82570172
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3063 3203 and amp range 2016 4031 and image y 1521 1661 and amp range 0 2047
Range in image: x 0 141 , y 0 141 (with image size 141 x 141)
dzp 0.023266561 -> scaling image by 1.0216605511853067
Faked up EXPNUM 79280097
Faked up EXPNUM 79280097
Faked up EXPNUM 79280097
90prime get_fwhm: self.fwhm = 2.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1040 1179 and amp range 0 2015 and image y 4042 4080 and amp range 2048 4095
Range in image: x 0 140 , y 0 39 (with image size 140 x 39)
dzp 0.05525464 -> scaling image by 1.0522086198429996
Faked up EXPNUM 78480198
Faked up EXPNUM 78480198
Faked up EXPNUM 78480198
90prime get_fwhm: self.fwhm = 2.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3060 3200 and amp range 2016 4031 and image y 1587 1726 and amp range 0 2047
Range in image: x 0 141 , y 0 140 (with image size 141 x 140)
dzp 0.02499258 -> scaling image by 1.0232859986636875
Faked up EXPNUM 75810096
Faked up EXPNUM 75810096
Faked up EXPNUM 75810096
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1281 1421 and amp range 0 2015 and image y 2318 2457 and amp range 2048 4095
Range in image: x 0 141 , y 0 140 (with image size 141 x 140)
dzp -0.011545347 -> scaling image by 0.9894226798649194
Stage tims : Wall: 70.35 s, CPU: 2.64 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.17556 MB
Stage tims finished: 2020-08-07T09:18:07.444371
Resources for stage tims : 4.302 s worker CPU, 430.252 s worker Wall, Wall: 70.348 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T09:18:10.879591
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01381.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01278.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/reference-custom-282575p51598.fits
Stage refs : Wall: 10.48 s, CPU: 6.05 s, VmPeak: 1025 MB, VmSize: 1020 MB, VmRSS: 243 MB, VmData: 274 MB, maxrss: 0.24838 MB
Stage refs finished: 2020-08-07T09:18:21.363499
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.486 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.6 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T09:18:21.469340
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outlier-mask-custom-282575p51598.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outliers-pre-custom-282575p51598.jpg
Image ksb_180519_092333_ooi_g_ls9-CCD4 g : masking 67 positive outlier pixels and 0 negative outlier pixels
Image ksb_160712_072426_ooi_r_ls9-CCD3 r : masking 186 positive outlier pixels and 0 negative outlier pixels
Image k4m_170910_071910_ooi_zd_ls9-CCD1 z : masking 93 positive outlier pixels and 0 negative outlier pixels
Image k4m_160528_100637_ooi_zd_ls9-CCD4 z : masking 1116 positive outlier pixels and 343 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outlier-mask-custom-282575p51598.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outliers-post-custom-282575p51598.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outliers-masked-pos-custom-282575p51598.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outliers-masked-neg-custom-282575p51598.jpg
Stage outliers : Wall: 0.85 s, CPU: 0.62 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 254 MB, VmData: 283 MB, maxrss: 0.260468 MB
Stage outliers finished: 2020-08-07T09:18:22.314684
Resources for stage outliers : 0.612 s worker CPU, 0.689 s worker Wall, Wall: 0.847 s, Cores in use: 1.46, Total efficiency (on 16 cores): 9.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T09:18:22.457336
Stage halos : Wall: 0.29 s, CPU: 0.28 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 255 MB, VmData: 283 MB, maxrss: 0.260716 MB
Stage halos finished: 2020-08-07T09:18:22.751168
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.295 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T09:18:22.931064
PSF sigmas in coadd pixels: ['2.03', '1.79', '3.14']
Using average PSF sigma 2.3186590255216513
Gaussian PSF norm 0.12166290457925892 vs pixelized 0.09195312
average tim pixel scale / coadd scale: 1.7298381279741648
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.79', '2.35', '1.86']
Using average PSF sigma 1.9991835460267497
Gaussian PSF norm 0.14110499875537874 vs pixelized 0.112444244
average tim pixel scale / coadd scale: 1.7294240982150872
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.47', '1.83', '1.44']
Using average PSF sigma 1.5784965751473647
Gaussian PSF norm 0.17871105722705952 vs pixelized 0.147641
average tim pixel scale / coadd scale: 0.9909494360553399
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.12 s, CPU: 0.12 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.26218 MB
Stage fit_on_coadds finished: 2020-08-07T09:18:23.055637
Resources for stage fit_on_coadds : 0.132 s worker CPU, 0.132 s worker Wall, Wall: 0.126 s, Cores in use: 1.99, Total efficiency (on 16 cores): 12.4 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T09:18:23.070154
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 187 potential peaks
Of 187 potential peaks: 167 in veto map, 2 cut by saddle test, 0 cut by aper test, 18 kept
SED z : 18 new peaks
Found 1087 potential peaks
Of 1087 potential peaks: 1084 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 24 potential peaks
Of 24 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 43 potential peaks
Of 43 potential peaks: 39 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 48 potential peaks
Of 48 potential peaks: 41 in veto map, 5 cut by saddle test, 1 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 24 new sources
Median coadd sky for g : 0.00037450244
Median coadd sky for r : 0.0009814464
Median coadd sky for z : 0.00024247314
Stage srcs : Wall: 0.62 s, CPU: 0.58 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 257 MB, VmData: 283 MB, maxrss: 0.262668 MB
Stage srcs finished: 2020-08-07T09:18:23.689336
Resources for stage srcs : 0.081 s worker CPU, 0.097 s worker Wall, Wall: 0.620 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T09:18:23.700332
Blob 1 of 13, id: 0, sources: 16, size: 170x156, npix 18026, brick X: 69,239, Y: 0,156, one pixel: 103 0
Blob 2 of 13, id: 6, sources: 2, size: 39x46, npix 1180, brick X: 200,239, Y: 139,185, one pixel: 227 139
Blob 3 of 13, id: 8, sources: 1, size: 33x33, npix 734, brick X: 118,151, Y: 161,194, one pixel: 134 161
Blob 4 of 13, id: 9, sources: 2, size: 31x38, npix 710, brick X: 0,31, Y: 173,211, one pixel: 15 173
Blob 5 of 13, id: 4, sources: 2, size: 29x42, npix 600, brick X: 27,56, Y: 76,118, one pixel: 39 76
Blob 6 of 13, id: 11, sources: 1, size: 29x25, npix 497, brick X: 159,188, Y: 214,239, one pixel: 170 214
Blob 7 of 13, id: 7, sources: 1, size: 27x26, npix 430, brick X: 42,69, Y: 161,187, one pixel: 54 161
Blob 8 of 13, id: 12, sources: 2, size: 35x21, npix 426, brick X: 43,78, Y: 218,239, one pixel: 68 218
Blob 9 of 13, id: 5, sources: 1, size: 25x24, npix 366, brick X: 52,77, Y: 117,141, one pixel: 62 117
Blob 10 of 13, id: 3, sources: 1, size: 22x22, npix 263, brick X: 22,44, Y: 51,73, one pixel: 32 51
Blob 11 of 13, id: 1, sources: 1, size: 21x19, npix 237, brick X: 29,50, Y: 20,39, one pixel: 37 20
Blob 12 of 13, id: 2, sources: 1, size: 20x20, npix 228, brick X: 9,29, Y: 41,61, one pixel: 18 41
Blob 13 of 13, id: 10, sources: 1, size: 17x18, npix 162, brick X: 80,97, Y: 204,222, one pixel: 88 204
Blob 13 finished, total: Wall: 0.18 s, CPU: 0.09 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.087424 MB
Blob 12 finished, total: Wall: 0.45 s, CPU: 0.37 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09414 MB
Blob 8 finished, total: Wall: 0.60 s, CPU: 0.52 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.1454 MB
Blob 9 finished, total: Wall: 0.66 s, CPU: 0.57 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.093956 MB
Blob 11 finished, total: Wall: 0.67 s, CPU: 0.58 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093172 MB
Blob 10 finished, total: Wall: 0.74 s, CPU: 0.66 s, VmPeak: 806 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145304 MB
Blob 5 finished, total: Wall: 0.87 s, CPU: 0.78 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092612 MB
Blob 4 finished, total: Wall: 0.92 s, CPU: 0.84 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145884 MB
Blob 7 finished, total: Wall: 0.93 s, CPU: 0.86 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145784 MB
Blob 6 finished, total: Wall: 0.98 s, CPU: 0.89 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.0925 MB
Blob 3 finished, total: Wall: 1.07 s, CPU: 0.98 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092396 MB
Blob 2 finished, total: Wall: 1.24 s, CPU: 1.14 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14698 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.55741, 51.59531), pm (-11.3, -7.0), parallax 0.972 with NanoMaggies: g=12, r=11.1, z=10.7
Reset brightness to NanoMaggies: g=12, r=11.1, z=10.7
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.525799, ee1=-0.394889, ee2=-0.27337
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.56275, 51.58656), pm (-0.6, -2.6), parallax 0.221 with NanoMaggies: g=18.3, r=17.7, z=17.4
Reset brightness to NanoMaggies: g=18.3, r=17.7, z=17.4
Measuring 3 iterative sources
Blob 1 finished, total: Wall: 8.57 s, CPU: 8.52 s, VmPeak: 813 MB, VmSize: 729 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.14942 MB
Old catalog: 39
New catalog: 31
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/blobs-custom-282575p51598.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/all-models-custom-282575p51598.fits
Stage fitblobs : Wall: 9.06 s, CPU: 0.45 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 257 MB, VmData: 283 MB, maxrss: 0.262832 MB
Stage fitblobs finished: 2020-08-07T09:18:32.762439
Resources for stage fitblobs : 16.993 s worker CPU, 18.434 s worker Wall, Wall: 9.063 s, Cores in use: 1.93, Total efficiency (on 16 cores): 12.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T09:18:32.775038
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-resid.jpg
Stage coadds : Wall: 1.78 s, CPU: 0.62 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 257 MB, VmData: 283 MB, maxrss: 0.26322 MB
Stage coadds finished: 2020-08-07T09:18:34.558156
Resources for stage coadds : 9.029 s worker CPU, 9.787 s worker Wall, Wall: 1.784 s, Cores in use: 5.41, Total efficiency (on 16 cores): 33.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T09:18:34.569860
Cut to 2 unWISE tiles
Reading WISE tile 2813p514 band 1
Reading WISE tile 2813p514 band 2
Reading WISE tile 2813p514 band 3
Reading WISE tile 2813p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.18 s, CPU: 0.12 s, VmPeak: 806 MB, VmSize: 800 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206744 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 806 MB, VmRSS: 150 MB, VmData: 180 MB, maxrss: 0.207456 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 807 MB, VmSize: 806 MB, VmRSS: 151 MB, VmData: 180 MB, maxrss: 0.19142 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 798 MB, VmRSS: 142 MB, VmData: 172 MB, maxrss: 0.204616 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 27.22 s, CPU: 0.47 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 258 MB, VmData: 283 MB, maxrss: 0.263732 MB
Stage wise_forced finished: 2020-08-07T09:19:01.794195
Resources for stage wise_forced : 5.657 s worker CPU, 62.620 s worker Wall, Wall: 27.226 s, Cores in use: 0.23, Total efficiency (on 16 cores): 1.4 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T09:19:01.807560
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/tractor-i/cus/tractor-custom-282575p51598.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/tractor/cus/tractor-custom-282575p51598.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/tractor/cus/brick-custom-282575p51598.sha256sum
Stage writecat : Wall: 0.71 s, CPU: 0.56 s, VmPeak: 1161 MB, VmSize: 1033 MB, VmRSS: 259 MB, VmData: 283 MB, maxrss: 0.396596 MB
Stage writecat finished: 2020-08-07T09:19:02.514815
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.709 s, Cores in use: 0.79, Total efficiency (on 16 cores): 4.9 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-writecat.p
All done: 36.809 s worker CPU, 522.015 s worker Wall, Wall: 125.434 s, Cores in use: 0.39, Total efficiency (on 16 cores): 2.5 %
Finished galaxy PGC2396739 in 2.173 minutes.
Started working on galaxy PGC2396739 at Thu Aug 13 13:28:30 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.5758568640306 51.59891712048298 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-13T13:28:30.775179
legacypipe git version: DR9.5.11-watershed-9-g82106209
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '282.5758568640306', '51.59891712048298', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.5758568640306 51.59891712048298 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 282.5758568640306 51.59891712048298
Starting process 37253 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 37254 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 37255 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 37256 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 37257 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 37258 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 37259 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 37260 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 37261 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 37262 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 37263 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 37264 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 37265 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 37266 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 37267 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 37268 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 37269 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 37270 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 37271 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 37272 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 37273 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 37274 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 37275 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 37276 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 37277 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 37278 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 37279 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 37280 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 37281 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 37282 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 37283 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 37284 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-13T13:28:31.229778
Keeping 9 CCDs:
  k4m_160526_101310_ooi_zd_ls9-CCD4 z expnum 91655 exptime 80.102 propid 2016A-0453 seeing 0.91 MJD 57534.426 object MzLS_655107_z 
    mosaic/CP/V4.3/CP20160525/k4m_160526_101310_ooi_zd_ls9.fits.fz
  k4m_170910_071910_ooi_zd_ls9-CCD1 z expnum 139007 exptime 215.103 propid 2016A-0453 seeing 1.12 MJD 58006.305 object MzLS_656672_z 
    mosaic/CP/V4.3/CP20170909/k4m_170910_071910_ooi_zd_ls9.fits.fz
  k4m_160528_100637_ooi_zd_ls9-CCD4 z expnum 92017 exptime 80.103 propid 2016A-0453 seeing 0.89 MJD 57536.421 object MzLS_655890_z 
    mosaic/CP/V4.3/CP20160527/k4m_160528_100637_ooi_zd_ls9.fits.fz
  ksb_180519_092333_ooi_g_ls9-CCD4 g expnum 82570172 exptime 89.9 propid NOTBASS seeing 1.25 MJD 58257.391 object 29521 
    90prime/CP/V2.3/CP20180518/ksb_180519_092333_ooi_g_ls9.fits.fz
  ksb_170405_120720_ooi_r_ls9-CCD4 r expnum 78480198 exptime 133.666 propid BASS seeing 1.10 MJD 57848.505 object 29521 
    90prime/CP/V2.3/CP20170404/ksb_170405_120720_ooi_r_ls9.fits.fz
  ksb_160704_093744_ooi_g_ls9-CCD3 g expnum 75730161 exptime 101.3 propid BASS seeing 1.10 MJD 57573.401 object 28392 
    90prime/CP/V2.3/CP20160703/ksb_160704_093744_ooi_g_ls9.fits.fz
  ksb_160712_072426_ooi_r_ls9-CCD3 r expnum 75810096 exptime 98.3 propid BASS seeing 1.44 MJD 57581.309 object 28392 
    90prime/CP/V2.3/CP20160711/ksb_160712_072426_ooi_r_ls9.fits.fz
  ksb_160709_101035_ooi_g_ls9-CCD2 g expnum 75780121 exptime 155.8 propid BASS seeing 1.93 MJD 57578.424 object 29523 
    90prime/CP/V2.3/CP20160708/ksb_160709_101035_ooi_g_ls9.fits.fz
  ksb_170624_071521_ooi_r_ls9-CCD2 r expnum 79280097 exptime 74.905 propid BASS seeing 1.15 MJD 57928.302 object 29523 
    90prime/CP/V2.3/CP20170623/ksb_170624_071521_ooi_r_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 4.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2324 2566 and amp range 2006 4053 and image y 3220 3460 and amp range 2040 4078
Range in image: x 0 243 , y 0 241 (with image size 243 x 241)
dzp 0.0036595785 -> scaling image by 1.003376283213225
mosaic get_fwhm: self.fwhm = 3.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 750 990 and amp range 0 2047 and image y 0 232 and amp range 0 2021
Range in image: x 0 241 , y 0 233 (with image size 241 x 233)
dzp 0.005139143 -> scaling image by 1.0047445456970268
Faked up EXPNUM 78480198
Faked up EXPNUM 78480198
Faked up EXPNUM 78480198
90prime get_fwhm: self.fwhm = 2.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3060 3200 and amp range 2016 4031 and image y 1587 1726 and amp range 0 2047
Range in image: x 0 141 , y 0 140 (with image size 141 x 140)
dzp 0.02499258 -> scaling image by 1.0232859986636875
Faked up EXPNUM 79280097
Faked up EXPNUM 79280097
Faked up EXPNUM 79280097
90prime get_fwhm: self.fwhm = 2.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1040 1179 and amp range 0 2015 and image y 4042 4080 and amp range 2048 4095
Range in image: x 0 140 , y 0 39 (with image size 140 x 39)
dzp 0.05525464 -> scaling image by 1.0522086198429996
Faked up EXPNUM 82570172
Faked up EXPNUM 82570172
Faked up EXPNUM 82570172
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3063 3203 and amp range 2016 4031 and image y 1521 1661 and amp range 0 2047
Range in image: x 0 141 , y 0 141 (with image size 141 x 141)
dzp 0.023266561 -> scaling image by 1.0216605511853067
Faked up EXPNUM 75780121
Faked up EXPNUM 75780121
Faked up EXPNUM 75780121
90prime get_fwhm: self.fwhm = 4.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1052 1191 and amp range 0 2015 and image y 4031 4080 and amp range 2048 4095
Range in image: x 0 140 , y 0 50 (with image size 140 x 50)
dzp 0.01693853 -> scaling image by 1.015723292931903
Faked up EXPNUM 75810096
Faked up EXPNUM 75810096
Faked up EXPNUM 75810096
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1281 1421 and amp range 0 2015 and image y 2318 2457 and amp range 2048 4095
Range in image: x 0 141 , y 0 140 (with image size 141 x 140)
dzp -0.011545347 -> scaling image by 0.9894226798649194
Faked up EXPNUM 75730161
Faked up EXPNUM 75730161
Faked up EXPNUM 75730161
90prime get_fwhm: self.fwhm = 2.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1283 1422 and amp range 0 2015 and image y 2302 2441 and amp range 2048 4095
Range in image: x 0 140 , y 0 140 (with image size 140 x 140)
dzp -0.0045482004 -> scaling image by 0.9958197144381092
mosaic get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3480 3728 and amp range 2048 4095 and image y 1550 1793 and amp range 0 2021
Range in image: x 0 249 , y 0 244 (with image size 249 x 244)
dzp -0.0006399284 -> scaling image by 0.9994107778325068
Stage tims : Wall: 2.86 s, CPU: 0.92 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.175444 MB
Stage tims finished: 2020-08-13T13:28:34.085534
Resources for stage tims : 4.753 s worker CPU, 13.727 s worker Wall, Wall: 2.858 s, Cores in use: 1.99, Total efficiency (on 32 cores): 6.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-13T13:28:34.175224
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01381.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01278.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/reference-custom-282575p51598.fits
Stage refs : Wall: 7.64 s, CPU: 5.64 s, VmPeak: 1025 MB, VmSize: 1020 MB, VmRSS: 242 MB, VmData: 274 MB, maxrss: 0.247992 MB
Stage refs finished: 2020-08-13T13:28:41.810383
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 7.638 s, Cores in use: 0.74, Total efficiency (on 32 cores): 2.3 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-13T13:28:41.838888
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outlier-mask-custom-282575p51598.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outliers-pre-custom-282575p51598.jpg
Image ksb_180519_092333_ooi_g_ls9-CCD4 g : masking 67 positive outlier pixels and 0 negative outlier pixels
Image ksb_160712_072426_ooi_r_ls9-CCD3 r : masking 186 positive outlier pixels and 0 negative outlier pixels
Image k4m_170910_071910_ooi_zd_ls9-CCD1 z : masking 93 positive outlier pixels and 0 negative outlier pixels
Image k4m_160528_100637_ooi_zd_ls9-CCD4 z : masking 1116 positive outlier pixels and 343 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outlier-mask-custom-282575p51598.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outliers-post-custom-282575p51598.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outliers-masked-pos-custom-282575p51598.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/outliers-masked-neg-custom-282575p51598.jpg
Stage outliers : Wall: 0.76 s, CPU: 0.46 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 254 MB, VmData: 283 MB, maxrss: 0.260176 MB
Stage outliers finished: 2020-08-13T13:28:42.597486
Resources for stage outliers : 0.678 s worker CPU, 0.874 s worker Wall, Wall: 0.761 s, Cores in use: 1.50, Total efficiency (on 32 cores): 4.7 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-13T13:28:42.688433
Stage halos : Wall: 0.17 s, CPU: 0.17 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 254 MB, VmData: 283 MB, maxrss: 0.260496 MB
Stage halos finished: 2020-08-13T13:28:42.863537
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.177 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-13T13:28:42.891348
PSF sigmas in coadd pixels: ['2.03', '1.79', '3.14']
Using average PSF sigma 2.3186590255216513
Gaussian PSF norm 0.12166290457925892 vs pixelized 0.09195312
average tim pixel scale / coadd scale: 1.7298381279741648
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.79', '2.35', '1.86']
Using average PSF sigma 1.9991835460267497
Gaussian PSF norm 0.14110499875537874 vs pixelized 0.112444244
average tim pixel scale / coadd scale: 1.7294240982150872
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.47', '1.83', '1.44']
Using average PSF sigma 1.5784965751473647
Gaussian PSF norm 0.17871105722705952 vs pixelized 0.147641
average tim pixel scale / coadd scale: 0.9909494360553399
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.13 s, CPU: 0.12 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.26196 MB
Stage fit_on_coadds finished: 2020-08-13T13:28:43.025160
Resources for stage fit_on_coadds : 0.144 s worker CPU, 0.144 s worker Wall, Wall: 0.136 s, Cores in use: 1.96, Total efficiency (on 32 cores): 6.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-fit_on_coadds.p
Running stage srcs
Warning: Stellar halo subtraction is only implemented for DECam
Running stage srcs at 2020-08-13T13:28:43.040420
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 187 potential peaks
Of 187 potential peaks: 167 in veto map, 2 cut by saddle test, 0 cut by aper test, 18 kept
SED z : 18 new peaks
Found 1087 potential peaks
Of 1087 potential peaks: 1084 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 24 potential peaks
Of 24 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 43 potential peaks
Of 43 potential peaks: 39 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 48 potential peaks
Of 48 potential peaks: 41 in veto map, 5 cut by saddle test, 1 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 24 new sources
Median coadd sky for g : 0.00037450244
Median coadd sky for r : 0.0009814464
Median coadd sky for z : 0.00024247309
Stage srcs : Wall: 0.41 s, CPU: 0.37 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.262448 MB
Stage srcs finished: 2020-08-13T13:28:43.454145
Resources for stage srcs : 0.088 s worker CPU, 0.107 s worker Wall, Wall: 0.416 s, Cores in use: 1.11, Total efficiency (on 32 cores): 3.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-13T13:28:43.471741
Blob 1 of 13, id: 0, sources: 16, size: 170x156, npix 18026, brick X: 69,239, Y: 0,156, one pixel: 103 0
Blob 2 of 13, id: 6, sources: 2, size: 39x46, npix 1180, brick X: 200,239, Y: 139,185, one pixel: 227 139
Blob 3 of 13, id: 8, sources: 1, size: 33x33, npix 734, brick X: 118,151, Y: 161,194, one pixel: 134 161
Blob 4 of 13, id: 9, sources: 2, size: 31x38, npix 710, brick X: 0,31, Y: 173,211, one pixel: 15 173
Blob 5 of 13, id: 4, sources: 2, size: 29x42, npix 600, brick X: 27,56, Y: 76,118, one pixel: 39 76
Blob 6 of 13, id: 11, sources: 1, size: 29x25, npix 497, brick X: 159,188, Y: 214,239, one pixel: 170 214
Blob 7 of 13, id: 7, sources: 1, size: 27x26, npix 430, brick X: 42,69, Y: 161,187, one pixel: 54 161
Blob 8 of 13, id: 12, sources: 2, size: 35x21, npix 426, brick X: 43,78, Y: 218,239, one pixel: 68 218
Blob 9 of 13, id: 5, sources: 1, size: 25x24, npix 366, brick X: 52,77, Y: 117,141, one pixel: 62 117
Blob 10 of 13, id: 3, sources: 1, size: 22x22, npix 263, brick X: 22,44, Y: 51,73, one pixel: 32 51
Blob 11 of 13, id: 1, sources: 1, size: 21x19, npix 237, brick X: 29,50, Y: 20,39, one pixel: 37 20
Blob 12 of 13, id: 2, sources: 1, size: 20x20, npix 228, brick X: 9,29, Y: 41,61, one pixel: 18 41
Blob 13 of 13, id: 10, sources: 1, size: 17x18, npix 162, brick X: 80,97, Y: 204,222, one pixel: 88 204
Blob 13 finished, total: Wall: 0.19 s, CPU: 0.10 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 83 MB, VmData: 137 MB, maxrss: 0.084976 MB
Blob 8 finished, total: Wall: 0.33 s, CPU: 0.25 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.090664 MB
Blob 12 finished, total: Wall: 0.39 s, CPU: 0.29 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092284 MB
Blob 11 finished, total: Wall: 0.47 s, CPU: 0.37 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145344 MB
Blob 9 finished, total: Wall: 0.50 s, CPU: 0.41 s, VmPeak: 806 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144492 MB
Blob 10 finished, total: Wall: 0.54 s, CPU: 0.44 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09216 MB
Blob 5 finished, total: Wall: 0.60 s, CPU: 0.49 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092308 MB
Blob 7 finished, total: Wall: 0.75 s, CPU: 0.66 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091968 MB
Blob 6 finished, total: Wall: 0.78 s, CPU: 0.69 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145136 MB
Reference source: GaiaSource at GaiaPosition: RA, Dec = (282.57417, 51.60320), pm (-5.9, -11.1), parallax 0.113 with NanoMaggies: g=21.8, r=20.4, z=19.2
  cat entry: tabledata object with 1 rows and 62 columns
Blob 3 finished, total: Wall: 0.88 s, CPU: 0.78 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 140 MB, maxrss: 0.093588 MB
Blob 4 finished, total: Wall: 0.91 s, CPU: 0.82 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092196 MB
Blob 2 finished, total: Wall: 1.25 s, CPU: 1.17 s, VmPeak: 668 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093324 MB
Reference source: GaiaSource at GaiaPosition: RA, Dec = (282.55741, 51.59531), pm (-11.3, -7.0), parallax 0.972 with NanoMaggies: g=12, r=11.1, z=10.7
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (282.57562, 51.59089), pm (0.7, 5.7), parallax 0.569 with NanoMaggies: g=17.9, r=17, z=16.6
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (282.56275, 51.58656), pm (-0.6, -2.6), parallax 0.221 with NanoMaggies: g=18.3, r=17.7, z=17.4
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (282.57938, 51.59753), pm (1.3, -0.6), parallax 0.308 with NanoMaggies: g=20.9, r=19.6, z=18.6
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (282.57627, 51.59199), pm (-0.4, 2.0), parallax 0.184 with NanoMaggies: g=20.3, r=19.8, z=19.7
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (282.57098, 51.60024), pm (-5.5, -12.2), parallax 2.295 with NanoMaggies: g=22.1, r=20.8, z=19.3
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: ExpGalaxy at RaDecPos: RA, Dec = (282.57584, 51.59892) with NanoMaggies: g=17.9, r=16.8, z=16.3 and EllipseWithPriors(0.25): log r_e=0.590528, ee1=-0.382368, ee2=-0.272646
  cat entry: tabledata object with 1 rows and 62 columns
  cat entry: tabledata object with 2 rows and 62 columns
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.55741, 51.59531), pm (-11.3, -7.0), parallax 0.972 with NanoMaggies: g=12, r=11.1, z=10.7
Reset brightness to NanoMaggies: g=12, r=11.1, z=10.7
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.590528, ee1=-0.382368, ee2=-0.272646
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.56275, 51.58656), pm (-0.6, -2.6), parallax 0.221 with NanoMaggies: g=18.3, r=17.7, z=17.4
Reset brightness to NanoMaggies: g=18.3, r=17.7, z=17.4
Measuring 3 iterative sources
Blob 1 finished, total: Wall: 8.88 s, CPU: 8.77 s, VmPeak: 683 MB, VmSize: 682 MB, VmRSS: 106 MB, VmData: 150 MB, maxrss: 0.108956 MB
Old catalog: 39
New catalog: 31
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/blobs-custom-282575p51598.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/metrics/cus/all-models-custom-282575p51598.fits
Stage fitblobs : Wall: 9.18 s, CPU: 0.28 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 257 MB, VmData: 284 MB, maxrss: 0.263136 MB
Stage fitblobs finished: 2020-08-13T13:28:52.647176
Resources for stage fitblobs : 15.463 s worker CPU, 16.917 s worker Wall, Wall: 9.177 s, Cores in use: 1.72, Total efficiency (on 32 cores): 5.4 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-13T13:28:52.664853
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-resid.jpg
Stage coadds : Wall: 2.24 s, CPU: 0.48 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 257 MB, VmData: 284 MB, maxrss: 0.263524 MB
Stage coadds finished: 2020-08-13T13:28:54.905605
Resources for stage coadds : 30.861 s worker CPU, 33.772 s worker Wall, Wall: 2.243 s, Cores in use: 13.97, Total efficiency (on 32 cores): 43.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-13T13:28:54.924066
Cut to 2 unWISE tiles
Reading WISE tile 2813p514 band 1
Reading WISE tile 2813p514 band 3
Reading WISE tile 2813p514 band 2
Reading WISE tile 2813p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2813p514/unwise-2813p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2837p514 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.21 s, CPU: 0.15 s, VmPeak: 806 MB, VmSize: 799 MB, VmRSS: 146 MB, VmData: 177 MB, maxrss: 0.186776 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 806 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.206036 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 812 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.20286 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2837p514/unwise-2837p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 805 MB, VmRSS: 147 MB, VmData: 179 MB, maxrss: 0.201888 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/tmp-legacysurvey-custom-282575p51598-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.96 s, CPU: 0.40 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 258 MB, VmData: 284 MB, maxrss: 0.264036 MB
Stage wise_forced finished: 2020-08-13T13:28:57.883394
Resources for stage wise_forced : 6.223 s worker CPU, 8.519 s worker Wall, Wall: 2.961 s, Cores in use: 2.24, Total efficiency (on 32 cores): 7.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-13T13:28:57.902709
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/coadd/cus/custom-282575p51598/legacysurvey-custom-282575p51598-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/tractor-i/cus/tractor-custom-282575p51598.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/tractor/cus/tractor-custom-282575p51598.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/tractor/cus/brick-custom-282575p51598.sha256sum
Stage writecat : Wall: 0.58 s, CPU: 0.44 s, VmPeak: 1161 MB, VmSize: 1033 MB, VmRSS: 260 MB, VmData: 284 MB, maxrss: 0.3969 MB
Stage writecat finished: 2020-08-13T13:28:58.482552
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.582 s, Cores in use: 0.76, Total efficiency (on 32 cores): 2.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2396739/PGC2396739-largegalaxy-writecat.p
All done: 58.216 s worker CPU, 74.068 s worker Wall, Wall: 27.277 s, Cores in use: 2.48, Total efficiency (on 32 cores): 7.8 %
Finished galaxy PGC2396739 in 0.484 minutes.