Started working on galaxy PGC2085901 at Wed Aug  5 19:45:55 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35125 36.732498 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:45:58.606080
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.35125', '36.732498', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35125 36.732498 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 272.35125 36.732498
Starting process 51331 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 51332 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 51333 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 51334 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 51335 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 51336 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 51337 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 51338 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 51339 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 51340 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 51341 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 51342 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 51343 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 51344 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51345 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51346 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:46:01.155840
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 13 CCDs:
  k4m_160415_113533_ooi_zd_ls9-CCD3 z expnum 82527 exptime 148.106 propid 2016A-0453 seeing 1.16 MJD 57493.483 object MzLS_588542_z 
    mosaic/CP/V4.3/CP20160414/k4m_160415_113533_ooi_zd_ls9.fits.fz
  k4m_170524_112715_ooi_zd_ls9-CCD4 z expnum 129993 exptime 149.103 propid 2016A-0453 seeing 1.24 MJD 57897.477 object MzLS_586530_z 
    mosaic/CP/V4.3/CP20170523/k4m_170524_112715_ooi_zd_ls9.fits.fz
  k4m_170613_105413_ooi_zd_ls9-CCD2 z expnum 133154 exptime 151.106 propid 2016A-0453 seeing 1.18 MJD 57917.454 object MzLS_587537_z 
    mosaic/CP/V4.3/CP20170612/k4m_170613_105413_ooi_zd_ls9.fits.fz
  ksb_160511_105540_ooi_r_ls9-CCD1 r expnum 75190248 exptime 56.0 propid BASS seeing 1.13 MJD 57519.455 object 09592 
    90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz
  ksb_160503_105424_ooi_g_ls9-CCD2 g expnum 75110180 exptime 80.0 propid BASS seeing 1.33 MJD 57511.454 object 10931 
    90prime/CP/V2.3/CP20160502/ksb_160503_105424_ooi_g_ls9.fits.fz
  ksb_160429_110145_ooi_r_ls9-CCD2 r expnum 75070185 exptime 175.2 propid BASS seeing 1.45 MJD 57507.460 object 10931 
    90prime/CP/V2.3/CP20160428/ksb_160429_110145_ooi_r_ls9.fits.fz
  ksb_160628_080048_ooi_r_ls9-CCD2 r expnum 75670115 exptime 155.9 propid BASS seeing 1.16 MJD 57567.334 object 10933 
    90prime/CP/V2.3/CP20160627/ksb_160628_080048_ooi_r_ls9.fits.fz
  ksb_160705_065914_ooi_g_ls9-CCD2 g expnum 75740094 exptime 108.3 propid BASS seeing 1.84 MJD 57574.291 object 10933 
    90prime/CP/V2.3/CP20160704/ksb_160705_065914_ooi_g_ls9.fits.fz
  ksb_160703_071935_ooi_g_ls9-CCD1 g expnum 75720041 exptime 74.4 propid BASS seeing 1.30 MJD 57572.305 object 09592 
    90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz
  ksb_160606_104535_ooi_g_ls9-CCD1 g expnum 75450149 exptime 250.0 propid BASS seeing 1.63 MJD 57545.448 object 09592 
    90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz
  ksb_160606_105628_ooi_g_ls9-CCD4 g expnum 75450151 exptime 250.0 propid BASS seeing 1.27 MJD 57545.456 object 10932 
    90prime/CP/V2.3/CP20160605/ksb_160606_105628_ooi_g_ls9.fits.fz
  ksb_160703_072209_ooi_g_ls9-CCD4 g expnum 75720042 exptime 70.5 propid BASS seeing 1.07 MJD 57572.307 object 10932 
    90prime/CP/V2.3/CP20160702/ksb_160703_072209_ooi_g_ls9.fits.fz
  ksb_160513_103142_ooi_r_ls9-CCD4 r expnum 75210208 exptime 61.8 propid BASS seeing 1.21 MJD 57521.439 object 10932 
    90prime/CP/V2.3/CP20160512/ksb_160513_103142_ooi_r_ls9.fits.fz
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
90prime get_fwhm: self.fwhm = 2.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 173 318 and amp range 0 2015 and image y 2662 2805 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.00015519658 -> scaling image by 0.9998570688798908
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
90prime get_fwhm: self.fwhm = 4.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 107 and amp range 0 2015 and image y 1163 1307 and amp range 0 2047
Range in image: x 0 93 , y 0 145 (with image size 93 x 145)
dzp -0.008523628 -> scaling image by 0.992180183483648
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
90prime get_fwhm: self.fwhm = 2.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3987 4016 and amp range 2016 4031 and image y 696 838 and amp range 0 2047
Range in image: x 0 30 , y 0 143 (with image size 30 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2199 2446 and amp range 2006 4053 and image y 1570 1819 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 4004 4016 and amp range 2016 4031 and image y 749 891 and amp range 0 2047
Range in image: x 0 13 , y 0 143 (with image size 13 x 143)
dzp 0.0047082007 -> scaling image by 1.0043458289369953
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3246 3498 and amp range 2048 4095 and image y 714 961 and amp range 0 2021
Range in image: x 0 253 , y 0 248 (with image size 253 x 248)
dzp -0.03444113 -> scaling image by 0.9687763957004109
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 104 and amp range 0 2015 and image y 1108 1252 and amp range 0 2047
Range in image: x 0 90 , y 0 145 (with image size 90 x 145)
dzp -0.006045583 -> scaling image by 0.9944472857505693
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
90prime get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 174 319 and amp range 0 2015 and image y 2653 2796 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 175 320 and amp range 0 2015 and image y 2644 2787 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3989 4016 and amp range 2016 4031 and image y 695 837 and amp range 0 2047
Range in image: x 0 28 , y 0 143 (with image size 28 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
90prime get_fwhm: self.fwhm = 2.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1963 2107 and amp range 0 2015 and image y 3181 3324 and amp range 2048 4095
Range in image: x 0 53 , y 0 144 (with image size 145 x 144)
dzp 0.01693853 -> scaling image by 1.015723292931903
Found overlap: image x 1963 2107 and amp range 2016 4031 and image y 3181 3324 and amp range 2048 4095
Range in image: x 53 145 , y 0 144 (with image size 145 x 144)
dzp 0.0026774607 -> scaling image by 1.002469075566243
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1984 2127 and amp range 0 2015 and image y 3162 3305 and amp range 2048 4095
Range in image: x 0 32 , y 0 144 (with image size 144 x 144)
dzp 0.016961161 -> scaling image by 1.0157444649385616
Found overlap: image x 1984 2127 and amp range 2016 4031 and image y 3162 3305 and amp range 2048 4095
Range in image: x 32 144 , y 0 144 (with image size 144 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 594 840 and amp range 0 2047 and image y 1722 1970 and amp range 0 2039
Range in image: x 0 247 , y 0 249 (with image size 247 x 249)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 15.01 s, CPU: 1.20 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.179504 MB
Stage tims finished: 2020-08-05T19:46:16.161109
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 7.419 s worker CPU, 65.190 s worker Wall, Wall: 15.007 s, Cores in use: 0.57, Total efficiency (on 16 cores): 3.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:46:16.765588
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits
Matched 7 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/reference-custom-272351p36732.fits
Stage refs : Wall: 10.94 s, CPU: 6.83 s, VmPeak: 1033 MB, VmSize: 1027 MB, VmRSS: 247 MB, VmData: 277 MB, maxrss: 0.253212 MB
Stage refs finished: 2020-08-05T19:46:27.701863
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.938 s, Cores in use: 0.62, Total efficiency (on 16 cores): 3.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:46:27.826781
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outlier-mask-custom-272351p36732.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outliers-pre-custom-272351p36732.jpg
Image ksb_160503_105424_ooi_g_ls9-CCD2 g : masking 58 positive outlier pixels and 0 negative outlier pixels
Image ksb_160606_105628_ooi_g_ls9-CCD4 g : masking 343 positive outlier pixels and 67 negative outlier pixels
Image ksb_160703_072209_ooi_g_ls9-CCD4 g : masking 61 positive outlier pixels and 0 negative outlier pixels
Image k4m_170524_112715_ooi_zd_ls9-CCD4 z : masking 1059 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outlier-mask-custom-272351p36732.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outliers-post-custom-272351p36732.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outliers-masked-pos-custom-272351p36732.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outliers-masked-neg-custom-272351p36732.jpg
Stage outliers : Wall: 3.55 s, CPU: 3.29 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 260 MB, VmData: 287 MB, maxrss: 0.26626 MB
Stage outliers finished: 2020-08-05T19:46:31.381073
Resources for stage outliers : 0.678 s worker CPU, 0.755 s worker Wall, Wall: 3.556 s, Cores in use: 1.12, Total efficiency (on 16 cores): 7.0 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:46:31.504023
Stage halos : Wall: 1.19 s, CPU: 1.17 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 260 MB, VmData: 287 MB, maxrss: 0.266376 MB
Stage halos finished: 2020-08-05T19:46:32.692259
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.190 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T19:46:32.834384
PSF sigmas in coadd pixels: ['2.16', '3.00', '2.11', '2.66', '2.07', '1.73']
Using average PSF sigma 2.286018560856563
Gaussian PSF norm 0.12340004434092533 vs pixelized 0.10025742
average tim pixel scale / coadd scale: 1.7292752687797974
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.83', '2.35', '1.89', '1.97']
Using average PSF sigma 2.00942835565997
Gaussian PSF norm 0.14038559323565825 vs pixelized 0.11630525
average tim pixel scale / coadd scale: 1.729686699189132
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.88', '2.02', '1.92']
Using average PSF sigma 1.9382838761181251
Gaussian PSF norm 0.1455384297674911 vs pixelized 0.11809793
average tim pixel scale / coadd scale: 0.9909289411823656
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.15 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 262 MB, VmData: 288 MB, maxrss: 0.268476 MB
Stage fit_on_coadds finished: 2020-08-05T19:46:32.996074
Resources for stage fit_on_coadds : 0.167 s worker CPU, 0.167 s worker Wall, Wall: 0.163 s, Cores in use: 1.95, Total efficiency (on 16 cores): 12.2 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Running stage srcs
Warning: Stellar halo subtraction is only implemented for DECam
Running stage srcs at 2020-08-05T19:46:33.012614
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 26 potential peaks
Of 26 potential peaks: 6 in veto map, 2 cut by saddle test, 0 cut by aper test, 18 kept
SED z : 18 new peaks
Found 48 potential peaks
Of 48 potential peaks: 37 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 34 potential peaks
Of 34 potential peaks: 25 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 51 potential peaks
Of 51 potential peaks: 37 in veto map, 7 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 50 potential peaks
Of 50 potential peaks: 41 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 31 new sources
Median coadd sky for g : 0.00010109487
Median coadd sky for r : 0.0003942108
Median coadd sky for z : -0.00029940472
Stage srcs : Wall: 0.87 s, CPU: 0.83 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 263 MB, VmData: 288 MB, maxrss: 0.269208 MB
Stage srcs finished: 2020-08-05T19:46:33.881260
Resources for stage srcs : 0.065 s worker CPU, 0.065 s worker Wall, Wall: 0.870 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:46:33.893396
Blob 1 of 14, id: 2, sources: 18, size: 173x210, npix 19026, brick X: 23,196, Y: 24,234, one pixel: 65 24
Blob 2 of 14, id: 9, sources: 4, size: 35x58, npix 1454, brick X: 0,35, Y: 168,226, one pixel: 11 168
Blob 3 of 14, id: 8, sources: 2, size: 37x55, npix 1398, brick X: 208,245, Y: 165,220, one pixel: 233 165
Blob 4 of 14, id: 5, sources: 1, size: 33x40, npix 1031, brick X: 212,245, Y: 108,148, one pixel: 228 108
Blob 5 of 14, id: 0, sources: 1, size: 37x29, npix 710, brick X: 90,127, Y: 6,35, one pixel: 107 6
Blob 6 of 14, id: 10, sources: 2, size: 32x33, npix 527, brick X: 143,175, Y: 193,226, one pixel: 161 193
Blob 7 of 14, id: 11, sources: 2, size: 34x23, npix 500, brick X: 76,110, Y: 198,221, one pixel: 99 198
Blob 8 of 14, id: 12, sources: 2, size: 23x36, npix 474, brick X: 183,206, Y: 209,245, one pixel: 194 209
Blob 9 of 14, id: 4, sources: 1, size: 24x26, npix 412, brick X: 27,51, Y: 93,119, one pixel: 38 93
Blob 10 of 14, id: 7, sources: 1, size: 25x25, npix 366, brick X: 181,206, Y: 149,174, one pixel: 193 149
Blob 11 of 14, id: 3, sources: 1, size: 23x23, npix 305, brick X: 14,37, Y: 33,56, one pixel: 24 33
Blob 12 of 14, id: 1, sources: 1, size: 21x23, npix 293, brick X: 208,229, Y: 7,30, one pixel: 217 7
Blob 13 of 14, id: 6, sources: 1, size: 21x21, npix 270, brick X: 191,212, Y: 109,130, one pixel: 200 109
Blob 14 of 14, id: 13, sources: 1, size: 18x13, npix 142, brick X: 167,185, Y: 232,245, one pixel: 175 232
Blob 11 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149172 MB
Blob 12 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149584 MB
Blob 14 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149592 MB
Blob 13 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149264 MB
Blob 6 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149 MB
Blob 10 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092748 MB
Blob 7 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149452 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.36242, 36.73820), pm (1.1, -2.2), parallax 0.108 with NanoMaggies: g=20.1, r=19.6, z=19.1
Reset brightness to NanoMaggies: g=20.2, r=19.4, z=19.1
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 816 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149656 MB
Blob 8 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.09372 MB
Blob 2 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15024 MB
Blob 4 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149128 MB
Measuring 2 iterative sources
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 1.31 s, CPU: 1.31 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.15116 MB
Blob 3 finished, total: Wall: 1.60 s, CPU: 1.60 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095004 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.41824, ee1=-0.0261132, ee2=0.142141
Measuring 5 iterative sources
Blob 1 finished, total: Wall: 10.98 s, CPU: 10.98 s, VmPeak: 810 MB, VmSize: 733 MB, VmRSS: 155 MB, VmData: 184 MB, maxrss: 0.159156 MB
Old catalog: 48
New catalog: 40
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/blobs-custom-272351p36732.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/all-models-custom-272351p36732.fits
Stage fitblobs : Wall: 11.43 s, CPU: 0.40 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 264 MB, VmData: 289 MB, maxrss: 0.270364 MB
Stage fitblobs finished: 2020-08-05T19:46:45.324912
Resources for stage fitblobs : 18.484 s worker CPU, 18.565 s worker Wall, Wall: 11.433 s, Cores in use: 1.65, Total efficiency (on 16 cores): 10.3 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:46:45.350744
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-resid.jpg
Stage coadds : Wall: 4.04 s, CPU: 1.84 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 264 MB, VmData: 289 MB, maxrss: 0.270688 MB
Stage coadds finished: 2020-08-05T19:46:49.389132
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 7.310 s worker CPU, 10.338 s worker Wall, Wall: 4.040 s, Cores in use: 2.26, Total efficiency (on 16 cores): 14.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:46:49.407733
Cut to 1 unWISE tiles
Reading WISE tile 2723p363 band 4
Reading WISE tile 2723p363 band 2
Reading WISE tile 2723p363 band 3
Reading WISE tile 2723p363 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 812 MB, VmSize: 803 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.1864 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 814 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.207276 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 810 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210552 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 812 MB, VmSize: 805 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.2103 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 8.42 s, CPU: 1.29 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 265 MB, VmData: 289 MB, maxrss: 0.2712 MB
Stage wise_forced finished: 2020-08-05T19:46:57.831301
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 2.952 s worker CPU, 11.434 s worker Wall, Wall: 8.425 s, Cores in use: 0.50, Total efficiency (on 16 cores): 3.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:46:57.849929
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/tractor-i/cus/tractor-custom-272351p36732.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/tractor/cus/tractor-custom-272351p36732.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/tractor/cus/brick-custom-272351p36732.sha256sum
Stage writecat : Wall: 0.90 s, CPU: 0.75 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 267 MB, VmData: 289 MB, maxrss: 0.404144 MB
Stage writecat finished: 2020-08-05T19:46:58.753076
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.905 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-writecat.p
All done: 37.078 s worker CPU, 106.519 s worker Wall, Wall: 58.514 s, Cores in use: 0.94, Total efficiency (on 16 cores): 5.9 %
Finished galaxy PGC2085901 in 1.057 minutes.
Started working on galaxy PGC2085901 at Wed Aug  5 20:10:07 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35125 36.732498 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:10:08.119014
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.35125', '36.732498', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35125 36.732498 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 272.35125 36.732498
Starting process 56576 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 56577 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 56578 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 56579 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 56580 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 56581 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 56582 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 56583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 56584 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 56585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 56586 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 56587 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 56588 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 56589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 56590 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 56591 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 56592 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 56593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 56594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 56595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 56596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 56597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 56598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 56599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 56600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 56601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 56602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 56603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 56604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 56605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 56606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 56607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:10:09.134026
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 13 CCDs:
  k4m_160415_113533_ooi_zd_ls9-CCD3 z expnum 82527 exptime 148.106 propid 2016A-0453 seeing 1.16 MJD 57493.483 object MzLS_588542_z 
    mosaic/CP/V4.3/CP20160414/k4m_160415_113533_ooi_zd_ls9.fits.fz
  k4m_170524_112715_ooi_zd_ls9-CCD4 z expnum 129993 exptime 149.103 propid 2016A-0453 seeing 1.24 MJD 57897.477 object MzLS_586530_z 
    mosaic/CP/V4.3/CP20170523/k4m_170524_112715_ooi_zd_ls9.fits.fz
  k4m_170613_105413_ooi_zd_ls9-CCD2 z expnum 133154 exptime 151.106 propid 2016A-0453 seeing 1.18 MJD 57917.454 object MzLS_587537_z 
    mosaic/CP/V4.3/CP20170612/k4m_170613_105413_ooi_zd_ls9.fits.fz
  ksb_160511_105540_ooi_r_ls9-CCD1 r expnum 75190248 exptime 56.0 propid BASS seeing 1.13 MJD 57519.455 object 09592 
    90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz
  ksb_160503_105424_ooi_g_ls9-CCD2 g expnum 75110180 exptime 80.0 propid BASS seeing 1.33 MJD 57511.454 object 10931 
    90prime/CP/V2.3/CP20160502/ksb_160503_105424_ooi_g_ls9.fits.fz
  ksb_160429_110145_ooi_r_ls9-CCD2 r expnum 75070185 exptime 175.2 propid BASS seeing 1.45 MJD 57507.460 object 10931 
    90prime/CP/V2.3/CP20160428/ksb_160429_110145_ooi_r_ls9.fits.fz
  ksb_160628_080048_ooi_r_ls9-CCD2 r expnum 75670115 exptime 155.9 propid BASS seeing 1.16 MJD 57567.334 object 10933 
    90prime/CP/V2.3/CP20160627/ksb_160628_080048_ooi_r_ls9.fits.fz
  ksb_160705_065914_ooi_g_ls9-CCD2 g expnum 75740094 exptime 108.3 propid BASS seeing 1.84 MJD 57574.291 object 10933 
    90prime/CP/V2.3/CP20160704/ksb_160705_065914_ooi_g_ls9.fits.fz
  ksb_160703_071935_ooi_g_ls9-CCD1 g expnum 75720041 exptime 74.4 propid BASS seeing 1.30 MJD 57572.305 object 09592 
    90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz
  ksb_160606_104535_ooi_g_ls9-CCD1 g expnum 75450149 exptime 250.0 propid BASS seeing 1.63 MJD 57545.448 object 09592 
    90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz
  ksb_160606_105628_ooi_g_ls9-CCD4 g expnum 75450151 exptime 250.0 propid BASS seeing 1.27 MJD 57545.456 object 10932 
    90prime/CP/V2.3/CP20160605/ksb_160606_105628_ooi_g_ls9.fits.fz
  ksb_160703_072209_ooi_g_ls9-CCD4 g expnum 75720042 exptime 70.5 propid BASS seeing 1.07 MJD 57572.307 object 10932 
    90prime/CP/V2.3/CP20160702/ksb_160703_072209_ooi_g_ls9.fits.fz
  ksb_160513_103142_ooi_r_ls9-CCD4 r expnum 75210208 exptime 61.8 propid BASS seeing 1.21 MJD 57521.439 object 10932 
    90prime/CP/V2.3/CP20160512/ksb_160513_103142_ooi_r_ls9.fits.fz
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3989 4016 and amp range 2016 4031 and image y 695 837 and amp range 0 2047
Range in image: x 0 28 , y 0 143 (with image size 28 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
90prime get_fwhm: self.fwhm = 4.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 107 and amp range 0 2015 and image y 1163 1307 and amp range 0 2047
Range in image: x 0 93 , y 0 145 (with image size 93 x 145)
dzp -0.008523628 -> scaling image by 0.992180183483648
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2199 2446 and amp range 2006 4053 and image y 1570 1819 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
90prime get_fwhm: self.fwhm = 2.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1963 2107 and amp range 0 2015 and image y 3181 3324 and amp range 2048 4095
Range in image: x 0 53 , y 0 144 (with image size 145 x 144)
dzp 0.01693853 -> scaling image by 1.015723292931903
Found overlap: image x 1963 2107 and amp range 2016 4031 and image y 3181 3324 and amp range 2048 4095
Range in image: x 53 145 , y 0 144 (with image size 145 x 144)
dzp 0.0026774607 -> scaling image by 1.002469075566243
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
90prime get_fwhm: self.fwhm = 2.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3987 4016 and amp range 2016 4031 and image y 696 838 and amp range 0 2047
Range in image: x 0 30 , y 0 143 (with image size 30 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
90prime get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 174 319 and amp range 0 2015 and image y 2653 2796 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 175 320 and amp range 0 2015 and image y 2644 2787 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
90prime get_fwhm: self.fwhm = 2.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 173 318 and amp range 0 2015 and image y 2662 2805 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.00015519658 -> scaling image by 0.9998570688798908
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3246 3498 and amp range 2048 4095 and image y 714 961 and amp range 0 2021
Range in image: x 0 253 , y 0 248 (with image size 253 x 248)
dzp -0.03444113 -> scaling image by 0.9687763957004109
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 4004 4016 and amp range 2016 4031 and image y 749 891 and amp range 0 2047
Range in image: x 0 13 , y 0 143 (with image size 13 x 143)
dzp 0.0047082007 -> scaling image by 1.0043458289369953
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 104 and amp range 0 2015 and image y 1108 1252 and amp range 0 2047
Range in image: x 0 90 , y 0 145 (with image size 90 x 145)
dzp -0.006045583 -> scaling image by 0.9944472857505693
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 594 840 and amp range 0 2047 and image y 1722 1970 and amp range 0 2039
Range in image: x 0 247 , y 0 249 (with image size 247 x 249)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1984 2127 and amp range 0 2015 and image y 3162 3305 and amp range 2048 4095
Range in image: x 0 32 , y 0 144 (with image size 144 x 144)
dzp 0.016961161 -> scaling image by 1.0157444649385616
Found overlap: image x 1984 2127 and amp range 2016 4031 and image y 3162 3305 and amp range 2048 4095
Range in image: x 32 144 , y 0 144 (with image size 144 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 13.92 s, CPU: 1.64 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.179692 MB
Stage tims finished: 2020-08-05T20:10:23.054506
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 6.964 s worker CPU, 49.991 s worker Wall, Wall: 13.923 s, Cores in use: 0.62, Total efficiency (on 32 cores): 1.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:10:23.086070
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits
Matched 7 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/reference-custom-272351p36732.fits
Stage refs : Wall: 11.09 s, CPU: 6.20 s, VmPeak: 1033 MB, VmSize: 1027 MB, VmRSS: 247 MB, VmData: 277 MB, maxrss: 0.253392 MB
Stage refs finished: 2020-08-05T20:10:34.180161
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.096 s, Cores in use: 0.56, Total efficiency (on 32 cores): 1.7 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:10:34.321173
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outlier-mask-custom-272351p36732.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outliers-pre-custom-272351p36732.jpg
Image ksb_160606_105628_ooi_g_ls9-CCD4 g : masking 343 positive outlier pixels and 67 negative outlier pixels
Image ksb_160703_072209_ooi_g_ls9-CCD4 g : masking 61 positive outlier pixels and 0 negative outlier pixels
Image ksb_160503_105424_ooi_g_ls9-CCD2 g : masking 58 positive outlier pixels and 0 negative outlier pixels
Image k4m_170524_112715_ooi_zd_ls9-CCD4 z : masking 1059 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outlier-mask-custom-272351p36732.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outliers-post-custom-272351p36732.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outliers-masked-pos-custom-272351p36732.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/outliers-masked-neg-custom-272351p36732.jpg
Stage outliers : Wall: 1.06 s, CPU: 0.69 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 260 MB, VmData: 287 MB, maxrss: 0.265944 MB
Stage outliers finished: 2020-08-05T20:10:35.386055
Resources for stage outliers : 0.881 s worker CPU, 1.240 s worker Wall, Wall: 1.067 s, Cores in use: 1.48, Total efficiency (on 32 cores): 4.6 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:10:35.422641
Stage halos : Wall: 3.09 s, CPU: 2.96 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 260 MB, VmData: 287 MB, maxrss: 0.266044 MB
Stage halos finished: 2020-08-05T20:10:38.516018
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 3.095 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T20:10:39.295430
PSF sigmas in coadd pixels: ['2.16', '3.00', '2.11', '2.66', '2.07', '1.73']
Using average PSF sigma 2.286018560856563
Gaussian PSF norm 0.12340004434092533 vs pixelized 0.10025742
average tim pixel scale / coadd scale: 1.7292752687797974
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.83', '2.35', '1.89', '1.97']
Using average PSF sigma 2.00942835565997
Gaussian PSF norm 0.14038559323565825 vs pixelized 0.11630526
average tim pixel scale / coadd scale: 1.729686699189132
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.88', '2.02', '1.92']
Using average PSF sigma 1.9382838761181251
Gaussian PSF norm 0.1455384297674911 vs pixelized 0.11809793
average tim pixel scale / coadd scale: 0.9909289411823656
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.16 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 262 MB, VmData: 287 MB, maxrss: 0.26818 MB
Stage fit_on_coadds finished: 2020-08-05T20:10:39.539506
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.161 s worker CPU, 0.189 s worker Wall, Wall: 0.246 s, Cores in use: 1.30, Total efficiency (on 32 cores): 4.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:10:39.567438
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 26 potential peaks
Of 26 potential peaks: 6 in veto map, 2 cut by saddle test, 0 cut by aper test, 18 kept
SED z : 18 new peaks
Found 48 potential peaks
Of 48 potential peaks: 37 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 34 potential peaks
Of 34 potential peaks: 25 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 51 potential peaks
Of 51 potential peaks: 37 in veto map, 7 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 50 potential peaks
Of 50 potential peaks: 41 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 31 new sources
Median coadd sky for g : 0.00010109487
Median coadd sky for r : 0.0003942108
Median coadd sky for z : -0.00029940472
Stage srcs : Wall: 3.51 s, CPU: 3.38 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 262 MB, VmData: 287 MB, maxrss: 0.26868 MB
Stage srcs finished: 2020-08-05T20:10:43.079903
Resources for stage srcs : 0.089 s worker CPU, 0.089 s worker Wall, Wall: 3.515 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:10:43.107247
Blob 1 of 14, id: 2, sources: 18, size: 173x210, npix 19026, brick X: 23,196, Y: 24,234, one pixel: 65 24
Blob 2 of 14, id: 9, sources: 4, size: 35x58, npix 1454, brick X: 0,35, Y: 168,226, one pixel: 11 168
Blob 3 of 14, id: 8, sources: 2, size: 37x55, npix 1398, brick X: 208,245, Y: 165,220, one pixel: 233 165
Blob 4 of 14, id: 5, sources: 1, size: 33x40, npix 1031, brick X: 212,245, Y: 108,148, one pixel: 228 108
Blob 5 of 14, id: 0, sources: 1, size: 37x29, npix 710, brick X: 90,127, Y: 6,35, one pixel: 107 6
Blob 6 of 14, id: 10, sources: 2, size: 32x33, npix 527, brick X: 143,175, Y: 193,226, one pixel: 161 193
Blob 7 of 14, id: 11, sources: 2, size: 34x23, npix 500, brick X: 76,110, Y: 198,221, one pixel: 99 198
Blob 8 of 14, id: 12, sources: 2, size: 23x36, npix 474, brick X: 183,206, Y: 209,245, one pixel: 194 209
Blob 9 of 14, id: 4, sources: 1, size: 24x26, npix 412, brick X: 27,51, Y: 93,119, one pixel: 38 93
Blob 10 of 14, id: 7, sources: 1, size: 25x25, npix 366, brick X: 181,206, Y: 149,174, one pixel: 193 149
Blob 11 of 14, id: 3, sources: 1, size: 23x23, npix 305, brick X: 14,37, Y: 33,56, one pixel: 24 33
Blob 12 of 14, id: 1, sources: 1, size: 21x23, npix 293, brick X: 208,229, Y: 7,30, one pixel: 217 7
Blob 13 of 14, id: 6, sources: 1, size: 21x21, npix 270, brick X: 191,212, Y: 109,130, one pixel: 200 109
Blob 14 of 14, id: 13, sources: 1, size: 18x13, npix 142, brick X: 167,185, Y: 232,245, one pixel: 175 232
Blob 11 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 84 MB, VmData: 137 MB, maxrss: 0.085972 MB
Blob 12 finished, total: Wall: 0.09 s, CPU: 0.07 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 87 MB, VmData: 139 MB, maxrss: 0.088588 MB
Blob 14 finished, total: Wall: 0.23 s, CPU: 0.21 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149728 MB
Blob 13 finished, total: Wall: 0.25 s, CPU: 0.23 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092532 MB
Blob 10 finished, total: Wall: 0.38 s, CPU: 0.37 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09254 MB
Blob 8 finished, total: Wall: 0.40 s, CPU: 0.38 s, VmPeak: 816 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14974 MB
Blob 6 finished, total: Wall: 0.50 s, CPU: 0.48 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092216 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.36242, 36.73820), pm (1.1, -2.2), parallax 0.108 with NanoMaggies: g=20.1, r=19.6, z=19.1
Reset brightness to NanoMaggies: g=20.2, r=19.4, z=19.1
Measuring 1 iterative sources
Blob 7 finished, total: Wall: 0.58 s, CPU: 0.56 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092256 MB
Blob 9 finished, total: Wall: 0.61 s, CPU: 0.59 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092244 MB
Blob 4 finished, total: Wall: 0.77 s, CPU: 0.75 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094604 MB
Blob 2 finished, total: Wall: 0.77 s, CPU: 0.75 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092812 MB
Measuring 1 iterative sources
Measuring 2 iterative sources
Blob 5 finished, total: Wall: 1.47 s, CPU: 1.45 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094244 MB
Blob 3 finished, total: Wall: 1.91 s, CPU: 1.90 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150476 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.41824, ee1=-0.0261133, ee2=0.142141
Measuring 5 iterative sources
Blob 1 finished, total: Wall: 11.55 s, CPU: 11.55 s, VmPeak: 814 MB, VmSize: 733 MB, VmRSS: 155 MB, VmData: 184 MB, maxrss: 0.159116 MB
Old catalog: 48
New catalog: 40
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/blobs-custom-272351p36732.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/metrics/cus/all-models-custom-272351p36732.fits
Stage fitblobs : Wall: 14.16 s, CPU: 2.38 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 264 MB, VmData: 288 MB, maxrss: 0.269836 MB
Stage fitblobs finished: 2020-08-05T20:10:57.268998
Resources for stage fitblobs : 19.600 s worker CPU, 21.827 s worker Wall, Wall: 14.164 s, Cores in use: 1.55, Total efficiency (on 32 cores): 4.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:10:57.360467
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-resid.jpg
Stage coadds : Wall: 2.89 s, CPU: 0.71 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 264 MB, VmData: 288 MB, maxrss: 0.27016 MB
Stage coadds finished: 2020-08-05T20:11:00.252818
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 23.817 s worker CPU, 40.048 s worker Wall, Wall: 2.895 s, Cores in use: 8.47, Total efficiency (on 32 cores): 26.5 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T20:11:00.279156
Cut to 1 unWISE tiles
Reading WISE tile 2723p363 band 2
Reading WISE tile 2723p363 band 1
Reading WISE tile 2723p363 band 3
Reading WISE tile 2723p363 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 810 MB, VmSize: 804 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.18682 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 802 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.20578 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 813 MB, VmSize: 799 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.202724 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 807 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 179 MB, maxrss: 0.200256 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/tmp-legacysurvey-custom-272351p36732-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.20 s, CPU: 0.85 s, VmPeak: 1037 MB, VmSize: 1037 MB, VmRSS: 264 MB, VmData: 288 MB, maxrss: 0.270672 MB
Stage wise_forced finished: 2020-08-05T20:11:03.474888
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.415 s worker CPU, 5.541 s worker Wall, Wall: 3.198 s, Cores in use: 1.34, Total efficiency (on 32 cores): 4.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T20:11:03.490808
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/coadd/cus/custom-272351p36732/legacysurvey-custom-272351p36732-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/tractor-i/cus/tractor-custom-272351p36732.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/tractor/cus/tractor-custom-272351p36732.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/tractor/cus/brick-custom-272351p36732.sha256sum
Stage writecat : Wall: 1.23 s, CPU: 0.63 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 266 MB, VmData: 288 MB, maxrss: 0.403616 MB
Stage writecat finished: 2020-08-05T20:11:04.719352
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.231 s, Cores in use: 0.51, Total efficiency (on 32 cores): 1.6 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2085901/PGC2085901-largegalaxy-writecat.p
All done: 54.934 s worker CPU, 118.933 s worker Wall, Wall: 56.090 s, Cores in use: 1.33, Total efficiency (on 32 cores): 4.2 %
Finished galaxy PGC2085901 in 0.981 minutes.
Started working on galaxy PGC2085901 at Fri Aug  7 09:27:04 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35157205699977 36.73303348403848 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T09:27:05.071077
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.35157205699977', '36.73303348403848', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35157205699977 36.73303348403848 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 272.35157205699977 36.73303348403848
Starting process 20453 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 20454 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 20455 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 20456 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 20457 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 20458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 20459 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 20460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 20461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 20462 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 20463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 20464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 20465 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 20466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 20467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 20468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T09:27:05.638826
Keeping 13 CCDs:
  k4m_160415_113533_ooi_zd_ls9-CCD3 z expnum 82527 exptime 148.106 propid 2016A-0453 seeing 1.16 MJD 57493.483 object MzLS_588542_z 
    mosaic/CP/V4.3/CP20160414/k4m_160415_113533_ooi_zd_ls9.fits.fz
  k4m_170524_112715_ooi_zd_ls9-CCD4 z expnum 129993 exptime 149.103 propid 2016A-0453 seeing 1.24 MJD 57897.477 object MzLS_586530_z 
    mosaic/CP/V4.3/CP20170523/k4m_170524_112715_ooi_zd_ls9.fits.fz
  k4m_170613_105413_ooi_zd_ls9-CCD2 z expnum 133154 exptime 151.106 propid 2016A-0453 seeing 1.18 MJD 57917.454 object MzLS_587537_z 
    mosaic/CP/V4.3/CP20170612/k4m_170613_105413_ooi_zd_ls9.fits.fz
  ksb_160511_105540_ooi_r_ls9-CCD1 r expnum 75190248 exptime 56.0 propid BASS seeing 1.13 MJD 57519.455 object 09592 
    90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz
  ksb_160503_105424_ooi_g_ls9-CCD2 g expnum 75110180 exptime 80.0 propid BASS seeing 1.33 MJD 57511.454 object 10931 
    90prime/CP/V2.3/CP20160502/ksb_160503_105424_ooi_g_ls9.fits.fz
  ksb_160429_110145_ooi_r_ls9-CCD2 r expnum 75070185 exptime 175.2 propid BASS seeing 1.45 MJD 57507.460 object 10931 
    90prime/CP/V2.3/CP20160428/ksb_160429_110145_ooi_r_ls9.fits.fz
  ksb_160628_080048_ooi_r_ls9-CCD2 r expnum 75670115 exptime 155.9 propid BASS seeing 1.16 MJD 57567.334 object 10933 
    90prime/CP/V2.3/CP20160627/ksb_160628_080048_ooi_r_ls9.fits.fz
  ksb_160705_065914_ooi_g_ls9-CCD2 g expnum 75740094 exptime 108.3 propid BASS seeing 1.84 MJD 57574.291 object 10933 
    90prime/CP/V2.3/CP20160704/ksb_160705_065914_ooi_g_ls9.fits.fz
  ksb_160703_071935_ooi_g_ls9-CCD1 g expnum 75720041 exptime 74.4 propid BASS seeing 1.30 MJD 57572.305 object 09592 
    90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz
  ksb_160606_104535_ooi_g_ls9-CCD1 g expnum 75450149 exptime 250.0 propid BASS seeing 1.63 MJD 57545.448 object 09592 
    90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz
  ksb_160606_105628_ooi_g_ls9-CCD4 g expnum 75450151 exptime 250.0 propid BASS seeing 1.27 MJD 57545.456 object 10932 
    90prime/CP/V2.3/CP20160605/ksb_160606_105628_ooi_g_ls9.fits.fz
  ksb_160703_072209_ooi_g_ls9-CCD4 g expnum 75720042 exptime 70.5 propid BASS seeing 1.07 MJD 57572.307 object 10932 
    90prime/CP/V2.3/CP20160702/ksb_160703_072209_ooi_g_ls9.fits.fz
  ksb_160513_103142_ooi_r_ls9-CCD4 r expnum 75210208 exptime 61.8 propid BASS seeing 1.21 MJD 57521.439 object 10932 
    90prime/CP/V2.3/CP20160512/ksb_160513_103142_ooi_r_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 4.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2207 2454 and amp range 2006 4053 and image y 1574 1823 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
mosaic get_fwhm: self.fwhm = 4.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3254 3506 and amp range 2048 4095 and image y 717 965 and amp range 0 2021
Range in image: x 0 253 , y 0 249 (with image size 253 x 249)
dzp -0.03444113 -> scaling image by 0.9687763957004109
mosaic get_fwhm: self.fwhm = 4.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 601 848 and amp range 0 2047 and image y 1725 1974 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3985 4016 and amp range 2016 4031 and image y 693 835 and amp range 0 2047
Range in image: x 0 32 , y 0 143 (with image size 32 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
90prime get_fwhm: self.fwhm = 4.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 103 and amp range 0 2015 and image y 1161 1305 and amp range 0 2047
Range in image: x 0 89 , y 0 145 (with image size 89 x 145)
dzp -0.008523628 -> scaling image by 0.992180183483648
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 4000 4016 and amp range 2016 4031 and image y 747 889 and amp range 0 2047
Range in image: x 0 17 , y 0 143 (with image size 17 x 143)
dzp 0.0047082007 -> scaling image by 1.0043458289369953
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
90prime get_fwhm: self.fwhm = 2.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 169 314 and amp range 0 2015 and image y 2660 2803 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.00015519658 -> scaling image by 0.9998570688798908
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
90prime get_fwhm: self.fwhm = 2.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3982 4016 and amp range 2016 4031 and image y 694 836 and amp range 0 2047
Range in image: x 0 35 , y 0 143 (with image size 35 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 170 315 and amp range 0 2015 and image y 2641 2785 and amp range 2048 4095
Range in image: x 0 146 , y 0 145 (with image size 146 x 145)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1979 2123 and amp range 0 2015 and image y 3160 3303 and amp range 2048 4095
Range in image: x 0 37 , y 0 144 (with image size 145 x 144)
dzp 0.016961161 -> scaling image by 1.0157444649385616
Found overlap: image x 1979 2123 and amp range 2016 4031 and image y 3160 3303 and amp range 2048 4095
Range in image: x 37 145 , y 0 144 (with image size 145 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
90prime get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 169 314 and amp range 0 2015 and image y 2651 2794 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
90prime get_fwhm: self.fwhm = 2.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1959 2102 and amp range 0 2015 and image y 3179 3322 and amp range 2048 4095
Range in image: x 0 57 , y 0 144 (with image size 144 x 144)
dzp 0.01693853 -> scaling image by 1.015723292931903
Found overlap: image x 1959 2102 and amp range 2016 4031 and image y 3179 3322 and amp range 2048 4095
Range in image: x 57 144 , y 0 144 (with image size 144 x 144)
dzp 0.0026774607 -> scaling image by 1.002469075566243
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 100 and amp range 0 2015 and image y 1106 1250 and amp range 0 2047
Range in image: x 0 86 , y 0 145 (with image size 86 x 145)
dzp -0.006045583 -> scaling image by 0.9944472857505693
Stage tims : Wall: 67.45 s, CPU: 0.94 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.177296 MB
Stage tims finished: 2020-08-07T09:28:13.088073
Resources for stage tims : 6.944 s worker CPU, 411.242 s worker Wall, Wall: 67.451 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T09:28:13.243928
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits
Matched 7 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/reference-custom-272351p36733.fits
Stage refs : Wall: 7.17 s, CPU: 6.07 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 245 MB, VmData: 276 MB, maxrss: 0.250776 MB
Stage refs finished: 2020-08-07T09:28:20.416403
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.174 s, Cores in use: 0.85, Total efficiency (on 16 cores): 5.3 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T09:28:20.517082
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/outlier-mask-custom-272351p36733.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/outliers-pre-custom-272351p36733.jpg
Image ksb_160606_105628_ooi_g_ls9-CCD4 g : masking 335 positive outlier pixels and 68 negative outlier pixels
Image ksb_160703_072209_ooi_g_ls9-CCD4 g : masking 63 positive outlier pixels and 0 negative outlier pixels
Image ksb_160503_105424_ooi_g_ls9-CCD2 g : masking 96 positive outlier pixels and 0 negative outlier pixels
Image k4m_170524_112715_ooi_zd_ls9-CCD4 z : masking 1033 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/outlier-mask-custom-272351p36733.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/outliers-post-custom-272351p36733.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/outliers-masked-pos-custom-272351p36733.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/outliers-masked-neg-custom-272351p36733.jpg
Stage outliers : Wall: 4.95 s, CPU: 0.67 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 259 MB, VmData: 287 MB, maxrss: 0.265024 MB
Stage outliers finished: 2020-08-07T09:28:25.470642
Resources for stage outliers : 0.705 s worker CPU, 0.723 s worker Wall, Wall: 4.955 s, Cores in use: 0.28, Total efficiency (on 16 cores): 1.7 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T09:28:26.487756
Stage halos : Wall: 0.40 s, CPU: 0.39 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 259 MB, VmData: 287 MB, maxrss: 0.265264 MB
Stage halos finished: 2020-08-07T09:28:26.888388
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.402 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T09:28:32.553478
PSF sigmas in coadd pixels: ['2.16', '3.00', '2.11', '2.66', '2.07', '1.73']
Using average PSF sigma 2.286018560856563
Gaussian PSF norm 0.12340004434092533 vs pixelized 0.100255534
average tim pixel scale / coadd scale: 1.7292752687797974
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.83', '2.35', '1.89', '1.97']
Using average PSF sigma 2.00942835565997
Gaussian PSF norm 0.14038559323565825 vs pixelized 0.11631499
average tim pixel scale / coadd scale: 1.729686699189132
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.88', '2.02', '1.92']
Using average PSF sigma 1.9382838761181251
Gaussian PSF norm 0.1455384297674911 vs pixelized 0.118105076
average tim pixel scale / coadd scale: 0.9909289411823656
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.27 s, CPU: 0.16 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 261 MB, VmData: 288 MB, maxrss: 0.266948 MB
Stage fit_on_coadds finished: 2020-08-07T09:28:32.828162
Resources for stage fit_on_coadds : 0.181 s worker CPU, 0.181 s worker Wall, Wall: 0.276 s, Cores in use: 1.25, Total efficiency (on 16 cores): 7.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T09:28:32.897129
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 7 in veto map, 1 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 48 potential peaks
Of 48 potential peaks: 37 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 34 potential peaks
Of 34 potential peaks: 25 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 53 potential peaks
Of 53 potential peaks: 38 in veto map, 8 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 50 potential peaks
Of 50 potential peaks: 40 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 29 new sources
Median coadd sky for g : 0.00010757179
Median coadd sky for r : 0.0003959889
Median coadd sky for z : -0.00024560915
Stage srcs : Wall: 0.63 s, CPU: 0.59 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 261 MB, VmData: 288 MB, maxrss: 0.267432 MB
Stage srcs finished: 2020-08-07T09:28:33.525326
Resources for stage srcs : 0.066 s worker CPU, 0.066 s worker Wall, Wall: 0.630 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T09:28:33.580131
Blob 1 of 14, id: 2, sources: 17, size: 174x210, npix 19012, brick X: 26,200, Y: 17,227, one pixel: 68 17
Blob 2 of 14, id: 9, sources: 3, size: 38x59, npix 1608, brick X: 0,38, Y: 160,219, one pixel: 15 160
Blob 3 of 14, id: 8, sources: 2, size: 33x55, npix 1319, brick X: 212,245, Y: 158,213, one pixel: 237 158
Blob 4 of 14, id: 5, sources: 1, size: 30x41, npix 918, brick X: 215,245, Y: 100,141, one pixel: 234 100
Blob 5 of 14, id: 0, sources: 1, size: 36x28, npix 695, brick X: 94,130, Y: 0,28, one pixel: 108 0
Blob 6 of 14, id: 10, sources: 2, size: 32x32, npix 528, brick X: 146,178, Y: 186,218, one pixel: 164 186
Blob 7 of 14, id: 11, sources: 2, size: 35x23, npix 498, brick X: 79,114, Y: 191,214, one pixel: 89 191
Blob 8 of 14, id: 12, sources: 2, size: 22x35, npix 462, brick X: 187,209, Y: 202,237, one pixel: 197 202
Blob 9 of 14, id: 4, sources: 1, size: 25x27, npix 420, brick X: 30,55, Y: 85,112, one pixel: 43 85
Blob 10 of 14, id: 7, sources: 1, size: 25x25, npix 376, brick X: 184,209, Y: 141,166, one pixel: 197 141
Blob 11 of 14, id: 13, sources: 1, size: 24x21, npix 330, brick X: 167,191, Y: 224,245, one pixel: 177 224
Blob 12 of 14, id: 3, sources: 1, size: 22x23, npix 302, brick X: 18,40, Y: 25,48, one pixel: 29 25
Blob 13 of 14, id: 1, sources: 1, size: 21x23, npix 299, brick X: 211,232, Y: 0,23, one pixel: 220 0
Blob 14 of 14, id: 6, sources: 1, size: 22x22, npix 273, brick X: 194,216, Y: 101,123, one pixel: 205 101
Blob 13 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144092 MB
Blob 12 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145268 MB
Blob 11 finished, total: Wall: 0.30 s, CPU: 0.29 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145404 MB
Blob 14 finished, total: Wall: 0.30 s, CPU: 0.25 s, VmPeak: 816 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145884 MB
Blob 8 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093172 MB
Blob 10 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145356 MB
Blob 6 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145296 MB
Blob 7 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 810 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145384 MB
Blob 9 finished, total: Wall: 0.64 s, CPU: 0.63 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145372 MB
Blob 4 finished, total: Wall: 0.66 s, CPU: 0.65 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092516 MB
Blob 2 finished, total: Wall: 0.94 s, CPU: 0.91 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14642 MB
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146728 MB
Measuring 2 iterative sources
Blob 3 finished, total: Wall: 1.71 s, CPU: 1.71 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147272 MB
Exception in one_blob: brick custom-272351p36733, iblob 2
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob
    result = one_blob(X)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob
    B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run
    Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness
    br = src.getBrightness()
AttributeError: 'NoneType' object has no attribute 'getBrightness'
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker
    result = (True, func(*args, **kwds))
  File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__
    R = self.func(*args, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob
    result = one_blob(X)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob
    B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run
    Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness
    br = src.getBrightness()
AttributeError: 'NoneType' object has no attribute 'getBrightness'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3771, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3739, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3295, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3284, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1131, in stage_fitblobs
    r = Riter.next(timeout)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next
    raise value
AttributeError: 'NoneType' object has no attribute 'getBrightness'
Something went wrong; please check the logfile.
ERROR: galaxy PGC2085901; please check the logfile.
Finished galaxy PGC2085901 in 1.563 minutes.
Started working on galaxy PGC2085901 at Fri Aug  7 12:01:48 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35157205699977 36.73303348403848 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T12:01:48.804367
legacypipe git version: DR9.5.11-watershed-4-gcc619972
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.35157205699977', '36.73303348403848', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35157205699977 36.73303348403848 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 272.35157205699977 36.73303348403848
Starting process 15782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 15783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 15784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 15785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 15786 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 15787 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB
Starting process 15788 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB
Starting process 15789 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 15790 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 15791 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 15792 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 15793 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 15794 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 15795 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 15796 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 15797 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 15798 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 15799 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 15800 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 15801 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 15802 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 15803 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 15804 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 15805 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 15806 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 15807 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 15808 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 15810 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 15811 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 15809 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 15812 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 15813 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-srcs.p and forcing stage srcs
Runstage fit_on_coadds
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p and forcing stage fit_on_coadds
Runstage halos
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-halos.p and forcing stage halos
Runstage outliers
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-outliers.p and forcing stage outliers
Runstage refs
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-refs.p and forcing stage refs
Runstage tims
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-tims.p and forcing stage tims
Running stage tims
Running stage tims at 2020-08-07T12:01:49.285328
Keeping 13 CCDs:
  k4m_160415_113533_ooi_zd_ls9-CCD3 z expnum 82527 exptime 148.106 propid 2016A-0453 seeing 1.16 MJD 57493.483 object MzLS_588542_z 
    mosaic/CP/V4.3/CP20160414/k4m_160415_113533_ooi_zd_ls9.fits.fz
  k4m_170524_112715_ooi_zd_ls9-CCD4 z expnum 129993 exptime 149.103 propid 2016A-0453 seeing 1.24 MJD 57897.477 object MzLS_586530_z 
    mosaic/CP/V4.3/CP20170523/k4m_170524_112715_ooi_zd_ls9.fits.fz
  k4m_170613_105413_ooi_zd_ls9-CCD2 z expnum 133154 exptime 151.106 propid 2016A-0453 seeing 1.18 MJD 57917.454 object MzLS_587537_z 
    mosaic/CP/V4.3/CP20170612/k4m_170613_105413_ooi_zd_ls9.fits.fz
  ksb_160511_105540_ooi_r_ls9-CCD1 r expnum 75190248 exptime 56.0 propid BASS seeing 1.13 MJD 57519.455 object 09592 
    90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz
  ksb_160503_105424_ooi_g_ls9-CCD2 g expnum 75110180 exptime 80.0 propid BASS seeing 1.33 MJD 57511.454 object 10931 
    90prime/CP/V2.3/CP20160502/ksb_160503_105424_ooi_g_ls9.fits.fz
  ksb_160429_110145_ooi_r_ls9-CCD2 r expnum 75070185 exptime 175.2 propid BASS seeing 1.45 MJD 57507.460 object 10931 
    90prime/CP/V2.3/CP20160428/ksb_160429_110145_ooi_r_ls9.fits.fz
  ksb_160628_080048_ooi_r_ls9-CCD2 r expnum 75670115 exptime 155.9 propid BASS seeing 1.16 MJD 57567.334 object 10933 
    90prime/CP/V2.3/CP20160627/ksb_160628_080048_ooi_r_ls9.fits.fz
  ksb_160705_065914_ooi_g_ls9-CCD2 g expnum 75740094 exptime 108.3 propid BASS seeing 1.84 MJD 57574.291 object 10933 
    90prime/CP/V2.3/CP20160704/ksb_160705_065914_ooi_g_ls9.fits.fz
  ksb_160703_071935_ooi_g_ls9-CCD1 g expnum 75720041 exptime 74.4 propid BASS seeing 1.30 MJD 57572.305 object 09592 
    90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz
  ksb_160606_104535_ooi_g_ls9-CCD1 g expnum 75450149 exptime 250.0 propid BASS seeing 1.63 MJD 57545.448 object 09592 
    90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz
  ksb_160606_105628_ooi_g_ls9-CCD4 g expnum 75450151 exptime 250.0 propid BASS seeing 1.27 MJD 57545.456 object 10932 
    90prime/CP/V2.3/CP20160605/ksb_160606_105628_ooi_g_ls9.fits.fz
  ksb_160703_072209_ooi_g_ls9-CCD4 g expnum 75720042 exptime 70.5 propid BASS seeing 1.07 MJD 57572.307 object 10932 
    90prime/CP/V2.3/CP20160702/ksb_160703_072209_ooi_g_ls9.fits.fz
  ksb_160513_103142_ooi_r_ls9-CCD4 r expnum 75210208 exptime 61.8 propid BASS seeing 1.21 MJD 57521.439 object 10932 
    90prime/CP/V2.3/CP20160512/ksb_160513_103142_ooi_r_ls9.fits.fz
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
90prime get_fwhm: self.fwhm = 2.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3982 4016 and amp range 2016 4031 and image y 694 836 and amp range 0 2047
Range in image: x 0 35 , y 0 143 (with image size 35 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
90prime get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 169 314 and amp range 0 2015 and image y 2651 2794 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
mosaic get_fwhm: self.fwhm = 4.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 601 848 and amp range 0 2047 and image y 1725 1974 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1979 2123 and amp range 0 2015 and image y 3160 3303 and amp range 2048 4095
Range in image: x 0 37 , y 0 144 (with image size 145 x 144)
dzp 0.016961161 -> scaling image by 1.0157444649385616
Found overlap: image x 1979 2123 and amp range 2016 4031 and image y 3160 3303 and amp range 2048 4095
Range in image: x 37 145 , y 0 144 (with image size 145 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
mosaic get_fwhm: self.fwhm = 4.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2207 2454 and amp range 2006 4053 and image y 1574 1823 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
90prime get_fwhm: self.fwhm = 2.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 169 314 and amp range 0 2015 and image y 2660 2803 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.00015519658 -> scaling image by 0.9998570688798908
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3985 4016 and amp range 2016 4031 and image y 693 835 and amp range 0 2047
Range in image: x 0 32 , y 0 143 (with image size 32 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
90prime get_fwhm: self.fwhm = 4.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 103 and amp range 0 2015 and image y 1161 1305 and amp range 0 2047
Range in image: x 0 89 , y 0 145 (with image size 89 x 145)
dzp -0.008523628 -> scaling image by 0.992180183483648
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 100 and amp range 0 2015 and image y 1106 1250 and amp range 0 2047
Range in image: x 0 86 , y 0 145 (with image size 86 x 145)
dzp -0.006045583 -> scaling image by 0.9944472857505693
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
90prime get_fwhm: self.fwhm = 2.93
Found 4 relevant rows in amp-corrections file.
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1959 2102 and amp range 0 2015 and image y 3179 3322 and amp range 2048 4095
Range in image: x 0 57 , y 0 144 (with image size 144 x 144)
dzp 0.01693853 -> scaling image by 1.015723292931903
Found overlap: image x 4000 4016 and amp range 2016 4031 and image y 747 889 and amp range 0 2047
Range in image: x 0 17 , y 0 143 (with image size 17 x 143)
Found overlap: image x 1959 2102 and amp range 2016 4031 and image y 3179 3322 and amp range 2048 4095
dzp 0.0047082007 -> scaling image by 1.0043458289369953
Range in image: x 57 144 , y 0 144 (with image size 144 x 144)
dzp 0.0026774607 -> scaling image by 1.002469075566243
mosaic get_fwhm: self.fwhm = 4.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3254 3506 and amp range 2048 4095 and image y 717 965 and amp range 0 2021
Range in image: x 0 253 , y 0 249 (with image size 253 x 249)
dzp -0.03444113 -> scaling image by 0.9687763957004109
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 170 315 and amp range 0 2015 and image y 2641 2785 and amp range 2048 4095
Range in image: x 0 146 , y 0 145 (with image size 146 x 145)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
Stage tims : Wall: 2.29 s, CPU: 0.78 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178164 MB
Stage tims finished: 2020-08-07T12:01:51.571964
Resources for stage tims : 6.995 s worker CPU, 16.007 s worker Wall, Wall: 2.289 s, Cores in use: 3.40, Total efficiency (on 32 cores): 10.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T12:01:53.042669
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits
Matched 7 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/reference-custom-272351p36733.fits
Stage refs : Wall: 6.07 s, CPU: 5.70 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 245 MB, VmData: 277 MB, maxrss: 0.251304 MB
Stage refs finished: 2020-08-07T12:01:59.114274
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 6.074 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T12:01:59.145637
Stage outliers : Wall: 0.35 s, CPU: 0.32 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 246 MB, VmData: 277 MB, maxrss: 0.252404 MB
Stage outliers finished: 2020-08-07T12:01:59.499774
Resources for stage outliers : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.356 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T12:01:59.526276
Stage halos : Wall: 0.23 s, CPU: 0.22 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 249 MB, VmData: 280 MB, maxrss: 0.254812 MB
Stage halos finished: 2020-08-07T12:01:59.760762
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.237 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T12:02:00.974646
PSF sigmas in coadd pixels: ['2.16', '3.00', '2.11', '2.66', '2.07', '1.73']
Using average PSF sigma 2.286018560856563
Gaussian PSF norm 0.12340004434092533 vs pixelized 0.100255534
average tim pixel scale / coadd scale: 1.7292752687797974
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.83', '2.35', '1.89', '1.97']
Using average PSF sigma 2.00942835565997
Gaussian PSF norm 0.14038559323565825 vs pixelized 0.11631499
average tim pixel scale / coadd scale: 1.729686699189132
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.88', '2.02', '1.92']
Using average PSF sigma 1.9382838761181251
Gaussian PSF norm 0.1455384297674911 vs pixelized 0.118105076
average tim pixel scale / coadd scale: 0.9909289411823656
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.16 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 258 MB, VmData: 287 MB, maxrss: 0.264308 MB
Stage fit_on_coadds finished: 2020-08-07T12:02:01.232100
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.193 s worker CPU, 0.284 s worker Wall, Wall: 0.260 s, Cores in use: 1.37, Total efficiency (on 32 cores): 4.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T12:02:01.244579
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 7 in veto map, 1 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 48 potential peaks
Of 48 potential peaks: 37 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 34 potential peaks
Of 34 potential peaks: 25 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 53 potential peaks
Of 53 potential peaks: 38 in veto map, 8 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 50 potential peaks
Of 50 potential peaks: 40 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 29 new sources
Median coadd sky for g : 0.00010757179
Median coadd sky for r : 0.0003959889
Median coadd sky for z : -0.00024560906
Stage srcs : Wall: 0.68 s, CPU: 0.62 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 259 MB, VmData: 287 MB, maxrss: 0.26512 MB
Stage srcs finished: 2020-08-07T12:02:01.921616
Resources for stage srcs : 0.093 s worker CPU, 0.103 s worker Wall, Wall: 0.679 s, Cores in use: 1.06, Total efficiency (on 32 cores): 3.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T12:02:01.937236
Blob 1 of 14, id: 2, sources: 17, size: 174x210, npix 19012, brick X: 26,200, Y: 17,227, one pixel: 68 17
Blob 2 of 14, id: 9, sources: 3, size: 38x59, npix 1608, brick X: 0,38, Y: 160,219, one pixel: 15 160
Blob 3 of 14, id: 8, sources: 2, size: 33x55, npix 1319, brick X: 212,245, Y: 158,213, one pixel: 237 158
Blob 4 of 14, id: 5, sources: 1, size: 30x41, npix 918, brick X: 215,245, Y: 100,141, one pixel: 234 100
Blob 5 of 14, id: 0, sources: 1, size: 36x28, npix 695, brick X: 94,130, Y: 0,28, one pixel: 108 0
Blob 6 of 14, id: 10, sources: 2, size: 32x32, npix 528, brick X: 146,178, Y: 186,218, one pixel: 164 186
Blob 7 of 14, id: 11, sources: 2, size: 35x23, npix 498, brick X: 79,114, Y: 191,214, one pixel: 89 191
Blob 8 of 14, id: 12, sources: 2, size: 22x35, npix 462, brick X: 187,209, Y: 202,237, one pixel: 197 202
Blob 9 of 14, id: 4, sources: 1, size: 25x27, npix 420, brick X: 30,55, Y: 85,112, one pixel: 43 85
Blob 10 of 14, id: 7, sources: 1, size: 25x25, npix 376, brick X: 184,209, Y: 141,166, one pixel: 197 141
Blob 11 of 14, id: 13, sources: 1, size: 24x21, npix 330, brick X: 167,191, Y: 224,245, one pixel: 177 224
Blob 12 of 14, id: 3, sources: 1, size: 22x23, npix 302, brick X: 18,40, Y: 25,48, one pixel: 29 25
Blob 13 of 14, id: 1, sources: 1, size: 21x23, npix 299, brick X: 211,232, Y: 0,23, one pixel: 220 0
Blob 14 of 14, id: 6, sources: 1, size: 22x22, npix 273, brick X: 194,216, Y: 101,123, one pixel: 205 101
Blob 13 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 139 MB, maxrss: 0.0876 MB
Blob 12 finished, total: Wall: 0.13 s, CPU: 0.08 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083824 MB
Blob 14 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14544 MB
Blob 11 finished, total: Wall: 0.21 s, CPU: 0.20 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.089528 MB
Blob 10 finished, total: Wall: 0.32 s, CPU: 0.30 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089812 MB
Blob 7 finished, total: Wall: 0.41 s, CPU: 0.40 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144664 MB
Blob 8 finished, total: Wall: 0.42 s, CPU: 0.38 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089948 MB
Blob 9 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145684 MB
Blob 6 finished, total: Wall: 0.43 s, CPU: 0.41 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089964 MB
Blob 4 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144264 MB
Blob 2 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146092 MB
Measuring 1 iterative sources
Measuring 2 iterative sources
Blob 5 finished, total: Wall: 1.16 s, CPU: 1.14 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092232 MB
Blob 3 finished, total: Wall: 1.69 s, CPU: 1.65 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093092 MB
Exception in one_blob: brick custom-272351p36733, iblob 2
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob
    result = one_blob(X)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob
    B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run
    Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness
    br = src.getBrightness()
AttributeError: 'NoneType' object has no attribute 'getBrightness'
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker
    result = (True, func(*args, **kwds))
  File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__
    R = self.func(*args, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob
    result = one_blob(X)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob
    B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run
    Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness
    br = src.getBrightness()
AttributeError: 'NoneType' object has no attribute 'getBrightness'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs
    r = Riter.next(timeout)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next
    raise value
AttributeError: 'NoneType' object has no attribute 'getBrightness'
Something went wrong; please check the logfile.
ERROR: galaxy PGC2085901; please check the logfile.
Finished galaxy PGC2085901 in 0.286 minutes.
Started working on galaxy PGC2085901 at Fri Aug  7 12:31:14 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35157205699977 36.73303348403848 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T12:31:15.061213
legacypipe git version: DR9.5.11-watershed-4-gcc619972
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.35157205699977', '36.73303348403848', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35157205699977 36.73303348403848 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 272.35157205699977 36.73303348403848
Starting process 19350 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 19351 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 19352 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 19353 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 19354 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 19355 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB
Starting process 19356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB
Starting process 19357 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 19358 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 19359 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 19360 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 19361 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 19362 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 19363 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 19364 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 19365 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 19366 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 19367 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 19368 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 19369 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 19370 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 19371 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 19372 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 19373 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 19374 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 19375 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 19376 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 19377 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 19378 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 19379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 19380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 19381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T12:31:15.481395
Keeping 13 CCDs:
  k4m_160415_113533_ooi_zd_ls9-CCD3 z expnum 82527 exptime 148.106 propid 2016A-0453 seeing 1.16 MJD 57493.483 object MzLS_588542_z 
    mosaic/CP/V4.3/CP20160414/k4m_160415_113533_ooi_zd_ls9.fits.fz
  k4m_170524_112715_ooi_zd_ls9-CCD4 z expnum 129993 exptime 149.103 propid 2016A-0453 seeing 1.24 MJD 57897.477 object MzLS_586530_z 
    mosaic/CP/V4.3/CP20170523/k4m_170524_112715_ooi_zd_ls9.fits.fz
  k4m_170613_105413_ooi_zd_ls9-CCD2 z expnum 133154 exptime 151.106 propid 2016A-0453 seeing 1.18 MJD 57917.454 object MzLS_587537_z 
    mosaic/CP/V4.3/CP20170612/k4m_170613_105413_ooi_zd_ls9.fits.fz
  ksb_160511_105540_ooi_r_ls9-CCD1 r expnum 75190248 exptime 56.0 propid BASS seeing 1.13 MJD 57519.455 object 09592 
    90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz
  ksb_160503_105424_ooi_g_ls9-CCD2 g expnum 75110180 exptime 80.0 propid BASS seeing 1.33 MJD 57511.454 object 10931 
    90prime/CP/V2.3/CP20160502/ksb_160503_105424_ooi_g_ls9.fits.fz
  ksb_160429_110145_ooi_r_ls9-CCD2 r expnum 75070185 exptime 175.2 propid BASS seeing 1.45 MJD 57507.460 object 10931 
    90prime/CP/V2.3/CP20160428/ksb_160429_110145_ooi_r_ls9.fits.fz
  ksb_160628_080048_ooi_r_ls9-CCD2 r expnum 75670115 exptime 155.9 propid BASS seeing 1.16 MJD 57567.334 object 10933 
    90prime/CP/V2.3/CP20160627/ksb_160628_080048_ooi_r_ls9.fits.fz
  ksb_160705_065914_ooi_g_ls9-CCD2 g expnum 75740094 exptime 108.3 propid BASS seeing 1.84 MJD 57574.291 object 10933 
    90prime/CP/V2.3/CP20160704/ksb_160705_065914_ooi_g_ls9.fits.fz
  ksb_160703_071935_ooi_g_ls9-CCD1 g expnum 75720041 exptime 74.4 propid BASS seeing 1.30 MJD 57572.305 object 09592 
    90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz
  ksb_160606_104535_ooi_g_ls9-CCD1 g expnum 75450149 exptime 250.0 propid BASS seeing 1.63 MJD 57545.448 object 09592 
    90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz
  ksb_160606_105628_ooi_g_ls9-CCD4 g expnum 75450151 exptime 250.0 propid BASS seeing 1.27 MJD 57545.456 object 10932 
    90prime/CP/V2.3/CP20160605/ksb_160606_105628_ooi_g_ls9.fits.fz
  ksb_160703_072209_ooi_g_ls9-CCD4 g expnum 75720042 exptime 70.5 propid BASS seeing 1.07 MJD 57572.307 object 10932 
    90prime/CP/V2.3/CP20160702/ksb_160703_072209_ooi_g_ls9.fits.fz
  ksb_160513_103142_ooi_r_ls9-CCD4 r expnum 75210208 exptime 61.8 propid BASS seeing 1.21 MJD 57521.439 object 10932 
    90prime/CP/V2.3/CP20160512/ksb_160513_103142_ooi_r_ls9.fits.fz
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
90prime get_fwhm: self.fwhm = 4.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 103 and amp range 0 2015 and image y 1161 1305 and amp range 0 2047
Range in image: x 0 89 , y 0 145 (with image size 89 x 145)
dzp -0.008523628 -> scaling image by 0.992180183483648
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1979 2123 and amp range 0 2015 and image y 3160 3303 and amp range 2048 4095
Range in image: x 0 37 , y 0 144 (with image size 145 x 144)
dzp 0.016961161 -> scaling image by 1.0157444649385616
Found overlap: image x 1979 2123 and amp range 2016 4031 and image y 3160 3303 and amp range 2048 4095
Range in image: x 37 145 , y 0 144 (with image size 145 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
mosaic get_fwhm: self.fwhm = 4.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 601 848 and amp range 0 2047 and image y 1725 1974 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
90prime get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 169 314 and amp range 0 2015 and image y 2651 2794 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
90prime get_fwhm: self.fwhm = 2.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3982 4016 and amp range 2016 4031 and image y 694 836 and amp range 0 2047
Range in image: x 0 35 , y 0 143 (with image size 35 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 100 and amp range 0 2015 and image y 1106 1250 and amp range 0 2047
Range in image: x 0 86 , y 0 145 (with image size 86 x 145)
dzp -0.006045583 -> scaling image by 0.9944472857505693
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
90prime get_fwhm: self.fwhm = 2.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 169 314 and amp range 0 2015 and image y 2660 2803 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.00015519658 -> scaling image by 0.9998570688798908
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3985 4016 and amp range 2016 4031 and image y 693 835 and amp range 0 2047
Range in image: x 0 32 , y 0 143 (with image size 32 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 4000 4016 and amp range 2016 4031 and image y 747 889 and amp range 0 2047
Range in image: x 0 17 , y 0 143 (with image size 17 x 143)
dzp 0.0047082007 -> scaling image by 1.0043458289369953
mosaic get_fwhm: self.fwhm = 4.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2207 2454 and amp range 2006 4053 and image y 1574 1823 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
90prime get_fwhm: self.fwhm = 2.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1959 2102 and amp range 0 2015 and image y 3179 3322 and amp range 2048 4095
Range in image: x 0 57 , y 0 144 (with image size 144 x 144)
dzp 0.01693853 -> scaling image by 1.015723292931903
Found overlap: image x 1959 2102 and amp range 2016 4031 and image y 3179 3322 and amp range 2048 4095
Range in image: x 57 144 , y 0 144 (with image size 144 x 144)
dzp 0.0026774607 -> scaling image by 1.002469075566243
mosaic get_fwhm: self.fwhm = 4.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3254 3506 and amp range 2048 4095 and image y 717 965 and amp range 0 2021
Range in image: x 0 253 , y 0 249 (with image size 253 x 249)
dzp -0.03444113 -> scaling image by 0.9687763957004109
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 170 315 and amp range 0 2015 and image y 2641 2785 and amp range 2048 4095
Range in image: x 0 146 , y 0 145 (with image size 146 x 145)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
Stage tims : Wall: 2.88 s, CPU: 0.81 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.17804 MB
Stage tims finished: 2020-08-07T12:31:18.362203
Resources for stage tims : 6.666 s worker CPU, 19.194 s worker Wall, Wall: 2.883 s, Cores in use: 2.59, Total efficiency (on 32 cores): 8.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T12:31:18.404130
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits
Matched 7 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/reference-custom-272351p36733.fits
Stage refs : Wall: 5.92 s, CPU: 5.62 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 246 MB, VmData: 277 MB, maxrss: 0.251424 MB
Stage refs finished: 2020-08-07T12:31:24.327971
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.926 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T12:31:24.352374
Stage outliers : Wall: 0.29 s, CPU: 0.27 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 247 MB, VmData: 277 MB, maxrss: 0.252544 MB
Stage outliers finished: 2020-08-07T12:31:24.643529
Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.293 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T12:31:24.669741
Stage halos : Wall: 0.21 s, CPU: 0.21 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 249 MB, VmData: 280 MB, maxrss: 0.254876 MB
Stage halos finished: 2020-08-07T12:31:24.883749
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.216 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T12:31:24.919297
PSF sigmas in coadd pixels: ['2.16', '3.00', '2.11', '2.66', '2.07', '1.73']
Using average PSF sigma 2.286018560856563
Gaussian PSF norm 0.12340004434092533 vs pixelized 0.10025553
average tim pixel scale / coadd scale: 1.7292752687797974
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.83', '2.35', '1.89', '1.97']
Using average PSF sigma 2.00942835565997
Gaussian PSF norm 0.14038559323565825 vs pixelized 0.11631499
average tim pixel scale / coadd scale: 1.729686699189132
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.88', '2.02', '1.92']
Using average PSF sigma 1.9382838761181251
Gaussian PSF norm 0.1455384297674911 vs pixelized 0.118105076
average tim pixel scale / coadd scale: 0.9909289411823656
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.17 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 259 MB, VmData: 287 MB, maxrss: 0.264728 MB
Stage fit_on_coadds finished: 2020-08-07T12:31:25.105761
Resources for stage fit_on_coadds : 0.183 s worker CPU, 0.274 s worker Wall, Wall: 0.189 s, Cores in use: 1.87, Total efficiency (on 32 cores): 5.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Running stage srcs
Warning: Stellar halo subtraction is only implemented for DECam
Running stage srcs at 2020-08-07T12:31:25.117903
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 7 in veto map, 1 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 48 potential peaks
Of 48 potential peaks: 37 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 34 potential peaks
Of 34 potential peaks: 25 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 53 potential peaks
Of 53 potential peaks: 38 in veto map, 8 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 50 potential peaks
Of 50 potential peaks: 40 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 29 new sources
Median coadd sky for g : 0.00010757179
Median coadd sky for r : 0.0003959889
Median coadd sky for z : -0.00024560915
Stage srcs : Wall: 0.47 s, CPU: 0.43 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 259 MB, VmData: 287 MB, maxrss: 0.265488 MB
Stage srcs finished: 2020-08-07T12:31:25.591251
Resources for stage srcs : 0.083 s worker CPU, 0.083 s worker Wall, Wall: 0.476 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T12:31:25.621025
Blob 1 of 14, id: 2, sources: 17, size: 174x210, npix 19012, brick X: 26,200, Y: 17,227, one pixel: 68 17
Blob 2 of 14, id: 9, sources: 3, size: 38x59, npix 1608, brick X: 0,38, Y: 160,219, one pixel: 15 160
Blob 3 of 14, id: 8, sources: 2, size: 33x55, npix 1319, brick X: 212,245, Y: 158,213, one pixel: 237 158
Blob 4 of 14, id: 5, sources: 1, size: 30x41, npix 918, brick X: 215,245, Y: 100,141, one pixel: 234 100
Blob 5 of 14, id: 0, sources: 1, size: 36x28, npix 695, brick X: 94,130, Y: 0,28, one pixel: 108 0
Blob 6 of 14, id: 10, sources: 2, size: 32x32, npix 528, brick X: 146,178, Y: 186,218, one pixel: 164 186
Blob 7 of 14, id: 11, sources: 2, size: 35x23, npix 498, brick X: 79,114, Y: 191,214, one pixel: 89 191
Blob 8 of 14, id: 12, sources: 2, size: 22x35, npix 462, brick X: 187,209, Y: 202,237, one pixel: 197 202
Blob 9 of 14, id: 4, sources: 1, size: 25x27, npix 420, brick X: 30,55, Y: 85,112, one pixel: 43 85
Blob 10 of 14, id: 7, sources: 1, size: 25x25, npix 376, brick X: 184,209, Y: 141,166, one pixel: 197 141
Blob 11 of 14, id: 13, sources: 1, size: 24x21, npix 330, brick X: 167,191, Y: 224,245, one pixel: 177 224
Blob 12 of 14, id: 3, sources: 1, size: 22x23, npix 302, brick X: 18,40, Y: 25,48, one pixel: 29 25
Blob 13 of 14, id: 1, sources: 1, size: 21x23, npix 299, brick X: 211,232, Y: 0,23, one pixel: 220 0
Blob 14 of 14, id: 6, sources: 1, size: 22x22, npix 273, brick X: 194,216, Y: 101,123, one pixel: 205 101
Blob 12 finished, total: Wall: 0.06 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145064 MB
Blob 13 finished, total: Wall: 0.13 s, CPU: 0.09 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083824 MB
Blob 14 finished, total: Wall: 0.24 s, CPU: 0.17 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.08954 MB
Blob 11 finished, total: Wall: 0.26 s, CPU: 0.22 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089612 MB
Blob 10 finished, total: Wall: 0.35 s, CPU: 0.34 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089788 MB
Blob 8 finished, total: Wall: 0.37 s, CPU: 0.36 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14568 MB
Blob 6 finished, total: Wall: 0.43 s, CPU: 0.41 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090028 MB
Blob 9 finished, total: Wall: 0.46 s, CPU: 0.44 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.090736 MB
Blob 7 finished, total: Wall: 0.46 s, CPU: 0.40 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090068 MB
Blob 4 finished, total: Wall: 0.67 s, CPU: 0.65 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090444 MB
Blob 2 finished, total: Wall: 0.87 s, CPU: 0.84 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091192 MB
Measuring 1 iterative sources
Measuring 2 iterative sources
Blob 5 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145728 MB
Blob 3 finished, total: Wall: 1.65 s, CPU: 1.63 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093176 MB
Exception in one_blob: brick custom-272351p36733, iblob 2
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob
    result = one_blob(X)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob
    B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run
    Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness
    br = src.getBrightness()
AttributeError: 'NoneType' object has no attribute 'getBrightness'
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker
    result = (True, func(*args, **kwds))
  File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__
    R = self.func(*args, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob
    result = one_blob(X)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob
    B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run
    Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness
    br = src.getBrightness()
AttributeError: 'NoneType' object has no attribute 'getBrightness'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs
    r = Riter.next(timeout)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next
    raise value
AttributeError: 'NoneType' object has no attribute 'getBrightness'
Something went wrong; please check the logfile.
ERROR: galaxy PGC2085901; please check the logfile.
Finished galaxy PGC2085901 in 0.242 minutes.
Started working on galaxy PGC2085901 at Fri Aug  7 13:29:53 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35157205699977 36.73303348403848 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T13:29:54.513098
legacypipe git version: DR9.5.11-watershed-5-g77ea3463
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.35157205699977', '36.73303348403848', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.35157205699977 36.73303348403848 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 272.35157205699977 36.73303348403848
Starting process 19592 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 19593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 19594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 19595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 19596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 19597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 19598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 19599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 19600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 19601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 19602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 19603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 19604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 19605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 19606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 19607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 19608 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 19609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 19610 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 19611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 19612 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 19613 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 19614 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 19615 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 19616 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 19617 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 19618 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 19619 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 19620 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 19621 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 19622 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 19623 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T13:29:55.055710
Keeping 13 CCDs:
  k4m_160415_113533_ooi_zd_ls9-CCD3 z expnum 82527 exptime 148.106 propid 2016A-0453 seeing 1.16 MJD 57493.483 object MzLS_588542_z 
    mosaic/CP/V4.3/CP20160414/k4m_160415_113533_ooi_zd_ls9.fits.fz
  k4m_170524_112715_ooi_zd_ls9-CCD4 z expnum 129993 exptime 149.103 propid 2016A-0453 seeing 1.24 MJD 57897.477 object MzLS_586530_z 
    mosaic/CP/V4.3/CP20170523/k4m_170524_112715_ooi_zd_ls9.fits.fz
  k4m_170613_105413_ooi_zd_ls9-CCD2 z expnum 133154 exptime 151.106 propid 2016A-0453 seeing 1.18 MJD 57917.454 object MzLS_587537_z 
    mosaic/CP/V4.3/CP20170612/k4m_170613_105413_ooi_zd_ls9.fits.fz
  ksb_160511_105540_ooi_r_ls9-CCD1 r expnum 75190248 exptime 56.0 propid BASS seeing 1.13 MJD 57519.455 object 09592 
    90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz
  ksb_160503_105424_ooi_g_ls9-CCD2 g expnum 75110180 exptime 80.0 propid BASS seeing 1.33 MJD 57511.454 object 10931 
    90prime/CP/V2.3/CP20160502/ksb_160503_105424_ooi_g_ls9.fits.fz
  ksb_160429_110145_ooi_r_ls9-CCD2 r expnum 75070185 exptime 175.2 propid BASS seeing 1.45 MJD 57507.460 object 10931 
    90prime/CP/V2.3/CP20160428/ksb_160429_110145_ooi_r_ls9.fits.fz
  ksb_160628_080048_ooi_r_ls9-CCD2 r expnum 75670115 exptime 155.9 propid BASS seeing 1.16 MJD 57567.334 object 10933 
    90prime/CP/V2.3/CP20160627/ksb_160628_080048_ooi_r_ls9.fits.fz
  ksb_160705_065914_ooi_g_ls9-CCD2 g expnum 75740094 exptime 108.3 propid BASS seeing 1.84 MJD 57574.291 object 10933 
    90prime/CP/V2.3/CP20160704/ksb_160705_065914_ooi_g_ls9.fits.fz
  ksb_160703_071935_ooi_g_ls9-CCD1 g expnum 75720041 exptime 74.4 propid BASS seeing 1.30 MJD 57572.305 object 09592 
    90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz
  ksb_160606_104535_ooi_g_ls9-CCD1 g expnum 75450149 exptime 250.0 propid BASS seeing 1.63 MJD 57545.448 object 09592 
    90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz
  ksb_160606_105628_ooi_g_ls9-CCD4 g expnum 75450151 exptime 250.0 propid BASS seeing 1.27 MJD 57545.456 object 10932 
    90prime/CP/V2.3/CP20160605/ksb_160606_105628_ooi_g_ls9.fits.fz
  ksb_160703_072209_ooi_g_ls9-CCD4 g expnum 75720042 exptime 70.5 propid BASS seeing 1.07 MJD 57572.307 object 10932 
    90prime/CP/V2.3/CP20160702/ksb_160703_072209_ooi_g_ls9.fits.fz
  ksb_160513_103142_ooi_r_ls9-CCD4 r expnum 75210208 exptime 61.8 propid BASS seeing 1.21 MJD 57521.439 object 10932 
    90prime/CP/V2.3/CP20160512/ksb_160513_103142_ooi_r_ls9.fits.fz
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
Faked up EXPNUM 75720042
90prime get_fwhm: self.fwhm = 2.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3982 4016 and amp range 2016 4031 and image y 694 836 and amp range 0 2047
Range in image: x 0 35 , y 0 143 (with image size 35 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
Faked up EXPNUM 75190248
90prime get_fwhm: self.fwhm = 2.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 169 314 and amp range 0 2015 and image y 2660 2803 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.00015519658 -> scaling image by 0.9998570688798908
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
Faked up EXPNUM 75720041
90prime get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 169 314 and amp range 0 2015 and image y 2651 2794 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
Faked up EXPNUM 75450151
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3985 4016 and amp range 2016 4031 and image y 693 835 and amp range 0 2047
Range in image: x 0 32 , y 0 143 (with image size 32 x 143)
dzp 0.010226944 -> scaling image by 1.0094638657706572
mosaic get_fwhm: self.fwhm = 4.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3254 3506 and amp range 2048 4095 and image y 717 965 and amp range 0 2021
Range in image: x 0 253 , y 0 249 (with image size 253 x 249)
dzp -0.03444113 -> scaling image by 0.9687763957004109
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
Faked up EXPNUM 75210208
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 4000 4016 and amp range 2016 4031 and image y 747 889 and amp range 0 2047
Range in image: x 0 17 , y 0 143 (with image size 17 x 143)
dzp 0.0047082007 -> scaling image by 1.0043458289369953
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
Faked up EXPNUM 75740094
90prime get_fwhm: self.fwhm = 4.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 103 and amp range 0 2015 and image y 1161 1305 and amp range 0 2047
Range in image: x 0 89 , y 0 145 (with image size 89 x 145)
dzp -0.008523628 -> scaling image by 0.992180183483648
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
Faked up EXPNUM 75110180
90prime get_fwhm: self.fwhm = 2.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1959 2102 and amp range 0 2015 and image y 3179 3322 and amp range 2048 4095
Range in image: x 0 57 , y 0 144 (with image size 144 x 144)
dzp 0.01693853 -> scaling image by 1.015723292931903
Found overlap: image x 1959 2102 and amp range 2016 4031 and image y 3179 3322 and amp range 2048 4095
Range in image: x 57 144 , y 0 144 (with image size 144 x 144)
dzp 0.0026774607 -> scaling image by 1.002469075566243
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
Faked up EXPNUM 75450149
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 170 315 and amp range 0 2015 and image y 2641 2785 and amp range 2048 4095
Range in image: x 0 146 , y 0 145 (with image size 146 x 145)
dzp -0.0051191514 -> scaling image by 0.9952961850385206
mosaic get_fwhm: self.fwhm = 4.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 601 848 and amp range 0 2047 and image y 1725 1974 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
Faked up EXPNUM 75070185
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1979 2123 and amp range 0 2015 and image y 3160 3303 and amp range 2048 4095
Range in image: x 0 37 , y 0 144 (with image size 145 x 144)
dzp 0.016961161 -> scaling image by 1.0157444649385616
Found overlap: image x 1979 2123 and amp range 2016 4031 and image y 3160 3303 and amp range 2048 4095
Range in image: x 37 145 , y 0 144 (with image size 145 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
mosaic get_fwhm: self.fwhm = 4.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2207 2454 and amp range 2006 4053 and image y 1574 1823 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
Faked up EXPNUM 75670115
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 100 and amp range 0 2015 and image y 1106 1250 and amp range 0 2047
Range in image: x 0 86 , y 0 145 (with image size 86 x 145)
dzp -0.006045583 -> scaling image by 0.9944472857505693
Stage tims : Wall: 5.74 s, CPU: 0.81 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.177672 MB
Stage tims finished: 2020-08-07T13:30:00.796264
Resources for stage tims : 6.351 s worker CPU, 21.199 s worker Wall, Wall: 5.743 s, Cores in use: 1.25, Total efficiency (on 32 cores): 3.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T13:30:00.831704
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits
Matched 7 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/reference-custom-272351p36733.fits
Stage refs : Wall: 8.08 s, CPU: 5.78 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 245 MB, VmData: 277 MB, maxrss: 0.251032 MB
Stage refs finished: 2020-08-07T13:30:08.910764
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 8.081 s, Cores in use: 0.72, Total efficiency (on 32 cores): 2.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T13:30:08.937428
Stage outliers : Wall: 0.43 s, CPU: 0.39 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 246 MB, VmData: 277 MB, maxrss: 0.25212 MB
Stage outliers finished: 2020-08-07T13:30:09.365005
Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.430 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T13:30:09.389843
Stage halos : Wall: 0.23 s, CPU: 0.21 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 249 MB, VmData: 280 MB, maxrss: 0.2546 MB
Stage halos finished: 2020-08-07T13:30:09.615000
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.227 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T13:30:10.047535
PSF sigmas in coadd pixels: ['2.16', '3.00', '2.11', '2.66', '2.07', '1.73']
Using average PSF sigma 2.286018560856563
Gaussian PSF norm 0.12340004434092533 vs pixelized 0.100255534
average tim pixel scale / coadd scale: 1.7292752687797974
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.83', '2.35', '1.89', '1.97']
Using average PSF sigma 2.00942835565997
Gaussian PSF norm 0.14038559323565825 vs pixelized 0.11631499
average tim pixel scale / coadd scale: 1.729686699189132
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.88', '2.02', '1.92']
Using average PSF sigma 1.9382838761181251
Gaussian PSF norm 0.1455384297674911 vs pixelized 0.118105076
average tim pixel scale / coadd scale: 0.9909289411823656
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.16 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 258 MB, VmData: 287 MB, maxrss: 0.264244 MB
Stage fit_on_coadds finished: 2020-08-07T13:30:10.214648
Resources for stage fit_on_coadds : 0.194 s worker CPU, 0.234 s worker Wall, Wall: 0.170 s, Cores in use: 2.08, Total efficiency (on 32 cores): 6.5 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-fit_on_coadds.p
Running stage srcs
Warning: Stellar halo subtraction is only implemented for DECam
Running stage srcs at 2020-08-07T13:30:10.227398
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 7 in veto map, 1 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 48 potential peaks
Of 48 potential peaks: 37 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 34 potential peaks
Of 34 potential peaks: 25 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 53 potential peaks
Of 53 potential peaks: 38 in veto map, 8 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 50 potential peaks
Of 50 potential peaks: 40 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 29 new sources
Median coadd sky for g : 0.00010757179
Median coadd sky for r : 0.0003959889
Median coadd sky for z : -0.00024560906
Stage srcs : Wall: 0.80 s, CPU: 0.68 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 259 MB, VmData: 287 MB, maxrss: 0.265144 MB
Stage srcs finished: 2020-08-07T13:30:11.023915
Resources for stage srcs : 0.086 s worker CPU, 0.100 s worker Wall, Wall: 0.799 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T13:30:11.037748
Blob 1 of 14, id: 2, sources: 17, size: 174x210, npix 19012, brick X: 26,200, Y: 17,227, one pixel: 68 17
Blob 2 of 14, id: 9, sources: 3, size: 38x59, npix 1608, brick X: 0,38, Y: 160,219, one pixel: 15 160
Blob 3 of 14, id: 8, sources: 2, size: 33x55, npix 1319, brick X: 212,245, Y: 158,213, one pixel: 237 158
Blob 4 of 14, id: 5, sources: 1, size: 30x41, npix 918, brick X: 215,245, Y: 100,141, one pixel: 234 100
Blob 5 of 14, id: 0, sources: 1, size: 36x28, npix 695, brick X: 94,130, Y: 0,28, one pixel: 108 0
Blob 6 of 14, id: 10, sources: 2, size: 32x32, npix 528, brick X: 146,178, Y: 186,218, one pixel: 164 186
Blob 7 of 14, id: 11, sources: 2, size: 35x23, npix 498, brick X: 79,114, Y: 191,214, one pixel: 89 191
Blob 8 of 14, id: 12, sources: 2, size: 22x35, npix 462, brick X: 187,209, Y: 202,237, one pixel: 197 202
Blob 9 of 14, id: 4, sources: 1, size: 25x27, npix 420, brick X: 30,55, Y: 85,112, one pixel: 43 85
Blob 10 of 14, id: 7, sources: 1, size: 25x25, npix 376, brick X: 184,209, Y: 141,166, one pixel: 197 141
Blob 11 of 14, id: 13, sources: 1, size: 24x21, npix 330, brick X: 167,191, Y: 224,245, one pixel: 177 224
Blob 12 of 14, id: 3, sources: 1, size: 22x23, npix 302, brick X: 18,40, Y: 25,48, one pixel: 29 25
Blob 13 of 14, id: 1, sources: 1, size: 21x23, npix 299, brick X: 211,232, Y: 0,23, one pixel: 220 0
Blob 14 of 14, id: 6, sources: 1, size: 22x22, npix 273, brick X: 194,216, Y: 101,123, one pixel: 205 101
Blob 12 finished, total: Wall: 0.14 s, CPU: 0.07 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083812 MB
Blob 13 finished, total: Wall: 0.15 s, CPU: 0.07 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083836 MB
Blob 14 finished, total: Wall: 0.18 s, CPU: 0.16 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145484 MB
Blob 11 finished, total: Wall: 0.28 s, CPU: 0.20 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090528 MB
Blob 10 finished, total: Wall: 0.36 s, CPU: 0.29 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145216 MB
Blob 8 finished, total: Wall: 0.44 s, CPU: 0.39 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090044 MB
Blob 6 finished, total: Wall: 0.44 s, CPU: 0.39 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089976 MB
Blob 7 finished, total: Wall: 0.46 s, CPU: 0.39 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089976 MB
Blob 9 finished, total: Wall: 0.47 s, CPU: 0.42 s, VmPeak: 810 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14492 MB
Blob 4 finished, total: Wall: 0.77 s, CPU: 0.69 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090568 MB
Blob 2 finished, total: Wall: 0.93 s, CPU: 0.83 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091204 MB
Measuring 1 iterative sources
Measuring 2 iterative sources
Blob 5 finished, total: Wall: 1.22 s, CPU: 1.16 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14532 MB
Blob 3 finished, total: Wall: 1.69 s, CPU: 1.62 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093112 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.2285, ee1=0.0207529, ee2=0.123524
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 15.78 s, CPU: 15.73 s, VmPeak: 696 MB, VmSize: 690 MB, VmRSS: 120 MB, VmData: 158 MB, maxrss: 0.1288 MB
Old catalog: 45
New catalog: 36
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/blobs-custom-272351p36733.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/metrics/cus/all-models-custom-272351p36733.fits
Stage fitblobs : Wall: 16.23 s, CPU: 0.44 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 261 MB, VmData: 288 MB, maxrss: 0.266812 MB
Stage fitblobs finished: 2020-08-07T13:30:27.272506
Resources for stage fitblobs : 22.600 s worker CPU, 23.584 s worker Wall, Wall: 16.237 s, Cores in use: 1.42, Total efficiency (on 32 cores): 4.4 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T13:30:27.288303
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/tmp-legacysurvey-custom-272351p36733-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/tmp-legacysurvey-custom-272351p36733-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/tmp-legacysurvey-custom-272351p36733-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/tmp-legacysurvey-custom-272351p36733-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-resid.jpg
Stage coadds : Wall: 2.34 s, CPU: 0.98 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 262 MB, VmData: 288 MB, maxrss: 0.268112 MB
Stage coadds finished: 2020-08-07T13:30:29.630884
Resources for stage coadds : 22.244 s worker CPU, 23.378 s worker Wall, Wall: 2.345 s, Cores in use: 9.91, Total efficiency (on 32 cores): 31.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T13:30:29.644845
Cut to 1 unWISE tiles
Reading WISE tile 2723p363 band 3
Reading WISE tile 2723p363 band 4
Reading WISE tile 2723p363 band 2
Reading WISE tile 2723p363 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 816 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.18278 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 812 MB, VmSize: 792 MB, VmRSS: 136 MB, VmData: 170 MB, maxrss: 0.198 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 800 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206652 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 793 MB, VmRSS: 138 MB, VmData: 171 MB, maxrss: 0.199772 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/tmp-legacysurvey-custom-272351p36733-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/tmp-legacysurvey-custom-272351p36733-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 6.03 s, CPU: 0.51 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 262 MB, VmData: 288 MB, maxrss: 0.268624 MB
Stage wise_forced finished: 2020-08-07T13:30:35.671775
Resources for stage wise_forced : 3.174 s worker CPU, 3.919 s worker Wall, Wall: 6.029 s, Cores in use: 0.61, Total efficiency (on 32 cores): 1.9 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T13:30:35.687166
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/coadd/cus/custom-272351p36733/legacysurvey-custom-272351p36733-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/tractor-i/cus/tractor-custom-272351p36733.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/tractor/cus/tractor-custom-272351p36733.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/tractor/cus/brick-custom-272351p36733.sha256sum
Stage writecat : Wall: 0.71 s, CPU: 0.53 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 264 MB, VmData: 288 MB, maxrss: 0.401636 MB
Stage writecat finished: 2020-08-07T13:30:36.393613
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.709 s, Cores in use: 0.76, Total efficiency (on 32 cores): 2.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2085901/PGC2085901-largegalaxy-writecat.p
All done: 54.657 s worker CPU, 72.421 s worker Wall, Wall: 41.359 s, Cores in use: 1.58, Total efficiency (on 32 cores): 4.9 %
Finished galaxy PGC2085901 in 0.734 minutes.