Started working on galaxy PGC2039560 at Wed Aug  5 19:35:27 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 107.8227855 33.8294106 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:35:29.352665
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '107.8227855', '33.8294106', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 107.8227855 33.8294106 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 107.8227855 33.8294106
Starting process 57575 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 57576 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 57577 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 57578 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 57579 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 57580 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 57581 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 57582 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57584 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 57585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 57586 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 57587 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 57588 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 57589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 57590 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:35:30.137821
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 13 CCDs:
  k4m_160229_034238_ooi_zd_ls9-CCD1 z expnum 71768 exptime 80.103 propid 2016A-0453 seeing 0.92 MJD 57447.155 object MzLS_574014_z 
    mosaic/CP/V4.3/CP20160228/k4m_160229_034238_ooi_zd_ls9.fits.fz
  k4m_161017_113407_ooi_zd_ls9-CCD4 z expnum 399526 exptime 121.105 propid 2016A-0404 seeing 0.77 MJD 57678.482 object MzLS_570888_z 
    mosaic/CP/V4.3/CP20161016/k4m_161017_113407_ooi_zd_ls9.fits.fz
  k4m_180204_033956_ooi_zd_ls9-CCD4 z expnum 159978 exptime 80.104 propid 2016A-0453 seeing 0.90 MJD 58153.153 object MzLS_570888_z 
    mosaic/CP/V4.3/CP20180203/k4m_180204_033956_ooi_zd_ls9.fits.fz
  k4m_170126_051802_ooi_zd_ls9-CCD1 z expnum 3104488 exptime 80.103 propid 2016A-0453 seeing 1.21 MJD 57779.221 object MzLS_572975_z 
    mosaic/CP/V4.3/CP20170125/k4m_170126_051802_ooi_zd_ls9.fits.fz
  k4m_180209_073620_ooi_zd_ls9-CCD4 z expnum 161373 exptime 80.104 propid 2016A-0453 seeing 0.90 MJD 58158.317 object MzLS_571932_z 
    mosaic/CP/V4.3/CP20180208/k4m_180209_073620_ooi_zd_ls9.fits.fz
  k4m_161016_114015_ooi_zd_ls9-CCD4 z expnum 399294 exptime 97.103 propid 2016A-0404 seeing 0.81 MJD 57677.486 object MzLS_571932_z 
    mosaic/CP/V4.3/CP20161015/k4m_161016_114015_ooi_zd_ls9.fits.fz
  ksb_160203_043115_ooi_r_ls9-CCD2 r expnum 74210055 exptime 155.1 propid 2015A-0801 seeing 1.84 MJD 57421.188 object 60712 
    90prime/CP/V2.3/CP20160202/ksb_160203_043115_ooi_r_ls9.fits.fz
  ksb_160204_042657_ooi_r_ls9-CCD2 r expnum 74220069 exptime 112.4 propid 2015A-0801 seeing 1.83 MJD 57422.185 object 60712 
    90prime/CP/V2.3/CP20160203/ksb_160204_042657_ooi_r_ls9.fits.fz
  ksb_180116_070524_ooi_g_ls9-CCD2 g expnum 81340081 exptime 250.0 propid BASS seeing 1.43 MJD 58134.295 object 60712 
    90prime/CP/V2.3/CP20180115/ksb_180116_070524_ooi_g_ls9.fits.fz
  ksb_160130_045820_ooi_r_ls9-CCD3 r expnum 74170074 exptime 122.3 propid 2015A-0801 seeing 1.17 MJD 57417.207 object 60723 
    90prime/CP/V2.3/CP20160129/ksb_160130_045820_ooi_r_ls9.fits.fz
  ksb_160305_041822_ooi_g_ls9-CCD3 g expnum 74520039 exptime 235.0 propid 2015A-0801 seeing 1.16 MJD 57452.179 object 60723 
    90prime/CP/V2.3/CP20160304/ksb_160305_041822_ooi_g_ls9.fits.fz
  ksb_160113_061830_ooi_g_ls9-CCD2 g expnum 74000134 exptime 135.6 propid 2015A-0801 seeing 1.46 MJD 57400.263 object 60711 
    90prime/CP/V2.3/CP20160112/ksb_160113_061830_ooi_g_ls9.fits.fz
  ksb_160212_041242_ooi_r_ls9-CCD2 r expnum 74300072 exptime 97.1 propid 2015A-0801 seeing 1.16 MJD 57430.175 object 60711 
    90prime/CP/V2.3/CP20160211/ksb_160212_041242_ooi_r_ls9.fits.fz
Faked up EXPNUM 74000134
Faked up EXPNUM 74000134
Faked up EXPNUM 74000134
90prime get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1181 1324 and amp range 0 2015 and image y 781 926 and amp range 0 2047
Range in image: x 0 144 , y 0 146 (with image size 144 x 146)
dzp -0.008523628 -> scaling image by 0.992180183483648
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74520039
Faked up EXPNUM 74520039
Faked up EXPNUM 74520039
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3408 3550 and amp range 2016 4031 and image y 2373 2516 and amp range 2048 4095
Range in image: x 0 143 , y 0 144 (with image size 143 x 144)
dzp -0.0012536051 -> scaling image by 0.9988460533227724
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 81340081
Faked up EXPNUM 81340081
Faked up EXPNUM 81340081
90prime get_fwhm: self.fwhm = 3.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3176 3319 and amp range 2016 4031 and image y 2775 2919 and amp range 2048 4095
Range in image: x 0 144 , y 0 145 (with image size 144 x 145)
dzp 0.013237011 -> scaling image by 1.012266359574015
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74220069
Faked up EXPNUM 74220069
Faked up EXPNUM 74220069
90prime get_fwhm: self.fwhm = 4.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3215 3358 and amp range 2016 4031 and image y 2815 2958 and amp range 2048 4095
Range in image: x 0 144 , y 0 144 (with image size 144 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74210055
Faked up EXPNUM 74210055
Faked up EXPNUM 74210055
90prime get_fwhm: self.fwhm = 4.05
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3212 3355 and amp range 2016 4031 and image y 2817 2960 and amp range 2048 4095
Range in image: x 0 144 , y 0 144 (with image size 144 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74300072
Faked up EXPNUM 74300072
Faked up EXPNUM 74300072
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1168 1311 and amp range 0 2015 and image y 768 912 and amp range 0 2047
Range in image: x 0 144 , y 0 145 (with image size 144 x 145)
dzp -0.006045583 -> scaling image by 0.9944472857505693
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.47
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1038 1288 and amp range 0 2047 and image y 3363 3615 and amp range 2022 4060
Range in image: x 0 251 , y 0 253 (with image size 251 x 253)
dzp -0.016192675 -> scaling image by 0.9851966584456431
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.13
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1027 1276 and amp range 0 2047 and image y 3376 3628 and amp range 2022 4060
Range in image: x 0 250 , y 0 253 (with image size 250 x 253)
dzp -0.017482605 -> scaling image by 0.9840268712629925
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74170074
Faked up EXPNUM 74170074
Faked up EXPNUM 74170074
90prime get_fwhm: self.fwhm = 2.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3418 3560 and amp range 2016 4031 and image y 2425 2567 and amp range 2048 4095
Range in image: x 0 143 , y 0 143 (with image size 143 x 143)
dzp -0.0005558773 -> scaling image by 0.99948814914245
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 2.95
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3742 3995 and amp range 2048 4095 and image y 760 1009 and amp range 0 2021
Range in image: x 0 254 , y 0 250 (with image size 254 x 250)
dzp -0.03444113 -> scaling image by 0.9687763957004109
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.47
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3735 3988 and amp range 2048 4095 and image y 762 1011 and amp range 0 2021
Range in image: x 0 254 , y 0 250 (with image size 254 x 250)
dzp -0.029506588 -> scaling image by 0.9731893881648719
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.65
Swapping in SKY_JOHN values for 1 splinesky cells; 39.324097 -> 39.266964
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2591 2838 and amp range 2006 4053 and image y 1461 1711 and amp range 0 2039
Range in image: x 0 248 , y 0 251 (with image size 248 x 251)
dzp 0.000620604 -> scaling image by 1.0005717608254892
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 0 93 and amp range 0 2005 and image y 2851 3100 and amp range 2040 4078
Range in image: x 0 94 , y 0 250 (with image size 94 x 250)
dzp -0.005990375 -> scaling image by 0.994497853444703
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 31.33 s, CPU: 0.91 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.18142 MB
Stage tims finished: 2020-08-05T19:36:01.466740
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 7.600 s worker CPU, 121.421 s worker Wall, Wall: 31.331 s, Cores in use: 0.27, Total efficiency (on 16 cores): 1.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:36:01.590707
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02534.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02662.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02790.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02663.fits
Matched 10 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/reference-custom-107822p33829.fits
Stage refs : Wall: 13.00 s, CPU: 5.43 s, VmPeak: 1025 MB, VmSize: 1020 MB, VmRSS: 241 MB, VmData: 271 MB, maxrss: 0.246664 MB
Stage refs finished: 2020-08-05T19:36:14.589956
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.001 s, Cores in use: 0.42, Total efficiency (on 16 cores): 2.6 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:36:14.792018
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outlier-mask-custom-107822p33829.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outliers-pre-custom-107822p33829.jpg
Image ksb_160305_041822_ooi_g_ls9-CCD3 g : masking 32 positive outlier pixels and 0 negative outlier pixels
Image k4m_160229_034238_ooi_zd_ls9-CCD1 z : masking 884 positive outlier pixels and 0 negative outlier pixels
Image k4m_161017_113407_ooi_zd_ls9-CCD4 z : masking 217 positive outlier pixels and 0 negative outlier pixels
Image k4m_180204_033956_ooi_zd_ls9-CCD4 z : masking 0 positive outlier pixels and 126 negative outlier pixels
Image k4m_170126_051802_ooi_zd_ls9-CCD1 z : masking 269 positive outlier pixels and 337 negative outlier pixels
Image k4m_180209_073620_ooi_zd_ls9-CCD4 z : masking 2220 positive outlier pixels and 0 negative outlier pixels
Image k4m_161016_114015_ooi_zd_ls9-CCD4 z : masking 927 positive outlier pixels and 445 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outlier-mask-custom-107822p33829.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outliers-post-custom-107822p33829.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outliers-masked-pos-custom-107822p33829.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outliers-masked-neg-custom-107822p33829.jpg
Stage outliers : Wall: 1.87 s, CPU: 1.50 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.262124 MB
Stage outliers finished: 2020-08-05T19:36:16.662649
Resources for stage outliers : 0.943 s worker CPU, 0.968 s worker Wall, Wall: 1.872 s, Cores in use: 1.31, Total efficiency (on 16 cores): 8.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:36:16.693234
Stage halos : Wall: 0.94 s, CPU: 0.92 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.262364 MB
Stage halos finished: 2020-08-05T19:36:17.632018
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.940 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T19:36:17.661076
PSF sigmas in coadd pixels: ['2.32', '1.89', '2.38']
Using average PSF sigma 2.196549348558817
Gaussian PSF norm 0.12842633923019486 vs pixelized 0.12099265
average tim pixel scale / coadd scale: 1.7301917728392109
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.98', '2.97', '1.91', '1.89']
Using average PSF sigma 2.437027421074172
Gaussian PSF norm 0.11575363877093302 vs pixelized 0.09612408
average tim pixel scale / coadd scale: 1.7300810005501595
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.49', '1.24', '1.46', '1.96', '1.46', '1.32']
Using average PSF sigma 1.489866836869849
Gaussian PSF norm 0.18934228535923928 vs pixelized 0.14920181
average tim pixel scale / coadd scale: 0.9909085962718764
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.19 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 258 MB, VmData: 284 MB, maxrss: 0.264636 MB
Stage fit_on_coadds finished: 2020-08-05T19:36:17.866194
Resources for stage fit_on_coadds : 0.251 s worker CPU, 0.251 s worker Wall, Wall: 0.207 s, Cores in use: 2.16, Total efficiency (on 16 cores): 13.5 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:36:17.880840
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 7 in veto map, 4 cut by saddle test, 0 cut by aper test, 14 kept
SED z : 14 new peaks
Found 18 potential peaks
Of 18 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 20 potential peaks
Of 20 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 26 potential peaks
Of 26 potential peaks: 21 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 28 potential peaks
Of 28 potential peaks: 24 in veto map, 3 cut by saddle test, 1 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 20 new sources
Median coadd sky for g : 4.76099e-05
Median coadd sky for r : 0.00025046966
Median coadd sky for z : -9.600907e-05
Stage srcs : Wall: 0.66 s, CPU: 0.64 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 259 MB, VmData: 284 MB, maxrss: 0.265284 MB
Stage srcs finished: 2020-08-05T19:36:18.544352
Resources for stage srcs : 0.065 s worker CPU, 0.065 s worker Wall, Wall: 0.665 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:36:18.558777
Blob 1 of 15, id: 6, sources: 7, size: 154x105, npix 9638, brick X: 46,200, Y: 75,180, one pixel: 118 75
Blob 2 of 15, id: 1, sources: 2, size: 60x73, npix 3197, brick X: 98,158, Y: 0,73, one pixel: 117 0
Blob 3 of 15, id: 12, sources: 2, size: 49x45, npix 1507, brick X: 0,49, Y: 200,245, one pixel: 26 200
Blob 4 of 15, id: 9, sources: 1, size: 39x41, npix 1115, brick X: 151,190, Y: 168,209, one pixel: 166 168
Blob 5 of 15, id: 8, sources: 2, size: 44x45, npix 1099, brick X: 190,234, Y: 118,163, one pixel: 203 118
Blob 6 of 15, id: 5, sources: 1, size: 29x29, npix 570, brick X: 184,213, Y: 52,81, one pixel: 197 52
Blob 7 of 15, id: 3, sources: 1, size: 26x31, npix 461, brick X: 53,79, Y: 44,75, one pixel: 68 44
Blob 8 of 15, id: 4, sources: 1, size: 25x25, npix 392, brick X: 214,239, Y: 46,71, one pixel: 225 46
Blob 9 of 15, id: 14, sources: 1, size: 26x17, npix 323, brick X: 140,166, Y: 228,245, one pixel: 151 228
Blob 10 of 15, id: 10, sources: 1, size: 22x23, npix 294, brick X: 34,56, Y: 179,202, one pixel: 44 179
Blob 11 of 15, id: 13, sources: 1, size: 23x18, npix 287, brick X: 88,111, Y: 227,245, one pixel: 97 227
Blob 12 of 15, id: 7, sources: 1, size: 22x21, npix 280, brick X: 13,35, Y: 89,110, one pixel: 21 89
Blob 13 of 15, id: 2, sources: 2, size: 26x14, npix 260, brick X: 148,174, Y: 0,14, one pixel: 149 0
Blob 14 of 15, id: 11, sources: 1, size: 20x20, npix 229, brick X: 65,85, Y: 182,202, one pixel: 74 182
Blob 15 of 15, id: 0, sources: 1, size: 14x23, npix 219, brick X: 0,14, Y: 0,23, one pixel: 1 0
Measuring 1 iterative sources
Blob 12 finished, total: Wall: 0.31 s, CPU: 0.24 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149144 MB
Blob 8 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150272 MB
Blob 14 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149524 MB
Blob 10 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 789 MB, VmSize: 719 MB, VmRSS: 134 MB, VmData: 171 MB, maxrss: 0.13676 MB
Blob 7 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149128 MB
Blob 11 finished, total: Wall: 0.63 s, CPU: 0.62 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1494 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (107.81941, 33.82035), pm (-3.3, -8.0), parallax 0.910 with NanoMaggies: g=22, r=20.4, z=18.8
Reset brightness to NanoMaggies: g=21.7, r=20.2, z=19.1
Blob 13 finished, total: Wall: 0.81 s, CPU: 0.76 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149584 MB
Blob 15 finished, total: Wall: 0.81 s, CPU: 0.76 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149776 MB
Blob 6 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149972 MB
Blob 9 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150732 MB
Blob 4 finished, total: Wall: 1.35 s, CPU: 1.35 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09276 MB
Blob 5 finished, total: Wall: 1.46 s, CPU: 1.46 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093664 MB
Measuring 1 iterative sources
Measuring 2 iterative sources
Blob 3 finished, total: Wall: 2.24 s, CPU: 2.23 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150508 MB
Blob 2 finished, total: Wall: 3.51 s, CPU: 3.51 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151116 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.961653, ee1=-0.0714701, ee2=0.00930672
Measuring 3 iterative sources
Blob 1 finished, total: Wall: 6.21 s, CPU: 6.19 s, VmPeak: 683 MB, VmSize: 683 MB, VmRSS: 110 MB, VmData: 154 MB, maxrss: 0.112532 MB
Old catalog: 30
New catalog: 30
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/blobs-custom-107822p33829.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/all-models-custom-107822p33829.fits
Stage fitblobs : Wall: 7.32 s, CPU: 0.36 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 259 MB, VmData: 284 MB, maxrss: 0.265448 MB
Stage fitblobs finished: 2020-08-05T19:36:25.882654
Resources for stage fitblobs : 21.702 s worker CPU, 22.039 s worker Wall, Wall: 7.326 s, Cores in use: 3.01, Total efficiency (on 16 cores): 18.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:36:25.932692
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-resid.jpg
Stage coadds : Wall: 2.91 s, CPU: 0.86 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 260 MB, VmData: 284 MB, maxrss: 0.265772 MB
Stage coadds finished: 2020-08-05T19:36:28.841227
Resources for stage coadds : 6.998 s worker CPU, 10.699 s worker Wall, Wall: 2.910 s, Cores in use: 2.70, Total efficiency (on 16 cores): 16.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:36:28.859336
Cut to 1 unWISE tiles
Reading WISE tile 1079p333 band 2
Reading WISE tile 1079p333 band 1
Reading WISE tile 1079p333 band 3
Reading WISE tile 1079p333 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 811 MB, VmSize: 808 MB, VmRSS: 149 MB, VmData: 176 MB, maxrss: 0.19388 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210428 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210568 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 812 MB, VmSize: 804 MB, VmRSS: 145 MB, VmData: 172 MB, maxrss: 0.2084 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.22 s, CPU: 0.77 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 260 MB, VmData: 284 MB, maxrss: 0.266284 MB
Stage wise_forced finished: 2020-08-05T19:36:31.081041
Resources for stage wise_forced : 3.127 s worker CPU, 4.617 s worker Wall, Wall: 2.223 s, Cores in use: 1.76, Total efficiency (on 16 cores): 11.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:36:31.095638
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/tractor-i/cus/tractor-custom-107822p33829.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/tractor/cus/tractor-custom-107822p33829.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/tractor/cus/brick-custom-107822p33829.sha256sum
Stage writecat : Wall: 0.80 s, CPU: 0.67 s, VmPeak: 1162 MB, VmSize: 1034 MB, VmRSS: 262 MB, VmData: 284 MB, maxrss: 0.399164 MB
Stage writecat finished: 2020-08-05T19:36:31.900654
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.806 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-writecat.p
All done: 40.689 s worker CPU, 160.065 s worker Wall, Wall: 61.780 s, Cores in use: 0.86, Total efficiency (on 16 cores): 5.4 %
Finished galaxy PGC2039560 in 1.076 minutes.
Started working on galaxy PGC2039560 at Wed Aug  5 20:03:12 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 107.8227855 33.8294106 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:03:19.603684
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '107.8227855', '33.8294106', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 107.8227855 33.8294106 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 107.8227855 33.8294106
Starting process 63997 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 63998 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 63999 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 64000 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 64001 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 64002 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 64003 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 64004 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 64005 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 64006 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 64007 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 64008 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 64009 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 64010 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 64011 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 64012 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 64013 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 64014 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 64015 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 64016 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 64017 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 64018 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 64019 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 64020 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 64021 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 64022 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 64023 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 64024 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 64026 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 64027 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 64025 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 64028 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:03:20.885821
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 13 CCDs:
  k4m_160229_034238_ooi_zd_ls9-CCD1 z expnum 71768 exptime 80.103 propid 2016A-0453 seeing 0.92 MJD 57447.155 object MzLS_574014_z 
    mosaic/CP/V4.3/CP20160228/k4m_160229_034238_ooi_zd_ls9.fits.fz
  k4m_161017_113407_ooi_zd_ls9-CCD4 z expnum 399526 exptime 121.105 propid 2016A-0404 seeing 0.77 MJD 57678.482 object MzLS_570888_z 
    mosaic/CP/V4.3/CP20161016/k4m_161017_113407_ooi_zd_ls9.fits.fz
  k4m_180204_033956_ooi_zd_ls9-CCD4 z expnum 159978 exptime 80.104 propid 2016A-0453 seeing 0.90 MJD 58153.153 object MzLS_570888_z 
    mosaic/CP/V4.3/CP20180203/k4m_180204_033956_ooi_zd_ls9.fits.fz
  k4m_170126_051802_ooi_zd_ls9-CCD1 z expnum 3104488 exptime 80.103 propid 2016A-0453 seeing 1.21 MJD 57779.221 object MzLS_572975_z 
    mosaic/CP/V4.3/CP20170125/k4m_170126_051802_ooi_zd_ls9.fits.fz
  k4m_180209_073620_ooi_zd_ls9-CCD4 z expnum 161373 exptime 80.104 propid 2016A-0453 seeing 0.90 MJD 58158.317 object MzLS_571932_z 
    mosaic/CP/V4.3/CP20180208/k4m_180209_073620_ooi_zd_ls9.fits.fz
  k4m_161016_114015_ooi_zd_ls9-CCD4 z expnum 399294 exptime 97.103 propid 2016A-0404 seeing 0.81 MJD 57677.486 object MzLS_571932_z 
    mosaic/CP/V4.3/CP20161015/k4m_161016_114015_ooi_zd_ls9.fits.fz
  ksb_160203_043115_ooi_r_ls9-CCD2 r expnum 74210055 exptime 155.1 propid 2015A-0801 seeing 1.84 MJD 57421.188 object 60712 
    90prime/CP/V2.3/CP20160202/ksb_160203_043115_ooi_r_ls9.fits.fz
  ksb_160204_042657_ooi_r_ls9-CCD2 r expnum 74220069 exptime 112.4 propid 2015A-0801 seeing 1.83 MJD 57422.185 object 60712 
    90prime/CP/V2.3/CP20160203/ksb_160204_042657_ooi_r_ls9.fits.fz
  ksb_180116_070524_ooi_g_ls9-CCD2 g expnum 81340081 exptime 250.0 propid BASS seeing 1.43 MJD 58134.295 object 60712 
    90prime/CP/V2.3/CP20180115/ksb_180116_070524_ooi_g_ls9.fits.fz
  ksb_160130_045820_ooi_r_ls9-CCD3 r expnum 74170074 exptime 122.3 propid 2015A-0801 seeing 1.17 MJD 57417.207 object 60723 
    90prime/CP/V2.3/CP20160129/ksb_160130_045820_ooi_r_ls9.fits.fz
  ksb_160305_041822_ooi_g_ls9-CCD3 g expnum 74520039 exptime 235.0 propid 2015A-0801 seeing 1.16 MJD 57452.179 object 60723 
    90prime/CP/V2.3/CP20160304/ksb_160305_041822_ooi_g_ls9.fits.fz
  ksb_160113_061830_ooi_g_ls9-CCD2 g expnum 74000134 exptime 135.6 propid 2015A-0801 seeing 1.46 MJD 57400.263 object 60711 
    90prime/CP/V2.3/CP20160112/ksb_160113_061830_ooi_g_ls9.fits.fz
  ksb_160212_041242_ooi_r_ls9-CCD2 r expnum 74300072 exptime 97.1 propid 2015A-0801 seeing 1.16 MJD 57430.175 object 60711 
    90prime/CP/V2.3/CP20160211/ksb_160212_041242_ooi_r_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 3.13
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1027 1276 and amp range 0 2047 and image y 3376 3628 and amp range 2022 4060
Range in image: x 0 250 , y 0 253 (with image size 250 x 253)
dzp -0.017482605 -> scaling image by 0.9840268712629925
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74520039
Faked up EXPNUM 74520039
Faked up EXPNUM 74520039
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3408 3550 and amp range 2016 4031 and image y 2373 2516 and amp range 2048 4095
Range in image: x 0 143 , y 0 144 (with image size 143 x 144)
dzp -0.0012536051 -> scaling image by 0.9988460533227724
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74170074
Faked up EXPNUM 74170074
Faked up EXPNUM 74170074
90prime get_fwhm: self.fwhm = 2.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3418 3560 and amp range 2016 4031 and image y 2425 2567 and amp range 2048 4095
Range in image: x 0 143 , y 0 143 (with image size 143 x 143)
dzp -0.0005558773 -> scaling image by 0.99948814914245
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.47
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1038 1288 and amp range 0 2047 and image y 3363 3615 and amp range 2022 4060
Range in image: x 0 251 , y 0 253 (with image size 251 x 253)
dzp -0.016192675 -> scaling image by 0.9851966584456431
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74220069
Faked up EXPNUM 74220069
Faked up EXPNUM 74220069
90prime get_fwhm: self.fwhm = 4.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3215 3358 and amp range 2016 4031 and image y 2815 2958 and amp range 2048 4095
Range in image: x 0 144 , y 0 144 (with image size 144 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 2.95
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3742 3995 and amp range 2048 4095 and image y 760 1009 and amp range 0 2021
Range in image: x 0 254 , y 0 250 (with image size 254 x 250)
dzp -0.03444113 -> scaling image by 0.9687763957004109
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.47
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3735 3988 and amp range 2048 4095 and image y 762 1011 and amp range 0 2021
Range in image: x 0 254 , y 0 250 (with image size 254 x 250)
dzp -0.029506588 -> scaling image by 0.9731893881648719
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74210055
Faked up EXPNUM 74210055
Faked up EXPNUM 74210055
90prime get_fwhm: self.fwhm = 4.05
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3212 3355 and amp range 2016 4031 and image y 2817 2960 and amp range 2048 4095
Range in image: x 0 144 , y 0 144 (with image size 144 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 81340081
Faked up EXPNUM 81340081
Faked up EXPNUM 81340081
90prime get_fwhm: self.fwhm = 3.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3176 3319 and amp range 2016 4031 and image y 2775 2919 and amp range 2048 4095
Range in image: x 0 144 , y 0 145 (with image size 144 x 145)
dzp 0.013237011 -> scaling image by 1.012266359574015
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74000134
Faked up EXPNUM 74000134
Faked up EXPNUM 74000134
90prime get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1181 1324 and amp range 0 2015 and image y 781 926 and amp range 0 2047
Range in image: x 0 144 , y 0 146 (with image size 144 x 146)
dzp -0.008523628 -> scaling image by 0.992180183483648
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74300072
Faked up EXPNUM 74300072
Faked up EXPNUM 74300072
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1168 1311 and amp range 0 2015 and image y 768 912 and amp range 0 2047
Range in image: x 0 144 , y 0 145 (with image size 144 x 145)
dzp -0.006045583 -> scaling image by 0.9944472857505693
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.65
Swapping in SKY_JOHN values for 1 splinesky cells; 39.324097 -> 39.266964
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2591 2838 and amp range 2006 4053 and image y 1461 1711 and amp range 0 2039
Range in image: x 0 248 , y 0 251 (with image size 248 x 251)
dzp 0.000620604 -> scaling image by 1.0005717608254892
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 0 93 and amp range 0 2005 and image y 2851 3100 and amp range 2040 4078
Range in image: x 0 94 , y 0 250 (with image size 94 x 250)
dzp -0.005990375 -> scaling image by 0.994497853444703
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 12.43 s, CPU: 1.07 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.181408 MB
Stage tims finished: 2020-08-05T20:03:33.318364
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 7.211 s worker CPU, 60.649 s worker Wall, Wall: 12.436 s, Cores in use: 0.67, Total efficiency (on 32 cores): 2.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:03:33.354532
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02534.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02662.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02790.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02663.fits
Matched 10 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/reference-custom-107822p33829.fits
Stage refs : Wall: 11.62 s, CPU: 7.63 s, VmPeak: 1025 MB, VmSize: 1020 MB, VmRSS: 241 MB, VmData: 271 MB, maxrss: 0.24666 MB
Stage refs finished: 2020-08-05T20:03:44.969997
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 11.618 s, Cores in use: 0.66, Total efficiency (on 32 cores): 2.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:03:45.059349
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outlier-mask-custom-107822p33829.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outliers-pre-custom-107822p33829.jpg
Image ksb_160305_041822_ooi_g_ls9-CCD3 g : masking 32 positive outlier pixels and 0 negative outlier pixels
Image k4m_160229_034238_ooi_zd_ls9-CCD1 z : masking 884 positive outlier pixels and 0 negative outlier pixels
Image k4m_161017_113407_ooi_zd_ls9-CCD4 z : masking 217 positive outlier pixels and 0 negative outlier pixels
Image k4m_180204_033956_ooi_zd_ls9-CCD4 z : masking 0 positive outlier pixels and 126 negative outlier pixels
Image k4m_161016_114015_ooi_zd_ls9-CCD4 z : masking 927 positive outlier pixels and 445 negative outlier pixels
Image k4m_170126_051802_ooi_zd_ls9-CCD1 z : masking 269 positive outlier pixels and 337 negative outlier pixels
Image k4m_180209_073620_ooi_zd_ls9-CCD4 z : masking 2220 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outlier-mask-custom-107822p33829.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outliers-post-custom-107822p33829.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outliers-masked-pos-custom-107822p33829.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/outliers-masked-neg-custom-107822p33829.jpg
Stage outliers : Wall: 1.69 s, CPU: 1.20 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 257 MB, VmData: 284 MB, maxrss: 0.262696 MB
Stage outliers finished: 2020-08-05T20:03:46.746480
Resources for stage outliers : 1.081 s worker CPU, 1.481 s worker Wall, Wall: 1.689 s, Cores in use: 1.35, Total efficiency (on 32 cores): 4.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:03:46.775313
Stage halos : Wall: 0.80 s, CPU: 0.75 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 257 MB, VmData: 284 MB, maxrss: 0.263224 MB
Stage halos finished: 2020-08-05T20:03:47.575129
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.802 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:03:47.610909
PSF sigmas in coadd pixels: ['2.32', '1.89', '2.38']
Using average PSF sigma 2.196549348558817
Gaussian PSF norm 0.12842633923019486 vs pixelized 0.12099265
average tim pixel scale / coadd scale: 1.7301917728392109
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.98', '2.97', '1.91', '1.89']
Using average PSF sigma 2.437027421074172
Gaussian PSF norm 0.11575363877093302 vs pixelized 0.09612408
average tim pixel scale / coadd scale: 1.7300810005501595
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.49', '1.24', '1.46', '1.96', '1.46', '1.32']
Using average PSF sigma 1.489866836869849
Gaussian PSF norm 0.18934228535923928 vs pixelized 0.14920183
average tim pixel scale / coadd scale: 0.9909085962718764
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.19 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 258 MB, VmData: 284 MB, maxrss: 0.264696 MB
Stage fit_on_coadds finished: 2020-08-05T20:03:47.831318
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.205 s worker CPU, 0.205 s worker Wall, Wall: 0.222 s, Cores in use: 1.80, Total efficiency (on 32 cores): 5.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:03:47.845785
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 7 in veto map, 4 cut by saddle test, 0 cut by aper test, 14 kept
SED z : 14 new peaks
Found 18 potential peaks
Of 18 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 20 potential peaks
Of 20 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 26 potential peaks
Of 26 potential peaks: 21 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 28 potential peaks
Of 28 potential peaks: 24 in veto map, 3 cut by saddle test, 1 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 20 new sources
Median coadd sky for g : 4.76099e-05
Median coadd sky for r : 0.00025046963
Median coadd sky for z : -9.600895e-05
Stage srcs : Wall: 1.09 s, CPU: 1.05 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 259 MB, VmData: 284 MB, maxrss: 0.265196 MB
Stage srcs finished: 2020-08-05T20:03:48.935330
Resources for stage srcs : 0.068 s worker CPU, 0.069 s worker Wall, Wall: 1.092 s, Cores in use: 1.03, Total efficiency (on 32 cores): 3.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:03:48.950561
Blob 1 of 15, id: 6, sources: 7, size: 154x105, npix 9638, brick X: 46,200, Y: 75,180, one pixel: 118 75
Blob 2 of 15, id: 1, sources: 2, size: 60x73, npix 3197, brick X: 98,158, Y: 0,73, one pixel: 117 0
Blob 3 of 15, id: 12, sources: 2, size: 49x45, npix 1507, brick X: 0,49, Y: 200,245, one pixel: 26 200
Blob 4 of 15, id: 9, sources: 1, size: 39x41, npix 1115, brick X: 151,190, Y: 168,209, one pixel: 166 168
Blob 5 of 15, id: 8, sources: 2, size: 44x45, npix 1099, brick X: 190,234, Y: 118,163, one pixel: 203 118
Blob 6 of 15, id: 5, sources: 1, size: 29x29, npix 570, brick X: 184,213, Y: 52,81, one pixel: 197 52
Blob 7 of 15, id: 3, sources: 1, size: 26x31, npix 461, brick X: 53,79, Y: 44,75, one pixel: 68 44
Blob 8 of 15, id: 4, sources: 1, size: 25x25, npix 392, brick X: 214,239, Y: 46,71, one pixel: 225 46
Blob 9 of 15, id: 14, sources: 1, size: 26x17, npix 323, brick X: 140,166, Y: 228,245, one pixel: 151 228
Blob 10 of 15, id: 10, sources: 1, size: 22x23, npix 294, brick X: 34,56, Y: 179,202, one pixel: 44 179
Blob 11 of 15, id: 13, sources: 1, size: 23x18, npix 287, brick X: 88,111, Y: 227,245, one pixel: 97 227
Blob 12 of 15, id: 7, sources: 1, size: 22x21, npix 280, brick X: 13,35, Y: 89,110, one pixel: 21 89
Blob 13 of 15, id: 2, sources: 2, size: 26x14, npix 260, brick X: 148,174, Y: 0,14, one pixel: 149 0
Blob 14 of 15, id: 11, sources: 1, size: 20x20, npix 229, brick X: 65,85, Y: 182,202, one pixel: 74 182
Blob 15 of 15, id: 0, sources: 1, size: 14x23, npix 219, brick X: 0,14, Y: 0,23, one pixel: 1 0
Blob 12 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.091256 MB
Measuring 1 iterative sources
Blob 7 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150052 MB
Blob 14 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14964 MB
Blob 8 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.09202 MB
Blob 10 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092528 MB
Blob 11 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.093888 MB
Blob 6 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.09382 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (107.81941, 33.82035), pm (-3.3, -8.0), parallax 0.910 with NanoMaggies: g=22, r=20.4, z=18.8
Reset brightness to NanoMaggies: g=21.7, r=20.2, z=19.1
Blob 13 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094524 MB
Blob 15 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149024 MB
Blob 9 finished, total: Wall: 0.92 s, CPU: 0.91 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094204 MB
Blob 4 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148732 MB
Blob 5 finished, total: Wall: 1.43 s, CPU: 1.43 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095276 MB
Measuring 1 iterative sources
Measuring 2 iterative sources
Blob 3 finished, total: Wall: 2.16 s, CPU: 2.16 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15024 MB
Blob 2 finished, total: Wall: 3.75 s, CPU: 3.75 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 95 MB, VmData: 142 MB, maxrss: 0.098476 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.961653, ee1=-0.07147, ee2=0.00930649
Measuring 3 iterative sources
Blob 1 finished, total: Wall: 6.60 s, CPU: 6.59 s, VmPeak: 684 MB, VmSize: 684 MB, VmRSS: 111 MB, VmData: 155 MB, maxrss: 0.113472 MB
Old catalog: 30
New catalog: 30
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/blobs-custom-107822p33829.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/metrics/cus/all-models-custom-107822p33829.fits
Stage fitblobs : Wall: 7.33 s, CPU: 0.70 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 259 MB, VmData: 284 MB, maxrss: 0.26536 MB
Stage fitblobs finished: 2020-08-05T20:03:56.283237
Resources for stage fitblobs : 20.459 s worker CPU, 20.592 s worker Wall, Wall: 7.335 s, Cores in use: 2.88, Total efficiency (on 32 cores): 9.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:03:56.306174
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-resid.jpg
Stage coadds : Wall: 4.51 s, CPU: 1.79 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 259 MB, VmData: 284 MB, maxrss: 0.265684 MB
Stage coadds finished: 2020-08-05T20:04:00.816798
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 22.475 s worker CPU, 43.206 s worker Wall, Wall: 4.513 s, Cores in use: 5.38, Total efficiency (on 32 cores): 16.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T20:04:00.840448
Cut to 1 unWISE tiles
Reading WISE tile 1079p333 band 4
Reading WISE tile 1079p333 band 1
Reading WISE tile 1079p333 band 3
Reading WISE tile 1079p333 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 808 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.190632 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.2101 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 800 MB, VmSize: 800 MB, VmRSS: 141 MB, VmData: 172 MB, maxrss: 0.20346 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 813 MB, VmSize: 799 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.204508 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.66 s, CPU: 1.28 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 260 MB, VmData: 284 MB, maxrss: 0.266196 MB
Stage wise_forced finished: 2020-08-05T20:04:04.496197
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.157 s worker CPU, 6.576 s worker Wall, Wall: 3.658 s, Cores in use: 1.21, Total efficiency (on 32 cores): 3.8 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:04:04.517842
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/tractor-i/cus/tractor-custom-107822p33829.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/tractor/cus/tractor-custom-107822p33829.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/tractor/cus/brick-custom-107822p33829.sha256sum
Stage writecat : Wall: 1.63 s, CPU: 1.04 s, VmPeak: 1162 MB, VmSize: 1034 MB, VmRSS: 262 MB, VmData: 284 MB, maxrss: 0.399076 MB
Stage writecat finished: 2020-08-05T20:04:06.145775
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.630 s, Cores in use: 0.64, Total efficiency (on 32 cores): 2.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/PGC2039560/PGC2039560-largegalaxy-writecat.p
All done: 54.663 s worker CPU, 132.785 s worker Wall, Wall: 45.285 s, Cores in use: 1.58, Total efficiency (on 32 cores): 4.9 %
Finished galaxy PGC2039560 in 0.901 minutes.
Started working on galaxy PGC2039560 at Fri Aug  7 09:18:37 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 107.82284332892412 33.82970458775122 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T09:18:38.028295
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '107.82284332892412', '33.82970458775122', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 107.82284332892412 33.82970458775122 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 107.82284332892412 33.82970458775122
Starting process 21350 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 21351 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21352 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21353 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21354 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 21355 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 21356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 21357 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 21358 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 21359 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 21360 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 21361 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21362 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21363 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 21364 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 21365 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T09:18:38.484379
Keeping 13 CCDs:
  k4m_160229_034238_ooi_zd_ls9-CCD1 z expnum 71768 exptime 80.103 propid 2016A-0453 seeing 0.92 MJD 57447.155 object MzLS_574014_z 
    mosaic/CP/V4.3/CP20160228/k4m_160229_034238_ooi_zd_ls9.fits.fz
  k4m_161017_113407_ooi_zd_ls9-CCD4 z expnum 399526 exptime 121.105 propid 2016A-0404 seeing 0.77 MJD 57678.482 object MzLS_570888_z 
    mosaic/CP/V4.3/CP20161016/k4m_161017_113407_ooi_zd_ls9.fits.fz
  k4m_180204_033956_ooi_zd_ls9-CCD4 z expnum 159978 exptime 80.104 propid 2016A-0453 seeing 0.90 MJD 58153.153 object MzLS_570888_z 
    mosaic/CP/V4.3/CP20180203/k4m_180204_033956_ooi_zd_ls9.fits.fz
  k4m_170126_051802_ooi_zd_ls9-CCD1 z expnum 3104488 exptime 80.103 propid 2016A-0453 seeing 1.21 MJD 57779.221 object MzLS_572975_z 
    mosaic/CP/V4.3/CP20170125/k4m_170126_051802_ooi_zd_ls9.fits.fz
  k4m_180209_073620_ooi_zd_ls9-CCD4 z expnum 161373 exptime 80.104 propid 2016A-0453 seeing 0.90 MJD 58158.317 object MzLS_571932_z 
    mosaic/CP/V4.3/CP20180208/k4m_180209_073620_ooi_zd_ls9.fits.fz
  k4m_161016_114015_ooi_zd_ls9-CCD4 z expnum 399294 exptime 97.103 propid 2016A-0404 seeing 0.81 MJD 57677.486 object MzLS_571932_z 
    mosaic/CP/V4.3/CP20161015/k4m_161016_114015_ooi_zd_ls9.fits.fz
  ksb_160203_043115_ooi_r_ls9-CCD2 r expnum 74210055 exptime 155.1 propid 2015A-0801 seeing 1.84 MJD 57421.188 object 60712 
    90prime/CP/V2.3/CP20160202/ksb_160203_043115_ooi_r_ls9.fits.fz
  ksb_160204_042657_ooi_r_ls9-CCD2 r expnum 74220069 exptime 112.4 propid 2015A-0801 seeing 1.83 MJD 57422.185 object 60712 
    90prime/CP/V2.3/CP20160203/ksb_160204_042657_ooi_r_ls9.fits.fz
  ksb_180116_070524_ooi_g_ls9-CCD2 g expnum 81340081 exptime 250.0 propid BASS seeing 1.43 MJD 58134.295 object 60712 
    90prime/CP/V2.3/CP20180115/ksb_180116_070524_ooi_g_ls9.fits.fz
  ksb_160130_045820_ooi_r_ls9-CCD3 r expnum 74170074 exptime 122.3 propid 2015A-0801 seeing 1.17 MJD 57417.207 object 60723 
    90prime/CP/V2.3/CP20160129/ksb_160130_045820_ooi_r_ls9.fits.fz
  ksb_160305_041822_ooi_g_ls9-CCD3 g expnum 74520039 exptime 235.0 propid 2015A-0801 seeing 1.16 MJD 57452.179 object 60723 
    90prime/CP/V2.3/CP20160304/ksb_160305_041822_ooi_g_ls9.fits.fz
  ksb_160113_061830_ooi_g_ls9-CCD2 g expnum 74000134 exptime 135.6 propid 2015A-0801 seeing 1.46 MJD 57400.263 object 60711 
    90prime/CP/V2.3/CP20160112/ksb_160113_061830_ooi_g_ls9.fits.fz
  ksb_160212_041242_ooi_r_ls9-CCD2 r expnum 74300072 exptime 97.1 propid 2015A-0801 seeing 1.16 MJD 57430.175 object 60711 
    90prime/CP/V2.3/CP20160211/ksb_160212_041242_ooi_r_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 3.47
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3740 3992 and amp range 2048 4095 and image y 763 1012 and amp range 0 2021
Range in image: x 0 253 , y 0 250 (with image size 253 x 250)
dzp -0.029506588 -> scaling image by 0.9731893881648719
mosaic get_fwhm: self.fwhm = 3.47
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1042 1292 and amp range 0 2047 and image y 3364 3615 and amp range 2022 4060
Range in image: x 0 251 , y 0 252 (with image size 251 x 252)
dzp -0.016192675 -> scaling image by 0.9851966584456431
mosaic get_fwhm: self.fwhm = 4.65
Swapping in SKY_JOHN values for 1 splinesky cells; 39.324097 -> 39.266964
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2595 2842 and amp range 2006 4053 and image y 1462 1711 and amp range 0 2039
Range in image: x 0 248 , y 0 250 (with image size 248 x 250)
dzp 0.000620604 -> scaling image by 1.0005717608254892
mosaic get_fwhm: self.fwhm = 3.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 0 97 and amp range 0 2005 and image y 2852 3100 and amp range 2040 4078
Range in image: x 0 98 , y 0 249 (with image size 98 x 249)
dzp -0.005990375 -> scaling image by 0.994497853444703
mosaic get_fwhm: self.fwhm = 2.95
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3746 3999 and amp range 2048 4095 and image y 761 1010 and amp range 0 2021
Range in image: x 0 254 , y 0 250 (with image size 254 x 250)
dzp -0.03444113 -> scaling image by 0.9687763957004109
mosaic get_fwhm: self.fwhm = 3.13
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1031 1280 and amp range 0 2047 and image y 3377 3628 and amp range 2022 4060
Range in image: x 0 250 , y 0 252 (with image size 250 x 252)
dzp -0.017482605 -> scaling image by 0.9840268712629925
Faked up EXPNUM 74170074
Faked up EXPNUM 74170074
Faked up EXPNUM 74170074
90prime get_fwhm: self.fwhm = 2.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3416 3558 and amp range 2016 4031 and image y 2425 2567 and amp range 2048 4095
Range in image: x 0 143 , y 0 143 (with image size 143 x 143)
dzp -0.0005558773 -> scaling image by 0.99948814914245
Faked up EXPNUM 74210055
Faked up EXPNUM 74210055
Faked up EXPNUM 74210055
90prime get_fwhm: self.fwhm = 4.05
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3209 3353 and amp range 2016 4031 and image y 2816 2959 and amp range 2048 4095
Range in image: x 0 145 , y 0 144 (with image size 145 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
Faked up EXPNUM 74300072
Faked up EXPNUM 74300072
Faked up EXPNUM 74300072
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1166 1309 and amp range 0 2015 and image y 767 912 and amp range 0 2047
Range in image: x 0 144 , y 0 146 (with image size 144 x 146)
dzp -0.006045583 -> scaling image by 0.9944472857505693
Faked up EXPNUM 74000134
Faked up EXPNUM 74000134
Faked up EXPNUM 74000134
90prime get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1179 1322 and amp range 0 2015 and image y 781 925 and amp range 0 2047
Range in image: x 0 144 , y 0 145 (with image size 144 x 145)
dzp -0.008523628 -> scaling image by 0.992180183483648
Faked up EXPNUM 74220069
Faked up EXPNUM 74220069
Faked up EXPNUM 74220069
90prime get_fwhm: self.fwhm = 4.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3213 3356 and amp range 2016 4031 and image y 2815 2958 and amp range 2048 4095
Range in image: x 0 144 , y 0 144 (with image size 144 x 144)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
Faked up EXPNUM 81340081
Faked up EXPNUM 81340081
Faked up EXPNUM 81340081
90prime get_fwhm: self.fwhm = 3.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3174 3317 and amp range 2016 4031 and image y 2775 2918 and amp range 2048 4095
Range in image: x 0 144 , y 0 144 (with image size 144 x 144)
dzp 0.013237011 -> scaling image by 1.012266359574015
Faked up EXPNUM 74520039
Faked up EXPNUM 74520039
Faked up EXPNUM 74520039
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3406 3548 and amp range 2016 4031 and image y 2373 2515 and amp range 2048 4095
Range in image: x 0 143 , y 0 143 (with image size 143 x 143)
dzp -0.0012536051 -> scaling image by 0.9988460533227724
Stage tims : Wall: 54.47 s, CPU: 0.88 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.179504 MB
Stage tims finished: 2020-08-07T09:19:32.955470
Resources for stage tims : 7.064 s worker CPU, 166.395 s worker Wall, Wall: 54.473 s, Cores in use: 0.15, Total efficiency (on 16 cores): 0.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T09:19:33.679142
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02534.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02662.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02790.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02663.fits
Matched 10 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/metrics/cus/reference-custom-107822p33829.fits
Stage refs : Wall: 5.96 s, CPU: 4.46 s, VmPeak: 1019 MB, VmSize: 1013 MB, VmRSS: 239 MB, VmData: 271 MB, maxrss: 0.244852 MB
Stage refs finished: 2020-08-07T09:19:39.637506
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.960 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T09:19:39.767224
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/metrics/cus/outlier-mask-custom-107822p33829.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/metrics/cus/outliers-pre-custom-107822p33829.jpg
Image ksb_180116_070524_ooi_g_ls9-CCD2 g : masking 43 positive outlier pixels and 0 negative outlier pixels
Image ksb_160305_041822_ooi_g_ls9-CCD3 g : masking 46 positive outlier pixels and 0 negative outlier pixels
Image k4m_160229_034238_ooi_zd_ls9-CCD1 z : masking 893 positive outlier pixels and 0 negative outlier pixels
Image k4m_161017_113407_ooi_zd_ls9-CCD4 z : masking 208 positive outlier pixels and 0 negative outlier pixels
Image k4m_180204_033956_ooi_zd_ls9-CCD4 z : masking 0 positive outlier pixels and 131 negative outlier pixels
Image k4m_170126_051802_ooi_zd_ls9-CCD1 z : masking 0 positive outlier pixels and 337 negative outlier pixels
Image k4m_180209_073620_ooi_zd_ls9-CCD4 z : masking 2187 positive outlier pixels and 0 negative outlier pixels
Image k4m_161016_114015_ooi_zd_ls9-CCD4 z : masking 918 positive outlier pixels and 454 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/metrics/cus/outlier-mask-custom-107822p33829.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/metrics/cus/outliers-post-custom-107822p33829.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/metrics/cus/outliers-masked-pos-custom-107822p33829.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/metrics/cus/outliers-masked-neg-custom-107822p33829.jpg
Stage outliers : Wall: 1.05 s, CPU: 0.65 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 254 MB, VmData: 283 MB, maxrss: 0.260496 MB
Stage outliers finished: 2020-08-07T09:19:40.819498
Resources for stage outliers : 0.909 s worker CPU, 0.972 s worker Wall, Wall: 1.054 s, Cores in use: 1.48, Total efficiency (on 16 cores): 9.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T09:19:40.919251
Stage halos : Wall: 0.38 s, CPU: 0.36 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 255 MB, VmData: 283 MB, maxrss: 0.260836 MB
Stage halos finished: 2020-08-07T09:19:41.304346
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.386 s, Cores in use: 0.95, Total efficiency (on 16 cores): 5.9 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T09:19:41.330443
PSF sigmas in coadd pixels: ['2.32', '1.89', '2.38']
Using average PSF sigma 2.196549348558817
Gaussian PSF norm 0.12842633923019486 vs pixelized 0.120990865
average tim pixel scale / coadd scale: 1.7301917728392109
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.98', '2.97', '1.91', '1.89']
Using average PSF sigma 2.437027421074172
Gaussian PSF norm 0.11575363877093302 vs pixelized 0.09612222
average tim pixel scale / coadd scale: 1.7300810005501595
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.49', '1.24', '1.46', '1.96', '1.46', '1.32']
Using average PSF sigma 1.489866836869849
Gaussian PSF norm 0.18934228535923928 vs pixelized 0.14920038
average tim pixel scale / coadd scale: 0.9909085962718764
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.262348 MB
Stage fit_on_coadds finished: 2020-08-07T09:19:41.508382
Resources for stage fit_on_coadds : 0.262 s worker CPU, 0.262 s worker Wall, Wall: 0.179 s, Cores in use: 2.43, Total efficiency (on 16 cores): 15.2 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T09:19:41.518249
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 24 potential peaks
Of 24 potential peaks: 8 in veto map, 4 cut by saddle test, 0 cut by aper test, 12 kept
SED z : 12 new peaks
Found 18 potential peaks
Of 18 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 20 potential peaks
Of 20 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 26 potential peaks
Of 26 potential peaks: 20 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 28 potential peaks
Of 28 potential peaks: 24 in veto map, 3 cut by saddle test, 1 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 19 new sources
Median coadd sky for g : 5.5029694e-05
Median coadd sky for r : 0.00024827468
Median coadd sky for z : -6.3175896e-05
Stage srcs : Wall: 0.51 s, CPU: 0.48 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 257 MB, VmData: 283 MB, maxrss: 0.262832 MB
Stage srcs finished: 2020-08-07T09:19:42.024507
Resources for stage srcs : 0.066 s worker CPU, 0.066 s worker Wall, Wall: 0.507 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T09:19:42.035327
Blob 1 of 14, id: 5, sources: 8, size: 187x105, npix 10739, brick X: 47,234, Y: 71,176, one pixel: 118 71
Blob 2 of 14, id: 1, sources: 2, size: 59x69, npix 3068, brick X: 99,158, Y: 0,69, one pixel: 115 0
Blob 3 of 14, id: 10, sources: 2, size: 50x49, npix 1677, brick X: 0,50, Y: 196,245, one pixel: 26 196
Blob 4 of 14, id: 7, sources: 1, size: 40x41, npix 1133, brick X: 151,191, Y: 164,205, one pixel: 166 164
Blob 5 of 14, id: 4, sources: 1, size: 29x29, npix 569, brick X: 185,214, Y: 48,77, one pixel: 198 48
Blob 6 of 14, id: 12, sources: 1, size: 31x21, npix 454, brick X: 138,169, Y: 224,245, one pixel: 151 224
Blob 7 of 14, id: 2, sources: 1, size: 25x31, npix 452, brick X: 54,79, Y: 40,71, one pixel: 69 40
Blob 8 of 14, id: 3, sources: 1, size: 25x25, npix 391, brick X: 215,240, Y: 42,67, one pixel: 225 42
Blob 9 of 14, id: 11, sources: 1, size: 24x22, npix 360, brick X: 88,112, Y: 223,245, one pixel: 97 223
Blob 10 of 14, id: 8, sources: 1, size: 22x23, npix 296, brick X: 35,57, Y: 175,198, one pixel: 45 175
Blob 11 of 14, id: 6, sources: 1, size: 22x21, npix 271, brick X: 13,35, Y: 85,106, one pixel: 22 85
Blob 12 of 14, id: 9, sources: 1, size: 21x20, npix 239, brick X: 65,86, Y: 178,198, one pixel: 74 178
Blob 13 of 14, id: 0, sources: 1, size: 15x19, npix 208, brick X: 0,15, Y: 0,19, one pixel: 0 0
Blob 14 of 14, id: 13, sources: 1, size: 17x15, npix 141, brick X: 178,195, Y: 230,245, one pixel: 186 230
Blob 14 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 806 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144528 MB
Blob 11 finished, total: Wall: 0.23 s, CPU: 0.22 s, VmPeak: 804 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145388 MB
Measuring 1 iterative sources
Blob 12 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 668 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093004 MB
Blob 10 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 806 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145468 MB
Blob 8 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 806 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145808 MB
Blob 7 finished, total: Wall: 0.62 s, CPU: 0.61 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14598 MB
Blob 9 finished, total: Wall: 0.64 s, CPU: 0.63 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092576 MB
Blob 13 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145976 MB
Blob 5 finished, total: Wall: 0.89 s, CPU: 0.88 s, VmPeak: 789 MB, VmSize: 711 MB, VmRSS: 129 MB, VmData: 169 MB, maxrss: 0.13226 MB
Blob 6 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146636 MB
Blob 4 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146588 MB
Measuring 1 iterative sources
Measuring 2 iterative sources
Blob 3 finished, total: Wall: 1.75 s, CPU: 1.75 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.094732 MB
Blob 2 finished, total: Wall: 3.45 s, CPU: 3.45 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147908 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.332401, ee1=-0.068299, ee2=0.00751172
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 5.90 s, CPU: 5.88 s, VmPeak: 814 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149068 MB
Old catalog: 29
New catalog: 26
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/metrics/cus/blobs-custom-107822p33829.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/metrics/cus/all-models-custom-107822p33829.fits
Stage fitblobs : Wall: 6.42 s, CPU: 0.47 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 257 MB, VmData: 283 MB, maxrss: 0.262996 MB
Stage fitblobs finished: 2020-08-07T09:19:48.459920
Resources for stage fitblobs : 17.934 s worker CPU, 18.061 s worker Wall, Wall: 6.426 s, Cores in use: 2.86, Total efficiency (on 16 cores): 17.9 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T09:19:48.473041
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-resid.jpg
Stage coadds : Wall: 1.75 s, CPU: 0.71 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 257 MB, VmData: 283 MB, maxrss: 0.26332 MB
Stage coadds finished: 2020-08-07T09:19:50.223965
Resources for stage coadds : 6.681 s worker CPU, 7.409 s worker Wall, Wall: 1.752 s, Cores in use: 4.22, Total efficiency (on 16 cores): 26.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T09:19:50.235147
Cut to 1 unWISE tiles
Reading WISE tile 1079p333 band 2
Reading WISE tile 1079p333 band 1
Reading WISE tile 1079p333 band 3
Reading WISE tile 1079p333 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 814 MB, VmSize: 806 MB, VmRSS: 151 MB, VmData: 180 MB, maxrss: 0.193696 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 812 MB, VmSize: 798 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.20536 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 812 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.204976 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/107/1079p333/unwise-1079p333-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 800 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206836 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/tmp-legacysurvey-custom-107822p33829-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 25.48 s, CPU: 0.58 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 258 MB, VmData: 283 MB, maxrss: 0.263832 MB
Stage wise_forced finished: 2020-08-07T09:20:15.717633
Resources for stage wise_forced : 3.220 s worker CPU, 16.295 s worker Wall, Wall: 25.484 s, Cores in use: 0.15, Total efficiency (on 16 cores): 0.9 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T09:20:15.772221
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/coadd/cus/custom-107822p33829/legacysurvey-custom-107822p33829-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/tractor-i/cus/tractor-custom-107822p33829.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/tractor/cus/tractor-custom-107822p33829.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/tractor/cus/brick-custom-107822p33829.sha256sum
Stage writecat : Wall: 0.88 s, CPU: 0.56 s, VmPeak: 1156 MB, VmSize: 1028 MB, VmRSS: 259 MB, VmData: 283 MB, maxrss: 0.396716 MB
Stage writecat finished: 2020-08-07T09:20:16.656013
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.885 s, Cores in use: 0.64, Total efficiency (on 16 cores): 4.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/107/PGC2039560/PGC2039560-largegalaxy-writecat.p
All done: 36.139 s worker CPU, 209.465 s worker Wall, Wall: 98.228 s, Cores in use: 0.46, Total efficiency (on 16 cores): 2.9 %
Finished galaxy PGC2039560 in 1.681 minutes.