Started working on galaxy PGC2485512 at Wed Aug  5 21:46:48 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.0761915 54.948608400000005 --width 379 --height 379 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T21:46:49.479634
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '253.0761915', '54.948608400000005', '--width', '379', '--height', '379', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.0761915 54.948608400000005 --width 379 --height 379 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 253.0761915 54.948608400000005
Starting process 21532 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 21533 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 21534 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 21535 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 21536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 21537 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 21538 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 21539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 21540 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 21541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 21542 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 21543 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 21544 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 21545 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 21546 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21547 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T21:46:49.922983
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 13 CCDs:
  k4m_170527_094543_ooi_zd_ls9-CCD4 z expnum 130160 exptime 80.105 propid 2016A-0453 seeing 0.83 MJD 57900.407 object MzLS_667946_z 
    mosaic/CP/V4.3/CP20170526/k4m_170527_094543_ooi_zd_ls9.fits.fz
  k4m_160605_074253_ooi_zd_ls9-CCD3 z expnum 93487 exptime 80.104 propid 2016A-0453 seeing 0.92 MJD 57544.321 object MzLS_669396_z 
    mosaic/CP/V4.3/CP20160604/k4m_160605_074253_ooi_zd_ls9.fits.fz
  k4m_170527_095137_ooi_zd_ls9-CCD3 z expnum 130163 exptime 80.104 propid 2016A-0453 seeing 0.77 MJD 57900.411 object MzLS_670116_z 
    mosaic/CP/V4.3/CP20170526/k4m_170527_095137_ooi_zd_ls9.fits.fz
  k4m_160616_064426_ooi_zd_ls9-CCD2 z expnum 95732 exptime 80.104 propid 2016A-0453 seeing 0.93 MJD 57555.281 object MzLS_668673_z 
    mosaic/CP/V4.3/CP20160615/k4m_160616_064426_ooi_zd_ls9.fits.fz
  ksb_170327_112934_ooi_g_ls9-CCD2 g expnum 78390274 exptime 81.048 propid BASS seeing 1.15 MJD 57839.479 object 32612 
    90prime/CP/V2.3/CP20170326/ksb_170327_112934_ooi_g_ls9.fits.fz
  ksb_170520_101640_ooi_r_ls9-CCD3 r expnum 78930197 exptime 181.5 propid 2015A-0801 seeing 2.03 MJD 57893.428 object 32623 
    90prime/CP/V2.3/CP20170519/ksb_170520_101640_ooi_r_ls9.fits.fz
  ksb_160604_072218_ooi_r_ls9-CCD4 r expnum 75430115 exptime 50.7 propid BASS seeing 1.16 MJD 57543.307 object 32621 
    90prime/CP/V2.3/CP20160603/ksb_160604_072218_ooi_r_ls9.fits.fz
  ksb_170602_101717_ooi_g_ls9-CCD4 g expnum 79060157 exptime 107.329 propid 2015A-0801 seeing 1.44 MJD 57906.429 object 32621 
    90prime/CP/V2.3/CP20170601/ksb_170602_101717_ooi_g_ls9.fits.fz
  ksb_180223_094249_ooi_r_ls9-CCD2 r expnum 81720197 exptime 150.0 propid BASS seeing 2.27 MJD 58172.405 object 32612 
    90prime/CP/V2.3/CP20180222/ksb_180223_094249_ooi_r_ls9.fits.fz
  ksb_160713_071700_ooi_r_ls9-CCD2 r expnum 75820071 exptime 250.0 propid BASS seeing 2.63 MJD 57582.303 object 32612 
    90prime/CP/V2.3/CP20160712/ksb_160713_071700_ooi_r_ls9.fits.fz
  ksb_180223_100145_ooi_r_ls9-CCD4 r expnum 81720203 exptime 220.0 propid BASS seeing 2.14 MJD 58172.418 object 32622 
    90prime/CP/V2.3/CP20180222/ksb_180223_100145_ooi_r_ls9.fits.fz
  ksb_160713_072204_ooi_r_ls9-CCD4 r expnum 75820072 exptime 250.0 propid BASS seeing 2.49 MJD 57582.307 object 32622 
    90prime/CP/V2.3/CP20160712/ksb_160713_072204_ooi_r_ls9.fits.fz
  ksb_170327_114155_ooi_g_ls9-CCD4 g expnum 78390280 exptime 90.454 propid BASS seeing 1.61 MJD 57839.487 object 32622 
    90prime/CP/V2.3/CP20170326/ksb_170327_114155_ooi_g_ls9.fits.fz
Faked up EXPNUM 81720197
Faked up EXPNUM 81720197
Faked up EXPNUM 81720197
90prime get_fwhm: self.fwhm = 5.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2137 2361 and amp range 2016 4031 and image y 320 547 and amp range 0 2047
Range in image: x 0 225 , y 0 228 (with image size 225 x 228)
dzp 0.014483032 -> scaling image by 1.0134287315188357
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75820072
Faked up EXPNUM 75820072
Faked up EXPNUM 75820072
90prime get_fwhm: self.fwhm = 5.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2240 2461 and amp range 2016 4031 and image y 3742 3965 and amp range 2048 4095
Range in image: x 0 222 , y 0 224 (with image size 222 x 224)
dzp -0.0036899033 -> scaling image by 0.9966072419211972
Faked up EXPNUM 78390274
Faked up EXPNUM 78390274
Faked up EXPNUM 78390274
90prime get_fwhm: self.fwhm = 2.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2161 2385 and amp range 2016 4031 and image y 205 431 and amp range 0 2047
Range in image: x 0 225 , y 0 227 (with image size 225 x 227)
dzp 0.01918938 -> scaling image by 1.017831182878158
Faked up EXPNUM 81720203
Faked up EXPNUM 81720203
Faked up EXPNUM 81720203
90prime get_fwhm: self.fwhm = 4.71
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2243 2464 and amp range 2016 4031 and image y 3716 3939 and amp range 2048 4095
Range in image: x 0 222 , y 0 224 (with image size 222 x 224)
dzp 0.044050463 -> scaling image by 1.0414062625929388
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78390280
Faked up EXPNUM 78390280
Faked up EXPNUM 78390280
90prime get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2250 2471 and amp range 2016 4031 and image y 3747 3970 and amp range 2048 4095
Range in image: x 0 222 , y 0 224 (with image size 222 x 224)
dzp -0.0030897402 -> scaling image by 0.9971582894587289
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75430115
Faked up EXPNUM 75430115
Faked up EXPNUM 75430115
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 235 455 and amp range 0 2015 and image y 1767 1987 and amp range 0 2047
Range in image: x 0 221 , y 0 221 (with image size 221 x 221)
dzp 0.009781551 -> scaling image by 1.0090498455107675
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2636 3020 and amp range 2006 4053 and image y 3007 3399 and amp range 2040 4078
Range in image: x 0 385 , y 0 393 (with image size 385 x 393)
dzp -0.0026360443 -> scaling image by 0.99757505842151
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3797 4088 and amp range 2048 4095 and image y 2481 2871 and amp range 2022 4060
Range in image: x 0 292 , y 0 391 (with image size 292 x 391)
dzp -0.02499645 -> scaling image by 0.9772404160512723
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 2.95
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 0 282 and amp range 0 2005 and image y 2559 2954 and amp range 2040 4078
Range in image: x 0 283 , y 0 396 (with image size 283 x 396)
dzp 0.012956044 -> scaling image by 1.012004439021001
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79060157
Faked up EXPNUM 79060157
Faked up EXPNUM 79060157
90prime get_fwhm: self.fwhm = 3.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 253 472 and amp range 0 2015 and image y 1754 1974 and amp range 0 2047
Range in image: x 0 220 , y 0 221 (with image size 220 x 221)
dzp 0.0029025706 -> scaling image by 1.002676942990926
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75820071
Faked up EXPNUM 75820071
Faked up EXPNUM 75820071
90prime get_fwhm: self.fwhm = 5.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2153 2376 and amp range 2016 4031 and image y 196 422 and amp range 0 2047
Range in image: x 0 224 , y 0 227 (with image size 224 x 227)
dzp -0.012503507 -> scaling image by 0.9885499019198392
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1029 1412 and amp range 0 2047 and image y 1512 1896 and amp range 0 2039
Range in image: x 0 384 , y 0 385 (with image size 384 x 385)
dzp -0.006320339 -> scaling image by 0.9941956631368829
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 39.10 s, CPU: 0.92 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 182 MB, VmData: 214 MB, maxrss: 0.186596 MB
Stage tims finished: 2020-08-05T21:47:29.025923
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 8.042 s worker CPU, 120.554 s worker Wall, Wall: 39.105 s, Cores in use: 0.23, Total efficiency (on 16 cores): 1.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-tims.p
Running stage refs
Faked up EXPNUM 78930197
Faked up EXPNUM 78930197
Faked up EXPNUM 78930197
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T21:47:29.584319
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01171.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01076.fits
Matched 8 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/metrics/cus/reference-custom-253076p54948.fits
Stage refs : Wall: 9.39 s, CPU: 2.36 s, VmPeak: 989 MB, VmSize: 982 MB, VmRSS: 208 MB, VmData: 239 MB, maxrss: 0.21248 MB
Stage refs finished: 2020-08-05T21:47:38.971050
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.388 s, Cores in use: 0.25, Total efficiency (on 16 cores): 1.6 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T21:47:39.074864
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/metrics/cus/outlier-mask-custom-253076p54948.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/metrics/cus/outliers-pre-custom-253076p54948.jpg
Image ksb_170602_101717_ooi_g_ls9-CCD4 g : masking 230 positive outlier pixels and 0 negative outlier pixels
Image ksb_170327_114155_ooi_g_ls9-CCD4 g : masking 50 positive outlier pixels and 0 negative outlier pixels
Image ksb_160713_071700_ooi_r_ls9-CCD2 r : masking 144 positive outlier pixels and 0 negative outlier pixels
Image ksb_160713_072204_ooi_r_ls9-CCD4 r : masking 1127 positive outlier pixels and 0 negative outlier pixels
Image k4m_170527_094543_ooi_zd_ls9-CCD4 z : masking 401 positive outlier pixels and 0 negative outlier pixels
Image k4m_160616_064426_ooi_zd_ls9-CCD2 z : masking 573 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/metrics/cus/outlier-mask-custom-253076p54948.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/metrics/cus/outliers-post-custom-253076p54948.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/metrics/cus/outliers-masked-pos-custom-253076p54948.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/metrics/cus/outliers-masked-neg-custom-253076p54948.jpg
Stage outliers : Wall: 1.53 s, CPU: 1.16 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 239 MB, VmData: 269 MB, maxrss: 0.244936 MB
Stage outliers finished: 2020-08-05T21:47:40.604067
Resources for stage outliers : 1.839 s worker CPU, 1.995 s worker Wall, Wall: 1.531 s, Cores in use: 1.96, Total efficiency (on 16 cores): 12.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T21:47:40.697050
Stage halos : Wall: 0.33 s, CPU: 0.32 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 239 MB, VmData: 269 MB, maxrss: 0.245244 MB
Stage halos finished: 2020-08-05T21:47:41.026041
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.331 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-05T21:47:41.057543
PSF sigmas in coadd pixels: ['1.86', '2.33', '2.61']
Using average PSF sigma 2.2702157795472093
Gaussian PSF norm 0.12425902168213344 vs pixelized 0.104828216
average tim pixel scale / coadd scale: 1.73025582348288
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.89', '3.69', '4.28', '3.47', '4.04']
Using average PSF sigma 3.47398519431446
Gaussian PSF norm 0.08120207081928725 vs pixelized 0.06259354
average tim pixel scale / coadd scale: 1.7303472139538472
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.35', '1.50', '1.24', '1.51']
Using average PSF sigma 1.3977809411646842
Gaussian PSF norm 0.20181616694446133 vs pixelized 0.16439508
average tim pixel scale / coadd scale: 0.9908851188116969
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.34 s, CPU: 0.33 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 243 MB, VmData: 271 MB, maxrss: 0.248752 MB
Stage fit_on_coadds finished: 2020-08-05T21:47:41.396422
Resources for stage fit_on_coadds : 0.478 s worker CPU, 0.478 s worker Wall, Wall: 0.340 s, Cores in use: 2.39, Total efficiency (on 16 cores): 14.9 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T21:47:41.408666
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 93 potential peaks
Of 93 potential peaks: 54 in veto map, 3 cut by saddle test, 0 cut by aper test, 36 kept
SED z : 36 new peaks
Found 155 potential peaks
Of 155 potential peaks: 151 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 214 potential peaks
Of 214 potential peaks: 205 in veto map, 6 cut by saddle test, 1 cut by aper test, 2 kept
SED g : 2 new peaks
Found 133 potential peaks
Of 133 potential peaks: 123 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 124 potential peaks
Of 124 potential peaks: 115 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 44 new sources
Median coadd sky for g : 0.000127221
Median coadd sky for r : 0.00020234268
Median coadd sky for z : 0.00020296921
Stage srcs : Wall: 0.70 s, CPU: 0.63 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 244 MB, VmData: 271 MB, maxrss: 0.249372 MB
Stage srcs finished: 2020-08-05T21:47:42.111817
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage srcs : 0.195 s worker CPU, 0.195 s worker Wall, Wall: 0.705 s, Cores in use: 1.17, Total efficiency (on 16 cores): 7.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T21:47:42.127396
Blob 1 of 22, id: 8, sources: 22, size: 263x254, npix 38127, brick X: 22,285, Y: 90,344, one pixel: 160 90
Blob 2 of 22, id: 12, sources: 3, size: 46x85, npix 2690, brick X: 333,379, Y: 201,286, one pixel: 352 201
Blob 3 of 22, id: 1, sources: 2, size: 48x40, npix 992, brick X: 0,48, Y: 14,54, one pixel: 36 14
Blob 4 of 22, id: 5, sources: 2, size: 42x39, npix 949, brick X: 214,256, Y: 34,73, one pixel: 244 34
Blob 5 of 22, id: 16, sources: 1, size: 32x34, npix 791, brick X: 163,195, Y: 311,345, one pixel: 175 311
Blob 6 of 22, id: 0, sources: 1, size: 37x27, npix 753, brick X: 260,297, Y: 0,27, one pixel: 266 0
Blob 7 of 22, id: 6, sources: 2, size: 32x43, npix 751, brick X: 122,154, Y: 54,97, one pixel: 133 54
Blob 8 of 22, id: 17, sources: 2, size: 40x36, npix 750, brick X: 205,245, Y: 318,354, one pixel: 215 318
Blob 9 of 22, id: 2, sources: 2, size: 21x45, npix 721, brick X: 358,379, Y: 20,65, one pixel: 371 20
Blob 10 of 22, id: 19, sources: 1, size: 32x34, npix 719, brick X: 183,215, Y: 339,373, one pixel: 199 339
Blob 11 of 22, id: 13, sources: 1, size: 21x43, npix 694, brick X: 0,21, Y: 207,250, one pixel: 5 207
Blob 12 of 22, id: 18, sources: 1, size: 30x31, npix 596, brick X: 52,82, Y: 319,350, one pixel: 68 319
Blob 13 of 22, id: 15, sources: 1, size: 29x30, npix 576, brick X: 344,373, Y: 302,332, one pixel: 358 302
Blob 14 of 22, id: 7, sources: 1, size: 28x26, npix 480, brick X: 333,361, Y: 88,114, one pixel: 345 88
Blob 15 of 22, id: 4, sources: 1, size: 27x27, npix 446, brick X: 184,211, Y: 29,56, one pixel: 197 29
Blob 16 of 22, id: 11, sources: 1, size: 27x26, npix 443, brick X: 280,307, Y: 186,212, one pixel: 290 186
Blob 17 of 22, id: 21, sources: 1, size: 20x24, npix 338, brick X: 0,20, Y: 352,376, one pixel: 5 352
Blob 18 of 22, id: 20, sources: 1, size: 22x23, npix 324, brick X: 132,154, Y: 348,371, one pixel: 141 348
Blob 8 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151168 MB
Blob 19 of 22, id: 10, sources: 1, size: 20x22, npix 260, brick X: 342,362, Y: 125,147, one pixel: 351 125
Blob 5 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151112 MB
Blob 15 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 803 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151528 MB
Blob 20 of 22, id: 14, sources: 1, size: 20x21, npix 239, brick X: 326,346, Y: 298,319, one pixel: 336 298
Blob 21 of 22, id: 3, sources: 1, size: 20x20, npix 219, brick X: 294,314, Y: 22,42, one pixel: 303 22
Blob 16 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.0972 MB
Blob 22 of 22, id: 9, sources: 1, size: 17x18, npix 162, brick X: 103,120, Y: 95,113, one pixel: 111 95
Blob 7 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 808 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.15174 MB
Blob 10 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151108 MB
Blob 13 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150892 MB
Blob 20 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 670 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097348 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.03391, 54.95179), pm (-3.2, 10.2), parallax 0.403 with NanoMaggies: g=16, r=15.3, z=15
Reset brightness to NanoMaggies: g=16, r=15.3, z=15
Measuring 2 iterative sources
Blob 22 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151108 MB
Blob 19 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 803 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151528 MB
Blob 14 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.098444 MB
Blob 4 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.152256 MB
Blob 9 finished, total: Wall: 1.09 s, CPU: 1.08 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150692 MB
Blob 21 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 808 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.15174 MB
Blob 18 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151112 MB
Blob 6 finished, total: Wall: 1.18 s, CPU: 1.17 s, VmPeak: 807 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.15256 MB
Blob 17 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151168 MB
Blob 3 finished, total: Wall: 1.25 s, CPU: 1.24 s, VmPeak: 804 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15152 MB
Blob 11 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097728 MB
Blob 12 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15196 MB
Blob 2 finished, total: Wall: 1.89 s, CPU: 1.89 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146084 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.94702, ee1=0.627386, ee2=0.131326
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 21.59 s, CPU: 21.58 s, VmPeak: 812 MB, VmSize: 748 MB, VmRSS: 171 MB, VmData: 200 MB, maxrss: 0.181604 MB
Old catalog: 51
New catalog: 51
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/metrics/cus/blobs-custom-253076p54948.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/metrics/cus/all-models-custom-253076p54948.fits
Stage fitblobs : Wall: 21.96 s, CPU: 0.39 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 244 MB, VmData: 271 MB, maxrss: 0.249728 MB
Stage fitblobs finished: 2020-08-05T21:48:04.088783
Resources for stage fitblobs : 38.397 s worker CPU, 38.502 s worker Wall, Wall: 21.963 s, Cores in use: 1.77, Total efficiency (on 16 cores): 11.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T21:48:04.105592
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/tmp-legacysurvey-custom-253076p54948-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/tmp-legacysurvey-custom-253076p54948-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/tmp-legacysurvey-custom-253076p54948-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/tmp-legacysurvey-custom-253076p54948-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-resid.jpg
Stage coadds : Wall: 2.79 s, CPU: 1.06 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 247 MB, VmData: 275 MB, maxrss: 0.252596 MB
Stage coadds finished: 2020-08-05T21:48:06.898771
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 7.370 s worker CPU, 10.278 s worker Wall, Wall: 2.795 s, Cores in use: 3.02, Total efficiency (on 16 cores): 18.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T21:48:06.915643
Cut to 1 unWISE tiles
Reading WISE tile 2527p545 band 1
Reading WISE tile 2527p545 band 4
Reading WISE tile 2527p545 band 3
Reading WISE tile 2527p545 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 811 MB, VmSize: 809 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.195508 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 809 MB, VmSize: 806 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211716 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 808 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.207776 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 813 MB, VmSize: 813 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.210904 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/tmp-legacysurvey-custom-253076p54948-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/tmp-legacysurvey-custom-253076p54948-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.22 s, CPU: 0.57 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 247 MB, VmData: 275 MB, maxrss: 0.253304 MB
Stage wise_forced finished: 2020-08-05T21:48:10.138297
Resources for stage wise_forced : 3.215 s worker CPU, 5.963 s worker Wall, Wall: 3.224 s, Cores in use: 1.18, Total efficiency (on 16 cores): 7.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T21:48:10.156236
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/coadd/cus/custom-253076p54948/legacysurvey-custom-253076p54948-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/tractor-i/cus/tractor-custom-253076p54948.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/tractor/cus/tractor-custom-253076p54948.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/tractor/cus/brick-custom-253076p54948.sha256sum
Stage writecat : Wall: 0.89 s, CPU: 0.63 s, VmPeak: 1129 MB, VmSize: 1001 MB, VmRSS: 249 MB, VmData: 275 MB, maxrss: 0.386168 MB
Stage writecat finished: 2020-08-05T21:48:11.043515
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.889 s, Cores in use: 0.71, Total efficiency (on 16 cores): 4.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC2485512/PGC2485512-largegalaxy-writecat.p
All done: 59.541 s worker CPU, 177.971 s worker Wall, Wall: 81.239 s, Cores in use: 0.84, Total efficiency (on 16 cores): 5.2 %
Finished galaxy PGC2485512 in 1.386 minutes.
Started working on galaxy PGC2485512 at Fri Aug  7 10:13:06 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.07565277602873 54.94834797918425 --width 379 --height 379 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T10:13:08.407908
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '253.07565277602873', '54.94834797918425', '--width', '379', '--height', '379', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.07565277602873 54.94834797918425 --width 379 --height 379 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 253.07565277602873 54.94834797918425
Starting process 21648 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 21649 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21650 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21651 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21652 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 21653 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 21654 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 21655 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 21656 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 21657 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 21658 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21659 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21660 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 21661 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 21662 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 21663 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T10:13:08.948053
Keeping 14 CCDs:
  k4m_170527_094543_ooi_zd_ls9-CCD4 z expnum 130160 exptime 80.105 propid 2016A-0453 seeing 0.83 MJD 57900.407 object MzLS_667946_z 
    mosaic/CP/V4.3/CP20170526/k4m_170527_094543_ooi_zd_ls9.fits.fz
  k4m_160605_074253_ooi_zd_ls9-CCD3 z expnum 93487 exptime 80.104 propid 2016A-0453 seeing 0.92 MJD 57544.321 object MzLS_669396_z 
    mosaic/CP/V4.3/CP20160604/k4m_160605_074253_ooi_zd_ls9.fits.fz
  k4m_170527_095137_ooi_zd_ls9-CCD3 z expnum 130163 exptime 80.104 propid 2016A-0453 seeing 0.77 MJD 57900.411 object MzLS_670116_z 
    mosaic/CP/V4.3/CP20170526/k4m_170527_095137_ooi_zd_ls9.fits.fz
  k4m_160616_064426_ooi_zd_ls9-CCD2 z expnum 95732 exptime 80.104 propid 2016A-0453 seeing 0.93 MJD 57555.281 object MzLS_668673_z 
    mosaic/CP/V4.3/CP20160615/k4m_160616_064426_ooi_zd_ls9.fits.fz
  ksb_170327_112934_ooi_g_ls9-CCD2 g expnum 78390274 exptime 81.048 propid BASS seeing 1.15 MJD 57839.479 object 32612 
    90prime/CP/V2.3/CP20170326/ksb_170327_112934_ooi_g_ls9.fits.fz
  ksb_170520_101640_ooi_r_ls9-CCD3 r expnum 78930197 exptime 181.5 propid 2015A-0801 seeing 2.03 MJD 57893.428 object 32623 
    90prime/CP/V2.3/CP20170519/ksb_170520_101640_ooi_r_ls9.fits.fz
  ksb_170523_080943_ooi_g_ls9-CCD3 g expnum 78960126 exptime 100.18 propid 2015A-0801 seeing 1.45 MJD 57896.340 object 32623 
    90prime/CP/V2.3/CP20170522/ksb_170523_080943_ooi_g_ls9.fits.fz
  ksb_160604_072218_ooi_r_ls9-CCD4 r expnum 75430115 exptime 50.7 propid BASS seeing 1.16 MJD 57543.307 object 32621 
    90prime/CP/V2.3/CP20160603/ksb_160604_072218_ooi_r_ls9.fits.fz
  ksb_170602_101717_ooi_g_ls9-CCD4 g expnum 79060157 exptime 107.329 propid 2015A-0801 seeing 1.44 MJD 57906.429 object 32621 
    90prime/CP/V2.3/CP20170601/ksb_170602_101717_ooi_g_ls9.fits.fz
  ksb_180223_094249_ooi_r_ls9-CCD2 r expnum 81720197 exptime 150.0 propid BASS seeing 2.27 MJD 58172.405 object 32612 
    90prime/CP/V2.3/CP20180222/ksb_180223_094249_ooi_r_ls9.fits.fz
  ksb_160713_071700_ooi_r_ls9-CCD2 r expnum 75820071 exptime 250.0 propid BASS seeing 2.63 MJD 57582.303 object 32612 
    90prime/CP/V2.3/CP20160712/ksb_160713_071700_ooi_r_ls9.fits.fz
  ksb_180223_100145_ooi_r_ls9-CCD4 r expnum 81720203 exptime 220.0 propid BASS seeing 2.14 MJD 58172.418 object 32622 
    90prime/CP/V2.3/CP20180222/ksb_180223_100145_ooi_r_ls9.fits.fz
  ksb_160713_072204_ooi_r_ls9-CCD4 r expnum 75820072 exptime 250.0 propid BASS seeing 2.49 MJD 57582.307 object 32622 
    90prime/CP/V2.3/CP20160712/ksb_160713_072204_ooi_r_ls9.fits.fz
  ksb_170327_114155_ooi_g_ls9-CCD4 g expnum 78390280 exptime 90.454 propid BASS seeing 1.61 MJD 57839.487 object 32622 
    90prime/CP/V2.3/CP20170326/ksb_170327_114155_ooi_g_ls9.fits.fz
Faked up EXPNUM 81720197
Faked up EXPNUM 81720197
Faked up EXPNUM 81720197
90prime get_fwhm: self.fwhm = 5.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2140 2363 and amp range 2016 4031 and image y 323 549 and amp range 0 2047
Range in image: x 0 224 , y 0 227 (with image size 224 x 227)
dzp 0.014483032 -> scaling image by 1.0134287315188357
Faked up EXPNUM 78390274
Faked up EXPNUM 78390274
Faked up EXPNUM 78390274
90prime get_fwhm: self.fwhm = 2.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2163 2387 and amp range 2016 4031 and image y 207 434 and amp range 0 2047
Range in image: x 0 225 , y 0 228 (with image size 225 x 228)
dzp 0.01918938 -> scaling image by 1.017831182878158
Faked up EXPNUM 75430115
Faked up EXPNUM 75430115
Faked up EXPNUM 75430115
90prime get_fwhm: self.fwhm = 2.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 237 457 and amp range 0 2015 and image y 1770 1990 and amp range 0 2047
Range in image: x 0 221 , y 0 221 (with image size 221 x 221)
dzp 0.009781551 -> scaling image by 1.0090498455107675
Faked up EXPNUM 78390280
Faked up EXPNUM 78390280
Faked up EXPNUM 78390280
90prime get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2252 2473 and amp range 2016 4031 and image y 3749 3972 and amp range 2048 4095
Range in image: x 0 222 , y 0 224 (with image size 222 x 224)
dzp -0.0030897402 -> scaling image by 0.9971582894587289
Faked up EXPNUM 81720203
Faked up EXPNUM 81720203
Faked up EXPNUM 81720203
90prime get_fwhm: self.fwhm = 4.71
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2245 2466 and amp range 2016 4031 and image y 3719 3941 and amp range 2048 4095
Range in image: x 0 222 , y 0 223 (with image size 222 x 223)
dzp 0.044050463 -> scaling image by 1.0414062625929388
Faked up EXPNUM 75820072
Faked up EXPNUM 75820072
Faked up EXPNUM 75820072
90prime get_fwhm: self.fwhm = 5.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2242 2463 and amp range 2016 4031 and image y 3744 3967 and amp range 2048 4095
Range in image: x 0 222 , y 0 224 (with image size 222 x 224)
dzp -0.0036899033 -> scaling image by 0.9966072419211972
mosaic get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2632 3016 and amp range 2006 4053 and image y 3003 3394 and amp range 2040 4078
Range in image: x 0 385 , y 0 392 (with image size 385 x 392)
dzp -0.0026360443 -> scaling image by 0.99757505842151
mosaic get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3794 4088 and amp range 2048 4095 and image y 2477 2866 and amp range 2022 4060
Range in image: x 0 295 , y 0 390 (with image size 295 x 390)
dzp -0.02499645 -> scaling image by 0.9772404160512723
mosaic get_fwhm: self.fwhm = 2.95
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 0 279 and amp range 0 2005 and image y 2555 2949 and amp range 2040 4078
Range in image: x 0 280 , y 0 395 (with image size 280 x 395)
dzp 0.012956044 -> scaling image by 1.012004439021001
Faked up EXPNUM 79060157
Faked up EXPNUM 79060157
Faked up EXPNUM 79060157
90prime get_fwhm: self.fwhm = 3.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 255 475 and amp range 0 2015 and image y 1756 1976 and amp range 0 2047
Range in image: x 0 221 , y 0 221 (with image size 221 x 221)
dzp 0.0029025706 -> scaling image by 1.002676942990926
mosaic get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1025 1409 and amp range 0 2047 and image y 1507 1892 and amp range 0 2039
Range in image: x 0 385 , y 0 386 (with image size 385 x 386)
dzp -0.006320339 -> scaling image by 0.9941956631368829
Faked up EXPNUM 75820071
Faked up EXPNUM 75820071
Faked up EXPNUM 75820071
90prime get_fwhm: self.fwhm = 5.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2155 2378 and amp range 2016 4031 and image y 198 425 and amp range 0 2047
Range in image: x 0 224 , y 0 228 (with image size 224 x 228)
dzp -0.012503507 -> scaling image by 0.9885499019198392
Stage tims : Wall: 150.49 s, CPU: 1.08 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 180 MB, VmData: 213 MB, maxrss: 0.183968 MB
Stage tims finished: 2020-08-07T10:15:39.433767
Faked up EXPNUM 78930197
Faked up EXPNUM 78930197
Faked up EXPNUM 78930197
Faked up EXPNUM 78960126
Faked up EXPNUM 78960126
Faked up EXPNUM 78960126
Resources for stage tims : 8.003 s worker CPU, 486.720 s worker Wall, Wall: 150.487 s, Cores in use: 0.06, Total efficiency (on 16 cores): 0.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T10:15:42.070536
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01171.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01076.fits
Matched 8 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/metrics/cus/reference-custom-253075p54948.fits
Stage refs : Wall: 47.01 s, CPU: 2.46 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 205 MB, VmData: 238 MB, maxrss: 0.20978 MB
Stage refs finished: 2020-08-07T10:16:29.079436
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 47.010 s, Cores in use: 0.05, Total efficiency (on 16 cores): 0.3 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T10:16:29.107081
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/metrics/cus/outlier-mask-custom-253075p54948.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/metrics/cus/outliers-pre-custom-253075p54948.jpg
Image ksb_170602_101717_ooi_g_ls9-CCD4 g : masking 227 positive outlier pixels and 0 negative outlier pixels
Image ksb_160713_071700_ooi_r_ls9-CCD2 r : masking 142 positive outlier pixels and 0 negative outlier pixels
Image ksb_160713_072204_ooi_r_ls9-CCD4 r : masking 1078 positive outlier pixels and 0 negative outlier pixels
Image k4m_170527_094543_ooi_zd_ls9-CCD4 z : masking 467 positive outlier pixels and 0 negative outlier pixels
Image k4m_160616_064426_ooi_zd_ls9-CCD2 z : masking 608 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/metrics/cus/outlier-mask-custom-253075p54948.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/metrics/cus/outliers-post-custom-253075p54948.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/metrics/cus/outliers-masked-pos-custom-253075p54948.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/metrics/cus/outliers-masked-neg-custom-253075p54948.jpg
Stage outliers : Wall: 1.33 s, CPU: 0.94 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 237 MB, VmData: 268 MB, maxrss: 0.243136 MB
Stage outliers finished: 2020-08-07T10:16:30.434829
Resources for stage outliers : 1.928 s worker CPU, 2.065 s worker Wall, Wall: 1.329 s, Cores in use: 2.16, Total efficiency (on 16 cores): 13.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T10:16:30.461182
Stage halos : Wall: 0.34 s, CPU: 0.31 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 238 MB, VmData: 269 MB, maxrss: 0.24358 MB
Stage halos finished: 2020-08-07T10:16:30.806136
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.346 s, Cores in use: 0.90, Total efficiency (on 16 cores): 5.6 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T10:16:30.836274
PSF sigmas in coadd pixels: ['1.86', '2.33', '2.61']
Using average PSF sigma 2.2702157795472093
Gaussian PSF norm 0.12425902168213344 vs pixelized 0.10482777
average tim pixel scale / coadd scale: 1.73025582348288
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.89', '3.69', '4.28', '3.47', '4.04']
Using average PSF sigma 3.47398519431446
Gaussian PSF norm 0.08120207081928725 vs pixelized 0.06259319
average tim pixel scale / coadd scale: 1.7303472139538472
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.35', '1.50', '1.24', '1.51']
Using average PSF sigma 1.3977809411646842
Gaussian PSF norm 0.20181616694446133 vs pixelized 0.16440189
average tim pixel scale / coadd scale: 0.9908851188116969
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.33 s, CPU: 0.32 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 241 MB, VmData: 270 MB, maxrss: 0.247004 MB
Stage fit_on_coadds finished: 2020-08-07T10:16:31.169719
Resources for stage fit_on_coadds : 0.416 s worker CPU, 0.416 s worker Wall, Wall: 0.335 s, Cores in use: 2.20, Total efficiency (on 16 cores): 13.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T10:16:31.182614
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 89 potential peaks
Of 89 potential peaks: 52 in veto map, 3 cut by saddle test, 0 cut by aper test, 34 kept
SED z : 34 new peaks
Found 157 potential peaks
Of 157 potential peaks: 155 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 205 potential peaks
Of 205 potential peaks: 197 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 120 potential peaks
Of 120 potential peaks: 110 in veto map, 6 cut by saddle test, 0 cut by aper test, 4 kept
SED Flat : 4 new peaks
Found 122 potential peaks
Of 122 potential peaks: 115 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 41 new sources
Median coadd sky for g : 0.00012414443
Median coadd sky for r : 0.00019960427
Median coadd sky for z : 0.00019311123
Stage srcs : Wall: 0.71 s, CPU: 0.65 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 242 MB, VmData: 270 MB, maxrss: 0.247488 MB
Stage srcs finished: 2020-08-07T10:16:31.896585
Resources for stage srcs : 0.196 s worker CPU, 0.196 s worker Wall, Wall: 0.715 s, Cores in use: 1.18, Total efficiency (on 16 cores): 7.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T10:16:31.927511
Blob 1 of 22, id: 9, sources: 21, size: 263x254, npix 38104, brick X: 18,281, Y: 94,348, one pixel: 155 94
Blob 2 of 22, id: 13, sources: 2, size: 51x86, npix 2879, brick X: 328,379, Y: 204,290, one pixel: 349 204
Blob 3 of 22, id: 2, sources: 1, size: 26x51, npix 962, brick X: 353,379, Y: 20,71, one pixel: 372 20
Blob 4 of 22, id: 0, sources: 1, size: 38x31, npix 888, brick X: 255,293, Y: 0,31, one pixel: 263 0
Blob 5 of 22, id: 6, sources: 2, size: 43x28, npix 830, brick X: 209,252, Y: 49,77, one pixel: 218 49
Blob 6 of 22, id: 16, sources: 1, size: 32x35, npix 791, brick X: 159,191, Y: 314,349, one pixel: 173 314
Blob 7 of 22, id: 7, sources: 2, size: 33x43, npix 754, brick X: 117,150, Y: 57,100, one pixel: 130 57
Blob 8 of 22, id: 17, sources: 2, size: 40x35, npix 751, brick X: 201,241, Y: 322,357, one pixel: 210 322
Blob 9 of 22, id: 19, sources: 1, size: 32x33, npix 708, brick X: 179,211, Y: 343,376, one pixel: 193 343
Blob 10 of 22, id: 3, sources: 1, size: 26x32, npix 598, brick X: 0,26, Y: 26,58, one pixel: 11 26
Blob 11 of 22, id: 18, sources: 1, size: 30x31, npix 595, brick X: 48,78, Y: 323,354, one pixel: 63 323
Blob 12 of 22, id: 15, sources: 1, size: 29x29, npix 592, brick X: 340,369, Y: 306,335, one pixel: 352 306
Blob 13 of 22, id: 8, sources: 1, size: 28x27, npix 482, brick X: 329,357, Y: 91,118, one pixel: 342 91
Blob 14 of 22, id: 12, sources: 1, size: 27x25, npix 451, brick X: 276,303, Y: 190,215, one pixel: 285 190
Blob 15 of 22, id: 5, sources: 1, size: 27x26, npix 445, brick X: 180,207, Y: 33,59, one pixel: 192 33
Blob 16 of 22, id: 20, sources: 1, size: 23x24, npix 325, brick X: 127,150, Y: 351,375, one pixel: 137 351
Blob 17 of 22, id: 1, sources: 1, size: 23x23, npix 296, brick X: 21,44, Y: 18,41, one pixel: 31 18
Blob 8 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.1474 MB
Blob 18 of 22, id: 11, sources: 1, size: 21x21, npix 260, brick X: 337,358, Y: 129,150, one pixel: 346 129
Blob 19 of 22, id: 14, sources: 1, size: 20x20, npix 238, brick X: 322,342, Y: 302,322, one pixel: 330 302
Blob 6 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14698 MB
Blob 20 of 22, id: 4, sources: 1, size: 19x20, npix 227, brick X: 290,309, Y: 26,46, one pixel: 298 26
Blob 14 finished, total: Wall: 0.58 s, CPU: 0.57 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147704 MB
Blob 21 of 22, id: 21, sources: 1, size: 15x21, npix 208, brick X: 0,15, Y: 358,379, one pixel: 4 358
Blob 15 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147812 MB
Blob 22 of 22, id: 10, sources: 1, size: 18x17, npix 162, brick X: 98,116, Y: 99,116, one pixel: 106 99
Blob 19 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147704 MB
Blob 9 finished, total: Wall: 0.76 s, CPU: 0.75 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147472 MB
Blob 16 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147208 MB
Blob 7 finished, total: Wall: 0.84 s, CPU: 0.83 s, VmPeak: 803 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147716 MB
Blob 18 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14698 MB
Blob 22 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147472 MB
Blob 10 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.1019 MB
Measuring 1 iterative sources
Blob 13 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 811 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147652 MB
Blob 12 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.096768 MB
Blob 5 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 120 MB, VmData: 161 MB, maxrss: 0.122656 MB
Blob 3 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148044 MB
Blob 17 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148456 MB
Blob 4 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148316 MB
Blob 11 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148564 MB
Blob 20 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147812 MB
Blob 21 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147704 MB
Blob 2 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145564 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.73756, ee1=0.569893, ee2=0.134753
Measuring 7 iterative sources
Blob 1 finished, total: Wall: 18.55 s, CPU: 18.54 s, VmPeak: 804 MB, VmSize: 745 MB, VmRSS: 169 MB, VmData: 200 MB, maxrss: 0.174228 MB
Old catalog: 49
New catalog: 49
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/metrics/cus/blobs-custom-253075p54948.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/metrics/cus/all-models-custom-253075p54948.fits
Stage fitblobs : Wall: 19.41 s, CPU: 0.42 s, VmPeak: 986 MB, VmSize: 986 MB, VmRSS: 242 MB, VmData: 270 MB, maxrss: 0.247844 MB
Stage fitblobs finished: 2020-08-07T10:16:51.334966
Resources for stage fitblobs : 33.845 s worker CPU, 33.983 s worker Wall, Wall: 19.409 s, Cores in use: 1.77, Total efficiency (on 16 cores): 11.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T10:16:51.692226
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/tmp-legacysurvey-custom-253075p54948-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/tmp-legacysurvey-custom-253075p54948-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/tmp-legacysurvey-custom-253075p54948-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/tmp-legacysurvey-custom-253075p54948-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-resid.jpg
Stage coadds : Wall: 7.08 s, CPU: 0.80 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 245 MB, VmData: 274 MB, maxrss: 0.25044 MB
Stage coadds finished: 2020-08-07T10:16:58.771365
Resources for stage coadds : 7.341 s worker CPU, 7.616 s worker Wall, Wall: 7.081 s, Cores in use: 1.15, Total efficiency (on 16 cores): 7.2 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T10:16:59.367197
Cut to 1 unWISE tiles
Reading WISE tile 2527p545 band 1
Reading WISE tile 2527p545 band 2
Reading WISE tile 2527p545 band 3
Reading WISE tile 2527p545 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 811 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.20442 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 802 MB, VmSize: 802 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.188208 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.07 s, VmPeak: 813 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.20472 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2527p545/unwise-2527p545-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 799 MB, VmRSS: 146 MB, VmData: 173 MB, maxrss: 0.208424 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/tmp-legacysurvey-custom-253075p54948-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/tmp-legacysurvey-custom-253075p54948-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 14.99 s, CPU: 0.56 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 245 MB, VmData: 274 MB, maxrss: 0.251144 MB
Stage wise_forced finished: 2020-08-07T10:17:14.359795
Resources for stage wise_forced : 3.196 s worker CPU, 17.693 s worker Wall, Wall: 14.994 s, Cores in use: 0.25, Total efficiency (on 16 cores): 1.6 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T10:17:14.377457
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/coadd/cus/custom-253075p54948/legacysurvey-custom-253075p54948-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/tractor-i/cus/tractor-custom-253075p54948.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/tractor/cus/tractor-custom-253075p54948.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/tractor/cus/brick-custom-253075p54948.sha256sum
Stage writecat : Wall: 0.76 s, CPU: 0.61 s, VmPeak: 1122 MB, VmSize: 994 MB, VmRSS: 247 MB, VmData: 274 MB, maxrss: 0.384028 MB
Stage writecat finished: 2020-08-07T10:17:15.137157
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.761 s, Cores in use: 0.81, Total efficiency (on 16 cores): 5.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2485512/PGC2485512-largegalaxy-writecat.p
All done: 54.929 s worker CPU, 548.694 s worker Wall, Wall: 246.210 s, Cores in use: 0.26, Total efficiency (on 16 cores): 1.6 %
Finished galaxy PGC2485512 in 4.151 minutes.