Started working on galaxy PGC2145751 at Wed Aug  5 20:56:54 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.0791435 39.222812700000006 --width 281 --height 281 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:56:55.767671
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.0791435', '39.222812700000006', '--width', '281', '--height', '281', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.0791435 39.222812700000006 --width 281 --height 281 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 277.0791435 39.222812700000006
Starting process 56609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 56610 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 56611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 56612 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 56613 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 56614 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 56615 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 56616 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 56617 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 56618 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 56619 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 56620 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 56621 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 56623 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 56622 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 56624 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:56:56.760101
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 10 CCDs:
  k4m_160424_112848_ooi_zd_ls9-CCD4 z expnum 84585 exptime 80.104 propid 2016A    seeing 0.94 MJD 57502.478 object MzLS_599430_z 
    mosaic/CP/V4.3/CP20160423/k4m_160424_112848_ooi_zd_ls9.fits.fz
  k4m_160512_105201_ooi_zd_ls9-CCD1 z expnum 88585 exptime 250.102 propid 2016A-0453 seeing 1.63 MJD 57520.453 object MzLS_601375_z 
    mosaic/CP/V4.3/CP20160511/k4m_160512_105201_ooi_zd_ls9.fits.fz
  k4m_160517_102213_ooi_zd_ls9-CCD3 z expnum 89717 exptime 90.104 propid 2016A-0453 seeing 1.25 MJD 57525.432 object MzLS_601374_z 
    mosaic/CP/V4.3/CP20160516/k4m_160517_102213_ooi_zd_ls9.fits.fz
  k4m_160501_110427_ooi_zd_ls9-CCD2 z expnum 86252 exptime 83.104 propid 2016A-0453 seeing 1.29 MJD 57509.461 object MzLS_600404_z 
    mosaic/CP/V4.3/CP20160430/k4m_160501_110427_ooi_zd_ls9.fits.fz
  ksb_160514_104308_ooi_r_ls9-CCD4 r expnum 75220178 exptime 54.5 propid BASS seeing 1.06 MJD 57522.447 object 13612 
    90prime/CP/V2.3/CP20160513/ksb_160514_104308_ooi_r_ls9.fits.fz
  ksb_180418_101422_ooi_g_ls9-CCD4 g expnum 82260158 exptime 91.709 propid BASS seeing 1.27 MJD 58226.427 object 13612 
    90prime/CP/V2.3/CP20180417/ksb_180418_101422_ooi_g_ls9.fits.fz
  ksb_170501_110633_ooi_r_ls9-CCD1 r expnum 78740272 exptime 68.656 propid BASS seeing 1.45 MJD 57874.463 object 13613 
    90prime/CP/V2.3/CP20170430/ksb_170501_110633_ooi_r_ls9.fits.fz
  ksb_160705_072550_ooi_g_ls9-CCD1 g expnum 75740104 exptime 103.0 propid BASS seeing 1.97 MJD 57574.310 object 13613 
    90prime/CP/V2.3/CP20160704/ksb_160705_072550_ooi_g_ls9.fits.fz
  ksb_160603_091015_ooi_g_ls9-CCD1 g expnum 75420134 exptime 83.5 propid BASS seeing 1.36 MJD 57542.382 object 13611 
    90prime/CP/V2.3/CP20160602/ksb_160603_091015_ooi_g_ls9.fits.fz
  ksb_160531_085701_ooi_r_ls9-CCD1 r expnum 75390181 exptime 55.5 propid BASS seeing 1.48 MJD 57539.373 object 13611 
    90prime/CP/V2.3/CP20160530/ksb_160531_085701_ooi_r_ls9.fits.fz
Faked up EXPNUM 75740104
Faked up EXPNUM 75740104
Faked up EXPNUM 75740104
90prime get_fwhm: self.fwhm = 4.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 209 377 and amp range 0 2015 and image y 1033 1198 and amp range 0 2047
Range in image: x 0 169 , y 0 166 (with image size 169 x 166)
dzp -0.011813398 -> scaling image by 0.989178436928226
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78740272
Faked up EXPNUM 78740272
Faked up EXPNUM 78740272
90prime get_fwhm: self.fwhm = 3.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 214 381 and amp range 0 2015 and image y 1027 1192 and amp range 0 2047
Range in image: x 0 168 , y 0 166 (with image size 168 x 166)
dzp -0.024106435 -> scaling image by 0.9780418215011345
Faked up EXPNUM 75420134
Faked up EXPNUM 75420134
Faked up EXPNUM 75420134
90prime get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2230 2395 and amp range 2016 4031 and image y 3027 3191 and amp range 2048 4095
Range in image: x 0 166 , y 0 165 (with image size 166 x 165)
dzp 0.009677861 -> scaling image by 1.0089534840651213
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75390181
Faked up EXPNUM 75390181
Faked up EXPNUM 75390181
90prime get_fwhm: self.fwhm = 3.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2228 2392 and amp range 2016 4031 and image y 3036 3200 and amp range 2048 4095
Range in image: x 0 165 , y 0 165 (with image size 165 x 165)
dzp 0.01301769 -> scaling image by 1.0120619004021345
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 6.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1434 1724 and amp range 0 2005 and image y 7 298 and amp range 0 2039
Range in image: x 0 291 , y 0 292 (with image size 291 x 292)
dzp -0.011066288 -> scaling image by 0.989859339076806
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 82260158
Faked up EXPNUM 82260158
Faked up EXPNUM 82260158
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 97 260 and amp range 0 2015 and image y 571 735 and amp range 0 2047
Range in image: x 0 164 , y 0 165 (with image size 164 x 165)
dzp 0.0059804036 -> scaling image by 1.0055233530762397
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1436 1724 and amp range 0 2005 and image y 3723 4018 and amp range 2040 4078
Range in image: x 0 289 , y 0 296 (with image size 289 x 296)
dzp 0.0022078273 -> scaling image by 1.0020355530120029
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2617 2909 and amp range 2048 4095 and image y 3319 3610 and amp range 2022 4060
Range in image: x 0 293 , y 0 292 (with image size 293 x 292)
dzp -0.0028835079 -> scaling image by 0.9973477146455455
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 4.97
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 7 164 and amp range 0 2047 and image y 2527 2810 and amp range 2040 4078
Range in image: x 0 158 , y 0 284 (with image size 158 x 284)
dzp 0.008550294 -> scaling image by 1.0079062018164673
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75220178
Faked up EXPNUM 75220178
Faked up EXPNUM 75220178
90prime get_fwhm: self.fwhm = 2.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 71 235 and amp range 0 2015 and image y 557 721 and amp range 0 2047
Range in image: x 0 165 , y 0 165 (with image size 165 x 165)
dzp 0.009781551 -> scaling image by 1.0090498455107675
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 39.56 s, CPU: 1.53 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.180036 MB
Stage tims finished: 2020-08-05T20:57:36.315037
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.846 s worker CPU, 98.142 s worker Wall, Wall: 39.557 s, Cores in use: 0.19, Total efficiency (on 16 cores): 1.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:57:36.341623
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02210.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02338.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02211.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/metrics/cus/reference-custom-277079p39222.fits
Stage refs : Wall: 23.87 s, CPU: 7.71 s, VmPeak: 1045 MB, VmSize: 1040 MB, VmRSS: 261 MB, VmData: 290 MB, maxrss: 0.26706 MB
Stage refs finished: 2020-08-05T20:58:00.210686
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 23.870 s, Cores in use: 0.32, Total efficiency (on 16 cores): 2.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:58:00.291830
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/metrics/cus/outlier-mask-custom-277079p39222.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/metrics/cus/outliers-pre-custom-277079p39222.jpg
Image k4m_160501_110427_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 323 negative outlier pixels
Image k4m_160512_105201_ooi_zd_ls9-CCD1 z : masking 10011 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/metrics/cus/outlier-mask-custom-277079p39222.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/metrics/cus/outliers-post-custom-277079p39222.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/metrics/cus/outliers-masked-pos-custom-277079p39222.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/metrics/cus/outliers-masked-neg-custom-277079p39222.jpg
Stage outliers : Wall: 1.42 s, CPU: 1.14 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 276 MB, VmData: 303 MB, maxrss: 0.283136 MB
Stage outliers finished: 2020-08-05T20:58:01.707147
Resources for stage outliers : 1.022 s worker CPU, 1.087 s worker Wall, Wall: 1.417 s, Cores in use: 1.53, Total efficiency (on 16 cores): 9.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:58:01.733193
Stage halos : Wall: 0.89 s, CPU: 0.86 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 277 MB, VmData: 304 MB, maxrss: 0.283464 MB
Stage halos finished: 2020-08-05T20:58:02.627906
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.896 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:58:02.747602
PSF sigmas in coadd pixels: ['2.07', '3.20', '2.21']
Using average PSF sigma 2.4945888162535717
Gaussian PSF norm 0.11308268117610433 vs pixelized 0.10352784
average tim pixel scale / coadd scale: 1.7294598226115563
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.72', '2.36', '2.41']
Using average PSF sigma 2.16088501143918
Gaussian PSF norm 0.1305459523669883 vs pixelized 0.11252235
average tim pixel scale / coadd scale: 1.7292714030801795
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.52', '2.65', '2.04', '2.10']
Using average PSF sigma 2.0767744004655024
Gaussian PSF norm 0.13583314187166767 vs pixelized 0.106323935
average tim pixel scale / coadd scale: 0.9909499026052938
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.18 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 280 MB, VmData: 305 MB, maxrss: 0.286368 MB
Stage fit_on_coadds finished: 2020-08-05T20:58:02.987914
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.319 s worker CPU, 0.319 s worker Wall, Wall: 0.242 s, Cores in use: 2.05, Total efficiency (on 16 cores): 12.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:58:03.007937
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 64 potential peaks
Of 64 potential peaks: 27 in veto map, 4 cut by saddle test, 0 cut by aper test, 33 kept
SED z : 33 new peaks
Found 124 potential peaks
Of 124 potential peaks: 112 in veto map, 9 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 83 potential peaks
Of 83 potential peaks: 76 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 91 potential peaks
Of 91 potential peaks: 81 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 83 potential peaks
Of 83 potential peaks: 76 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 40 new sources
Median coadd sky for g : 0.00032285956
Median coadd sky for r : 0.000627901
Median coadd sky for z : -0.00037383847
Stage srcs : Wall: 1.97 s, CPU: 1.90 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 280 MB, VmData: 305 MB, maxrss: 0.28698 MB
Stage srcs finished: 2020-08-05T20:58:04.977668
Resources for stage srcs : 0.097 s worker CPU, 0.097 s worker Wall, Wall: 1.971 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:58:04.997709
Blob 1 of 13, id: 5, sources: 29, size: 281x253, npix 31808, brick X: 0,281, Y: 28,281, one pixel: 241 28
Blob 2 of 13, id: 9, sources: 5, size: 62x64, npix 2813, brick X: 0,62, Y: 181,245, one pixel: 16 181
Blob 3 of 13, id: 2, sources: 4, size: 31x60, npix 1323, brick X: 0,31, Y: 2,62, one pixel: 9 2
Blob 4 of 13, id: 11, sources: 3, size: 53x38, npix 1128, brick X: 217,270, Y: 221,259, one pixel: 257 221
Blob 5 of 13, id: 1, sources: 2, size: 38x38, npix 1107, brick X: 117,155, Y: 0,38, one pixel: 122 0
Blob 6 of 13, id: 4, sources: 2, size: 40x51, npix 1090, brick X: 160,200, Y: 6,57, one pixel: 183 6
Blob 7 of 13, id: 0, sources: 2, size: 36x43, npix 882, brick X: 41,77, Y: 0,43, one pixel: 52 0
Blob 8 of 13, id: 7, sources: 1, size: 28x27, npix 501, brick X: 47,75, Y: 170,197, one pixel: 58 170
Blob 9 of 13, id: 6, sources: 1, size: 27x26, npix 433, brick X: 166,193, Y: 64,90, one pixel: 178 64
Blob 10 of 13, id: 10, sources: 1, size: 25x25, npix 390, brick X: 202,227, Y: 190,215, one pixel: 213 190
Blob 11 of 13, id: 8, sources: 1, size: 22x23, npix 292, brick X: 255,277, Y: 177,200, one pixel: 265 177
Blob 12 of 13, id: 12, sources: 1, size: 22x21, npix 290, brick X: 67,89, Y: 243,264, one pixel: 76 243
Blob 13 of 13, id: 3, sources: 1, size: 17x17, npix 145, brick X: 240,257, Y: 3,20, one pixel: 248 3
Blob 13 finished, total: Wall: 0.09 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150824 MB
Blob 12 finished, total: Wall: 0.24 s, CPU: 0.23 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151288 MB
Blob 9 finished, total: Wall: 0.31 s, CPU: 0.30 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151264 MB
Blob 8 finished, total: Wall: 0.45 s, CPU: 0.44 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15082 MB
Blob 10 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151092 MB
Blob 11 finished, total: Wall: 0.47 s, CPU: 0.46 s, VmPeak: 792 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.138264 MB
Blob 6 finished, total: Wall: 0.65 s, CPU: 0.64 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094464 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.10841, 39.22723), pm (-6.6, -18.5), parallax 1.799 with NanoMaggies: g=11.7, r=11.2, z=11
Reset brightness to NanoMaggies: g=11.7, r=11.2, z=11
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.09706, 39.22688), pm (-0.4, -2.8), parallax 0.211 with NanoMaggies: g=17.6, r=17.1, z=17
Reset brightness to NanoMaggies: g=17.6, r=17.1, z=17
Blob 2 finished, total: Wall: 0.79 s, CPU: 0.77 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.094784 MB
Blob 7 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.0952 MB
Blob 5 finished, total: Wall: 1.09 s, CPU: 1.08 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097348 MB
Blob 4 finished, total: Wall: 1.22 s, CPU: 1.21 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095624 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.09251, 39.21490), pm (-1.5, -6.0), parallax 0.363 with NanoMaggies: g=16.8, r=16.3, z=16.2
Reset brightness to NanoMaggies: g=16.8, r=16.3, z=16.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.09788, 39.21460), pm (1.5, -3.3), parallax 0.200 with NanoMaggies: g=17.9, r=17.3, z=17.1
Reset brightness to NanoMaggies: g=17.9, r=17.3, z=17.1
Blob 3 finished, total: Wall: 1.40 s, CPU: 1.39 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150896 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.48873, ee1=-1.00216, ee2=-0.223514
Measuring 7 iterative sources
Blob 1 finished, total: Wall: 22.25 s, CPU: 22.25 s, VmPeak: 813 MB, VmSize: 744 MB, VmRSS: 167 MB, VmData: 196 MB, maxrss: 0.180632 MB
Old catalog: 60
New catalog: 54
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/metrics/cus/blobs-custom-277079p39222.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/metrics/cus/all-models-custom-277079p39222.fits
Stage fitblobs : Wall: 24.06 s, CPU: 1.58 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 281 MB, VmData: 307 MB, maxrss: 0.288208 MB
Stage fitblobs finished: 2020-08-05T20:58:29.055202
Resources for stage fitblobs : 30.567 s worker CPU, 31.682 s worker Wall, Wall: 24.059 s, Cores in use: 1.34, Total efficiency (on 16 cores): 8.4 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:58:29.074870
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/tmp-legacysurvey-custom-277079p39222-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/tmp-legacysurvey-custom-277079p39222-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/tmp-legacysurvey-custom-277079p39222-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/tmp-legacysurvey-custom-277079p39222-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-resid.jpg
Stage coadds : Wall: 3.12 s, CPU: 1.20 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 282 MB, VmData: 307 MB, maxrss: 0.288532 MB
Stage coadds finished: 2020-08-05T20:58:32.198400
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 9.363 s worker CPU, 13.815 s worker Wall, Wall: 3.125 s, Cores in use: 3.38, Total efficiency (on 16 cores): 21.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T20:58:32.215034
Cut to 1 unWISE tiles
Reading WISE tile 2767p393 band 1
Reading WISE tile 2767p393 band 2
Reading WISE tile 2767p393 band 3
Reading WISE tile 2767p393 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 809 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.189388 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 806 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.207708 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.206008 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 804 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.207576 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/tmp-legacysurvey-custom-277079p39222-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/tmp-legacysurvey-custom-277079p39222-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.67 s, CPU: 0.67 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 282 MB, VmData: 307 MB, maxrss: 0.289044 MB
Stage wise_forced finished: 2020-08-05T20:58:36.880392
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.225 s worker CPU, 7.248 s worker Wall, Wall: 4.667 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:58:36.949891
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/coadd/cus/custom-277079p39222/legacysurvey-custom-277079p39222-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/tractor-i/cus/tractor-custom-277079p39222.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/tractor/cus/tractor-custom-277079p39222.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/tractor/cus/brick-custom-277079p39222.sha256sum
Stage writecat : Wall: 2.17 s, CPU: 1.11 s, VmPeak: 1182 MB, VmSize: 1054 MB, VmRSS: 284 MB, VmData: 307 MB, maxrss: 0.421924 MB
Stage writecat finished: 2020-08-05T20:58:39.122840
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.175 s, Cores in use: 0.51, Total efficiency (on 16 cores): 3.2 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2145751/PGC2145751-largegalaxy-writecat.p
All done: 50.442 s worker CPU, 152.393 s worker Wall, Wall: 102.389 s, Cores in use: 0.67, Total efficiency (on 16 cores): 4.2 %
Finished galaxy PGC2145751 in 1.747 minutes.
Started working on galaxy PGC2145751 at Fri Aug  7 09:27:47 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.07871188292324 39.222979672625605 --width 281 --height 281 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T09:27:49.352178
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.07871188292324', '39.222979672625605', '--width', '281', '--height', '281', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.07871188292324 39.222979672625605 --width 281 --height 281 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 277.07871188292324 39.222979672625605
Starting process 27308 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 27309 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 27311 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 27313 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 27315 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB
Starting process 27317 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB
Starting process 27319 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB
Starting process 27322 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 27323 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 27325 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 27327 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 27329 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 27331 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 27333 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 27335 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 27337 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T09:27:49.867222
Keeping 10 CCDs:
  k4m_160424_112848_ooi_zd_ls9-CCD4 z expnum 84585 exptime 80.104 propid 2016A    seeing 0.94 MJD 57502.478 object MzLS_599430_z 
    mosaic/CP/V4.3/CP20160423/k4m_160424_112848_ooi_zd_ls9.fits.fz
  k4m_160512_105201_ooi_zd_ls9-CCD1 z expnum 88585 exptime 250.102 propid 2016A-0453 seeing 1.63 MJD 57520.453 object MzLS_601375_z 
    mosaic/CP/V4.3/CP20160511/k4m_160512_105201_ooi_zd_ls9.fits.fz
  k4m_160517_102213_ooi_zd_ls9-CCD3 z expnum 89717 exptime 90.104 propid 2016A-0453 seeing 1.25 MJD 57525.432 object MzLS_601374_z 
    mosaic/CP/V4.3/CP20160516/k4m_160517_102213_ooi_zd_ls9.fits.fz
  k4m_160501_110427_ooi_zd_ls9-CCD2 z expnum 86252 exptime 83.104 propid 2016A-0453 seeing 1.29 MJD 57509.461 object MzLS_600404_z 
    mosaic/CP/V4.3/CP20160430/k4m_160501_110427_ooi_zd_ls9.fits.fz
  ksb_160514_104308_ooi_r_ls9-CCD4 r expnum 75220178 exptime 54.5 propid BASS seeing 1.06 MJD 57522.447 object 13612 
    90prime/CP/V2.3/CP20160513/ksb_160514_104308_ooi_r_ls9.fits.fz
  ksb_180418_101422_ooi_g_ls9-CCD4 g expnum 82260158 exptime 91.709 propid BASS seeing 1.27 MJD 58226.427 object 13612 
    90prime/CP/V2.3/CP20180417/ksb_180418_101422_ooi_g_ls9.fits.fz
  ksb_170501_110633_ooi_r_ls9-CCD1 r expnum 78740272 exptime 68.656 propid BASS seeing 1.45 MJD 57874.463 object 13613 
    90prime/CP/V2.3/CP20170430/ksb_170501_110633_ooi_r_ls9.fits.fz
  ksb_160705_072550_ooi_g_ls9-CCD1 g expnum 75740104 exptime 103.0 propid BASS seeing 1.97 MJD 57574.310 object 13613 
    90prime/CP/V2.3/CP20160704/ksb_160705_072550_ooi_g_ls9.fits.fz
  ksb_160603_091015_ooi_g_ls9-CCD1 g expnum 75420134 exptime 83.5 propid BASS seeing 1.36 MJD 57542.382 object 13611 
    90prime/CP/V2.3/CP20160602/ksb_160603_091015_ooi_g_ls9.fits.fz
  ksb_160531_085701_ooi_r_ls9-CCD1 r expnum 75390181 exptime 55.5 propid BASS seeing 1.48 MJD 57539.373 object 13611 
    90prime/CP/V2.3/CP20160530/ksb_160531_085701_ooi_r_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 6.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1436 1726 and amp range 0 2005 and image y 7 294 and amp range 0 2039
Range in image: x 0 291 , y 0 288 (with image size 291 x 288)
dzp -0.011066288 -> scaling image by 0.989859339076806
mosaic get_fwhm: self.fwhm = 4.97
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 7 166 and amp range 0 2047 and image y 2522 2805 and amp range 2040 4078
Range in image: x 0 160 , y 0 284 (with image size 160 x 284)
dzp 0.008550294 -> scaling image by 1.0079062018164673
mosaic get_fwhm: self.fwhm = 4.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1438 1727 and amp range 0 2005 and image y 3718 4013 and amp range 2040 4078
Range in image: x 0 290 , y 0 296 (with image size 290 x 296)
dzp 0.0022078273 -> scaling image by 1.0020355530120029
mosaic get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2619 2911 and amp range 2048 4095 and image y 3314 3605 and amp range 2022 4060
Range in image: x 0 293 , y 0 292 (with image size 293 x 292)
dzp -0.0028835079 -> scaling image by 0.9973477146455455
Faked up EXPNUM 75740104
Faked up EXPNUM 75740104
Faked up EXPNUM 75740104
90prime get_fwhm: self.fwhm = 4.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 208 375 and amp range 0 2015 and image y 1036 1201 and amp range 0 2047
Range in image: x 0 168 , y 0 166 (with image size 168 x 166)
dzp -0.011813398 -> scaling image by 0.989178436928226
Faked up EXPNUM 82260158
Faked up EXPNUM 82260158
Faked up EXPNUM 82260158
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 95 259 and amp range 0 2015 and image y 574 737 and amp range 0 2047
Range in image: x 0 165 , y 0 164 (with image size 165 x 164)
dzp 0.0059804036 -> scaling image by 1.0055233530762397
Faked up EXPNUM 75390181
Faked up EXPNUM 75390181
Faked up EXPNUM 75390181
90prime get_fwhm: self.fwhm = 3.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2226 2391 and amp range 2016 4031 and image y 3039 3203 and amp range 2048 4095
Range in image: x 0 166 , y 0 165 (with image size 166 x 165)
dzp 0.01301769 -> scaling image by 1.0120619004021345
Faked up EXPNUM 78740272
Faked up EXPNUM 78740272
Faked up EXPNUM 78740272
90prime get_fwhm: self.fwhm = 3.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 213 380 and amp range 0 2015 and image y 1029 1194 and amp range 0 2047
Range in image: x 0 168 , y 0 166 (with image size 168 x 166)
dzp -0.024106435 -> scaling image by 0.9780418215011345
Faked up EXPNUM 75220178
Faked up EXPNUM 75220178
Faked up EXPNUM 75220178
90prime get_fwhm: self.fwhm = 2.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 70 234 and amp range 0 2015 and image y 560 724 and amp range 0 2047
Range in image: x 0 165 , y 0 165 (with image size 165 x 165)
dzp 0.009781551 -> scaling image by 1.0090498455107675
Faked up EXPNUM 75420134
Faked up EXPNUM 75420134
Faked up EXPNUM 75420134
90prime get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2229 2393 and amp range 2016 4031 and image y 3030 3193 and amp range 2048 4095
Range in image: x 0 165 , y 0 164 (with image size 165 x 164)
dzp 0.009677861 -> scaling image by 1.0089534840651213
Stage tims : Wall: 51.16 s, CPU: 0.83 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178276 MB
Stage tims finished: 2020-08-07T09:28:41.022353
Resources for stage tims : 4.973 s worker CPU, 221.280 s worker Wall, Wall: 51.157 s, Cores in use: 0.11, Total efficiency (on 16 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T09:28:41.085616
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02210.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02338.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02211.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/metrics/cus/reference-custom-277078p39222.fits
Stage refs : Wall: 7.60 s, CPU: 6.77 s, VmPeak: 1039 MB, VmSize: 1033 MB, VmRSS: 258 MB, VmData: 290 MB, maxrss: 0.264652 MB
Stage refs finished: 2020-08-07T09:28:48.684813
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.601 s, Cores in use: 0.89, Total efficiency (on 16 cores): 5.6 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T09:28:48.714166
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/metrics/cus/outlier-mask-custom-277078p39222.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/metrics/cus/outliers-pre-custom-277078p39222.jpg
Image k4m_160512_105201_ooi_zd_ls9-CCD1 z : masking 9997 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/metrics/cus/outlier-mask-custom-277078p39222.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/metrics/cus/outliers-post-custom-277078p39222.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/metrics/cus/outliers-masked-pos-custom-277078p39222.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/metrics/cus/outliers-masked-neg-custom-277078p39222.jpg
Stage outliers : Wall: 1.07 s, CPU: 0.67 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 275 MB, VmData: 303 MB, maxrss: 0.281676 MB
Stage outliers finished: 2020-08-07T09:28:49.784755
Resources for stage outliers : 0.995 s worker CPU, 1.116 s worker Wall, Wall: 1.072 s, Cores in use: 1.55, Total efficiency (on 16 cores): 9.7 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T09:28:49.957227
Stage halos : Wall: 0.27 s, CPU: 0.26 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 275 MB, VmData: 304 MB, maxrss: 0.281952 MB
Stage halos finished: 2020-08-07T09:28:50.226884
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.271 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T09:28:50.261149
PSF sigmas in coadd pixels: ['2.07', '3.20', '2.21']
Using average PSF sigma 2.4945888162535717
Gaussian PSF norm 0.11308268117610433 vs pixelized 0.10352581
average tim pixel scale / coadd scale: 1.7294598226115563
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.72', '2.36', '2.41']
Using average PSF sigma 2.16088501143918
Gaussian PSF norm 0.1305459523669883 vs pixelized 0.11252517
average tim pixel scale / coadd scale: 1.7292714030801795
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.52', '2.65', '2.04', '2.10']
Using average PSF sigma 2.0767744004655024
Gaussian PSF norm 0.13583314187166767 vs pixelized 0.10632398
average tim pixel scale / coadd scale: 0.9909499026052938
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.17 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 277 MB, VmData: 304 MB, maxrss: 0.283476 MB
Stage fit_on_coadds finished: 2020-08-07T09:28:50.491226
Resources for stage fit_on_coadds : 0.303 s worker CPU, 0.303 s worker Wall, Wall: 0.232 s, Cores in use: 2.05, Total efficiency (on 16 cores): 12.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T09:28:50.522109
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 61 potential peaks
Of 61 potential peaks: 25 in veto map, 6 cut by saddle test, 0 cut by aper test, 30 kept
SED z : 30 new peaks
Found 126 potential peaks
Of 126 potential peaks: 114 in veto map, 8 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 82 potential peaks
Of 82 potential peaks: 76 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 84 potential peaks
Of 84 potential peaks: 73 in veto map, 8 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 72 potential peaks
Of 72 potential peaks: 64 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 38 new sources
Median coadd sky for g : 0.00031969056
Median coadd sky for r : 0.0006347022
Median coadd sky for z : -0.00030564057
Stage srcs : Wall: 0.64 s, CPU: 0.60 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 277 MB, VmData: 304 MB, maxrss: 0.28396 MB
Stage srcs finished: 2020-08-07T09:28:51.165823
Resources for stage srcs : 0.117 s worker CPU, 0.118 s worker Wall, Wall: 0.645 s, Cores in use: 1.11, Total efficiency (on 16 cores): 6.9 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T09:28:51.187455
Blob 1 of 13, id: 5, sources: 27, size: 281x256, npix 31961, brick X: 0,281, Y: 25,281, one pixel: 239 25
Blob 2 of 13, id: 9, sources: 5, size: 58x63, npix 2598, brick X: 0,58, Y: 179,242, one pixel: 10 179
Blob 3 of 13, id: 11, sources: 3, size: 52x38, npix 1133, brick X: 213,265, Y: 219,257, one pixel: 252 219
Blob 4 of 13, id: 4, sources: 2, size: 40x52, npix 1119, brick X: 155,195, Y: 3,55, one pixel: 180 3
Blob 5 of 13, id: 2, sources: 2, size: 39x35, npix 1023, brick X: 112,151, Y: 0,35, one pixel: 117 0
Blob 6 of 13, id: 0, sources: 4, size: 26x51, npix 999, brick X: 0,26, Y: 0,51, one pixel: 6 0
Blob 7 of 13, id: 1, sources: 2, size: 33x41, npix 785, brick X: 37,70, Y: 0,41, one pixel: 49 0
Blob 8 of 13, id: 7, sources: 1, size: 29x27, npix 499, brick X: 42,71, Y: 167,194, one pixel: 56 167
Blob 9 of 13, id: 6, sources: 1, size: 27x26, npix 433, brick X: 162,189, Y: 62,88, one pixel: 173 62
Blob 10 of 13, id: 10, sources: 1, size: 25x25, npix 381, brick X: 198,223, Y: 188,213, one pixel: 208 188
Blob 11 of 13, id: 8, sources: 1, size: 21x23, npix 292, brick X: 251,272, Y: 175,198, one pixel: 260 175
Blob 12 of 13, id: 12, sources: 1, size: 23x21, npix 283, brick X: 62,85, Y: 240,261, one pixel: 72 240
Blob 13 of 13, id: 3, sources: 1, size: 17x17, npix 145, brick X: 235,252, Y: 1,18, one pixel: 243 1
Blob 13 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147248 MB
Blob 12 finished, total: Wall: 0.14 s, CPU: 0.14 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146864 MB
Blob 11 finished, total: Wall: 0.22 s, CPU: 0.21 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095416 MB
Blob 9 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147064 MB
Blob 10 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147004 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.09251, 39.21490), pm (-1.5, -6.0), parallax 0.363 with NanoMaggies: g=17, r=16.4, z=16.8
Reset brightness to NanoMaggies: g=16.8, r=16.3, z=16.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.09788, 39.21460), pm (1.5, -3.3), parallax 0.200 with NanoMaggies: g=17.9, r=17.3, z=17.1
Reset brightness to NanoMaggies: g=17.9, r=17.3, z=17.1
Blob 6 finished, total: Wall: 0.47 s, CPU: 0.46 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092712 MB
Blob 8 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.09446 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.10841, 39.22723), pm (-6.6, -18.5), parallax 1.799 with NanoMaggies: g=11.7, r=11.2, z=11
Reset brightness to NanoMaggies: g=11.7, r=11.2, z=11
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.09706, 39.22688), pm (-0.4, -2.8), parallax 0.211 with NanoMaggies: g=17.6, r=17.1, z=17
Reset brightness to NanoMaggies: g=17.6, r=17.1, z=17
Blob 2 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095368 MB
Blob 4 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147832 MB
Blob 7 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 792 MB, VmSize: 712 MB, VmRSS: 131 MB, VmData: 170 MB, maxrss: 0.133776 MB
Blob 3 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147192 MB
Blob 5 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095216 MB
Exception in one_blob: brick custom-277078p39222, iblob 5
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob
    result = one_blob(X)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob
    B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run
    Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness
    br = src.getBrightness()
AttributeError: 'NoneType' object has no attribute 'getBrightness'
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker
    result = (True, func(*args, **kwds))
  File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__
    R = self.func(*args, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob
    result = one_blob(X)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob
    B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run
    Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness
    br = src.getBrightness()
AttributeError: 'NoneType' object has no attribute 'getBrightness'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3771, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3739, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3295, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3284, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1131, in stage_fitblobs
    r = Riter.next(timeout)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next
    raise value
AttributeError: 'NoneType' object has no attribute 'getBrightness'
Something went wrong; please check the logfile.
ERROR: galaxy PGC2145751; please check the logfile.
Finished galaxy PGC2145751 in 1.221 minutes.
Started working on galaxy PGC2145751 at Fri Aug  7 12:07:07 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.07871188292324 39.222979672625605 --width 281 --height 281 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T12:07:08.542553
legacypipe git version: DR9.5.11-watershed-4-gcc619972
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.07871188292324', '39.222979672625605', '--width', '281', '--height', '281', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.07871188292324 39.222979672625605 --width 281 --height 281 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 277.07871188292324 39.222979672625605
Starting process 16757 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 16758 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 16759 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 16760 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 16761 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 16762 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 16763 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 16764 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 16765 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 16766 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 16767 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 16768 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 16769 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 16770 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 16771 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 16772 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 16773 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 16774 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 16775 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 16776 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 16777 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 16778 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 16779 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 16780 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 16781 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 16782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 16783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 16784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 16786 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 16787 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 16785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 16788 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-srcs.p and forcing stage srcs
Runstage fit_on_coadds
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-fit_on_coadds.p and forcing stage fit_on_coadds
Runstage halos
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-halos.p and forcing stage halos
Runstage outliers
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-outliers.p and forcing stage outliers
Runstage refs
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-refs.p and forcing stage refs
Runstage tims
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-tims.p and forcing stage tims
Running stage tims
Running stage tims at 2020-08-07T12:07:09.169495
Keeping 10 CCDs:
  k4m_160424_112848_ooi_zd_ls9-CCD4 z expnum 84585 exptime 80.104 propid 2016A    seeing 0.94 MJD 57502.478 object MzLS_599430_z 
    mosaic/CP/V4.3/CP20160423/k4m_160424_112848_ooi_zd_ls9.fits.fz
  k4m_160512_105201_ooi_zd_ls9-CCD1 z expnum 88585 exptime 250.102 propid 2016A-0453 seeing 1.63 MJD 57520.453 object MzLS_601375_z 
    mosaic/CP/V4.3/CP20160511/k4m_160512_105201_ooi_zd_ls9.fits.fz
  k4m_160517_102213_ooi_zd_ls9-CCD3 z expnum 89717 exptime 90.104 propid 2016A-0453 seeing 1.25 MJD 57525.432 object MzLS_601374_z 
    mosaic/CP/V4.3/CP20160516/k4m_160517_102213_ooi_zd_ls9.fits.fz
  k4m_160501_110427_ooi_zd_ls9-CCD2 z expnum 86252 exptime 83.104 propid 2016A-0453 seeing 1.29 MJD 57509.461 object MzLS_600404_z 
    mosaic/CP/V4.3/CP20160430/k4m_160501_110427_ooi_zd_ls9.fits.fz
  ksb_160514_104308_ooi_r_ls9-CCD4 r expnum 75220178 exptime 54.5 propid BASS seeing 1.06 MJD 57522.447 object 13612 
    90prime/CP/V2.3/CP20160513/ksb_160514_104308_ooi_r_ls9.fits.fz
  ksb_180418_101422_ooi_g_ls9-CCD4 g expnum 82260158 exptime 91.709 propid BASS seeing 1.27 MJD 58226.427 object 13612 
    90prime/CP/V2.3/CP20180417/ksb_180418_101422_ooi_g_ls9.fits.fz
  ksb_170501_110633_ooi_r_ls9-CCD1 r expnum 78740272 exptime 68.656 propid BASS seeing 1.45 MJD 57874.463 object 13613 
    90prime/CP/V2.3/CP20170430/ksb_170501_110633_ooi_r_ls9.fits.fz
  ksb_160705_072550_ooi_g_ls9-CCD1 g expnum 75740104 exptime 103.0 propid BASS seeing 1.97 MJD 57574.310 object 13613 
    90prime/CP/V2.3/CP20160704/ksb_160705_072550_ooi_g_ls9.fits.fz
  ksb_160603_091015_ooi_g_ls9-CCD1 g expnum 75420134 exptime 83.5 propid BASS seeing 1.36 MJD 57542.382 object 13611 
    90prime/CP/V2.3/CP20160602/ksb_160603_091015_ooi_g_ls9.fits.fz
  ksb_160531_085701_ooi_r_ls9-CCD1 r expnum 75390181 exptime 55.5 propid BASS seeing 1.48 MJD 57539.373 object 13611 
    90prime/CP/V2.3/CP20160530/ksb_160531_085701_ooi_r_ls9.fits.fz
Faked up EXPNUM 78740272
Faked up EXPNUM 78740272
Faked up EXPNUM 78740272
90prime get_fwhm: self.fwhm = 3.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 213 380 and amp range 0 2015 and image y 1029 1194 and amp range 0 2047
Range in image: x 0 168 , y 0 166 (with image size 168 x 166)
dzp -0.024106435 -> scaling image by 0.9780418215011345
mosaic get_fwhm: self.fwhm = 6.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1436 1726 and amp range 0 2005 and image y 7 294 and amp range 0 2039
Range in image: x 0 291 , y 0 288 (with image size 291 x 288)
dzp -0.011066288 -> scaling image by 0.989859339076806
mosaic get_fwhm: self.fwhm = 4.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1438 1727 and amp range 0 2005 and image y 3718 4013 and amp range 2040 4078
Range in image: x 0 290 , y 0 296 (with image size 290 x 296)
dzp 0.0022078273 -> scaling image by 1.0020355530120029
Faked up EXPNUM 75420134
Faked up EXPNUM 75420134
Faked up EXPNUM 75420134
90prime get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2229 2393 and amp range 2016 4031 and image y 3030 3193 and amp range 2048 4095
Range in image: x 0 165 , y 0 164 (with image size 165 x 164)
dzp 0.009677861 -> scaling image by 1.0089534840651213
Faked up EXPNUM 75740104
Faked up EXPNUM 75740104
Faked up EXPNUM 75740104
90prime get_fwhm: self.fwhm = 4.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 208 375 and amp range 0 2015 and image y 1036 1201 and amp range 0 2047
Range in image: x 0 168 , y 0 166 (with image size 168 x 166)
dzp -0.011813398 -> scaling image by 0.989178436928226
Faked up EXPNUM 75220178
Faked up EXPNUM 75220178
Faked up EXPNUM 75220178
90prime get_fwhm: self.fwhm = 2.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 70 234 and amp range 0 2015 and image y 560 724 and amp range 0 2047
Range in image: x 0 165 , y 0 165 (with image size 165 x 165)
dzp 0.009781551 -> scaling image by 1.0090498455107675
mosaic get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2619 2911 and amp range 2048 4095 and image y 3314 3605 and amp range 2022 4060
Range in image: x 0 293 , y 0 292 (with image size 293 x 292)
dzp -0.0028835079 -> scaling image by 0.9973477146455455
mosaic get_fwhm: self.fwhm = 4.97
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 7 166 and amp range 0 2047 and image y 2522 2805 and amp range 2040 4078
Range in image: x 0 160 , y 0 284 (with image size 160 x 284)
dzp 0.008550294 -> scaling image by 1.0079062018164673
Faked up EXPNUM 75390181
Faked up EXPNUM 75390181
Faked up EXPNUM 75390181
90prime get_fwhm: self.fwhm = 3.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2226 2391 and amp range 2016 4031 and image y 3039 3203 and amp range 2048 4095
Range in image: x 0 166 , y 0 165 (with image size 166 x 165)
dzp 0.01301769 -> scaling image by 1.0120619004021345
Faked up EXPNUM 82260158
Faked up EXPNUM 82260158
Faked up EXPNUM 82260158
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 95 259 and amp range 0 2015 and image y 574 737 and amp range 0 2047
Range in image: x 0 165 , y 0 164 (with image size 165 x 164)
dzp 0.0059804036 -> scaling image by 1.0055233530762397
Stage tims : Wall: 2.29 s, CPU: 0.78 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178128 MB
Stage tims finished: 2020-08-07T12:07:11.461624
Resources for stage tims : 5.291 s worker CPU, 11.555 s worker Wall, Wall: 2.295 s, Cores in use: 2.64, Total efficiency (on 32 cores): 8.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T12:07:12.113660
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02210.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02338.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02211.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/metrics/cus/reference-custom-277078p39222.fits
Stage refs : Wall: 7.12 s, CPU: 6.78 s, VmPeak: 1039 MB, VmSize: 1033 MB, VmRSS: 259 MB, VmData: 290 MB, maxrss: 0.264912 MB
Stage refs finished: 2020-08-07T12:07:19.237387
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 7.126 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T12:07:19.261021
Stage outliers : Wall: 0.31 s, CPU: 0.28 s, VmPeak: 1039 MB, VmSize: 1034 MB, VmRSS: 260 MB, VmData: 290 MB, maxrss: 0.265736 MB
Stage outliers finished: 2020-08-07T12:07:19.569857
Resources for stage outliers : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.311 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T12:07:19.596117
Stage halos : Wall: 0.23 s, CPU: 0.22 s, VmPeak: 1039 MB, VmSize: 1034 MB, VmRSS: 263 MB, VmData: 294 MB, maxrss: 0.269016 MB
Stage halos finished: 2020-08-07T12:07:19.824160
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.230 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T12:07:19.867420
PSF sigmas in coadd pixels: ['2.07', '3.20', '2.21']
Using average PSF sigma 2.4945888162535717
Gaussian PSF norm 0.11308268117610433 vs pixelized 0.10352581
average tim pixel scale / coadd scale: 1.7294598226115563
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.72', '2.36', '2.41']
Using average PSF sigma 2.16088501143918
Gaussian PSF norm 0.1305459523669883 vs pixelized 0.11252519
average tim pixel scale / coadd scale: 1.7292714030801795
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.52', '2.65', '2.04', '2.10']
Using average PSF sigma 2.0767744004655024
Gaussian PSF norm 0.13583314187166767 vs pixelized 0.10632398
average tim pixel scale / coadd scale: 0.9909499026052938
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.18 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 275 MB, VmData: 304 MB, maxrss: 0.281828 MB
Stage fit_on_coadds finished: 2020-08-07T12:07:20.129592
Resources for stage fit_on_coadds : 0.306 s worker CPU, 0.464 s worker Wall, Wall: 0.264 s, Cores in use: 1.85, Total efficiency (on 32 cores): 5.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T12:07:20.141950
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 61 potential peaks
Of 61 potential peaks: 25 in veto map, 6 cut by saddle test, 0 cut by aper test, 30 kept
SED z : 30 new peaks
Found 126 potential peaks
Of 126 potential peaks: 114 in veto map, 8 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 82 potential peaks
Of 82 potential peaks: 76 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 84 potential peaks
Of 84 potential peaks: 73 in veto map, 8 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 72 potential peaks
Of 72 potential peaks: 64 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 38 new sources
Median coadd sky for g : 0.0003196905
Median coadd sky for r : 0.0006347022
Median coadd sky for z : -0.00030564057
Stage srcs : Wall: 0.72 s, CPU: 0.64 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 276 MB, VmData: 304 MB, maxrss: 0.282704 MB
Stage srcs finished: 2020-08-07T12:07:20.858499
Resources for stage srcs : 0.151 s worker CPU, 0.167 s worker Wall, Wall: 0.719 s, Cores in use: 1.11, Total efficiency (on 32 cores): 3.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T12:07:20.885555
Blob 1 of 13, id: 5, sources: 27, size: 281x256, npix 31961, brick X: 0,281, Y: 25,281, one pixel: 239 25
Blob 2 of 13, id: 9, sources: 5, size: 58x63, npix 2598, brick X: 0,58, Y: 179,242, one pixel: 10 179
Blob 3 of 13, id: 11, sources: 3, size: 52x38, npix 1133, brick X: 213,265, Y: 219,257, one pixel: 252 219
Blob 4 of 13, id: 4, sources: 2, size: 40x52, npix 1119, brick X: 155,195, Y: 3,55, one pixel: 180 3
Blob 5 of 13, id: 2, sources: 2, size: 39x35, npix 1023, brick X: 112,151, Y: 0,35, one pixel: 117 0
Blob 6 of 13, id: 0, sources: 4, size: 26x51, npix 999, brick X: 0,26, Y: 0,51, one pixel: 6 0
Blob 7 of 13, id: 1, sources: 2, size: 33x41, npix 785, brick X: 37,70, Y: 0,41, one pixel: 49 0
Blob 8 of 13, id: 7, sources: 1, size: 29x27, npix 499, brick X: 42,71, Y: 167,194, one pixel: 56 167
Blob 9 of 13, id: 6, sources: 1, size: 27x26, npix 433, brick X: 162,189, Y: 62,88, one pixel: 173 62
Blob 10 of 13, id: 10, sources: 1, size: 25x25, npix 381, brick X: 198,223, Y: 188,213, one pixel: 208 188
Blob 11 of 13, id: 8, sources: 1, size: 21x23, npix 292, brick X: 251,272, Y: 175,198, one pixel: 260 175
Blob 12 of 13, id: 12, sources: 1, size: 23x21, npix 283, brick X: 62,85, Y: 240,261, one pixel: 72 240
Blob 13 of 13, id: 3, sources: 1, size: 17x17, npix 145, brick X: 235,252, Y: 1,18, one pixel: 243 1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.09788, 39.21460), pm (1.5, -3.3), parallax 0.200 with NanoMaggies: g=17.9, r=17.3, z=17.1
Reset brightness to NanoMaggies: g=17.9, r=17.3, z=17.1
Blob 13 finished, total: Wall: 0.10 s, CPU: 0.09 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.084048 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.09251, 39.21490), pm (-1.5, -6.0), parallax 0.363 with NanoMaggies: g=18.9, r=17.5, z=17.5
Reset brightness to NanoMaggies: g=16.8, r=16.3, z=16.1
Blob 12 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.0949 MB
Blob 11 finished, total: Wall: 0.17 s, CPU: 0.15 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089776 MB
Blob 9 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145056 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.10841, 39.22723), pm (-6.6, -18.5), parallax 1.799 with NanoMaggies: g=11.7, r=11.2, z=11
Reset brightness to NanoMaggies: g=11.7, r=11.2, z=11
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.09706, 39.22688), pm (-0.4, -2.8), parallax 0.211 with NanoMaggies: g=17.6, r=17.1, z=17
Reset brightness to NanoMaggies: g=17.6, r=17.1, z=17
Blob 10 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146572 MB
Blob 8 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145096 MB
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146028 MB
Blob 4 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093704 MB
Blob 7 finished, total: Wall: 0.81 s, CPU: 0.80 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090548 MB
Blob 2 finished, total: Wall: 0.84 s, CPU: 0.78 s, VmPeak: 668 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092776 MB
Blob 3 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145532 MB
Blob 5 finished, total: Wall: 1.03 s, CPU: 1.01 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.090844 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.36388, ee1=-0.579765, ee2=-0.0780973
Measuring 5 iterative sources
Blob 1 finished, total: Wall: 19.44 s, CPU: 19.39 s, VmPeak: 710 MB, VmSize: 698 MB, VmRSS: 128 MB, VmData: 166 MB, maxrss: 0.147492 MB
Old catalog: 58
New catalog: 50
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/metrics/cus/blobs-custom-277078p39222.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/metrics/cus/all-models-custom-277078p39222.fits
Stage fitblobs : Wall: 20.79 s, CPU: 0.37 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 278 MB, VmData: 306 MB, maxrss: 0.28472 MB
Stage fitblobs finished: 2020-08-07T12:07:41.672798
Resources for stage fitblobs : 25.809 s worker CPU, 26.064 s worker Wall, Wall: 20.790 s, Cores in use: 1.26, Total efficiency (on 32 cores): 3.9 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T12:07:41.689955
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/tmp-legacysurvey-custom-277078p39222-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/tmp-legacysurvey-custom-277078p39222-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/tmp-legacysurvey-custom-277078p39222-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/tmp-legacysurvey-custom-277078p39222-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-resid.jpg
Stage coadds : Wall: 2.24 s, CPU: 0.61 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 279 MB, VmData: 306 MB, maxrss: 0.28598 MB
Stage coadds finished: 2020-08-07T12:07:43.927383
Resources for stage coadds : 25.979 s worker CPU, 27.736 s worker Wall, Wall: 2.240 s, Cores in use: 11.87, Total efficiency (on 32 cores): 37.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T12:07:43.946262
Cut to 1 unWISE tiles
Reading WISE tile 2767p393 band 1
Reading WISE tile 2767p393 band 2
Reading WISE tile 2767p393 band 3
Reading WISE tile 2767p393 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 813 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.183284 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 797 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.203332 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 808 MB, VmSize: 797 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.203388 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2767p393/unwise-2767p393-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 795 MB, VmRSS: 142 MB, VmData: 173 MB, maxrss: 0.203492 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/tmp-legacysurvey-custom-277078p39222-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/tmp-legacysurvey-custom-277078p39222-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.91 s, CPU: 0.55 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 280 MB, VmData: 306 MB, maxrss: 0.286492 MB
Stage wise_forced finished: 2020-08-07T12:07:45.851452
Resources for stage wise_forced : 3.277 s worker CPU, 4.090 s worker Wall, Wall: 1.907 s, Cores in use: 2.01, Total efficiency (on 32 cores): 6.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T12:07:45.880517
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/coadd/cus/custom-277078p39222/legacysurvey-custom-277078p39222-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/tractor-i/cus/tractor-custom-277078p39222.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/tractor/cus/tractor-custom-277078p39222.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/tractor/cus/brick-custom-277078p39222.sha256sum
Stage writecat : Wall: 0.77 s, CPU: 0.60 s, VmPeak: 1175 MB, VmSize: 1047 MB, VmRSS: 282 MB, VmData: 306 MB, maxrss: 0.419376 MB
Stage writecat finished: 2020-08-07T12:07:46.645582
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.768 s, Cores in use: 0.79, Total efficiency (on 32 cores): 2.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2145751/PGC2145751-largegalaxy-writecat.p
All done: 60.819 s worker CPU, 70.084 s worker Wall, Wall: 37.509 s, Cores in use: 1.92, Total efficiency (on 32 cores): 6.0 %
Finished galaxy PGC2145751 in 0.659 minutes.