Started working on galaxy PGC2190844 at Wed Aug  5 21:40:57 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.53940000000006 42.0139503 --width 361 --height 361 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T21:40:57.768973
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.53940000000006', '42.0139503', '--width', '361', '--height', '361', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.53940000000006 42.0139503 --width 361 --height 361 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 273.53940000000006 42.0139503
Starting process 48133 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 48134 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 48135 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 48136 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 48137 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB
Starting process 48138 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB
Starting process 48140 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB
Starting process 48141 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 48142 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 48143 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 48144 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 48145 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 48146 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 48147 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 48148 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 48149 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T21:40:59.130105
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  k4m_170614_111520_ooi_zd_ls9-CCD4 z expnum 133375 exptime 97.104 propid 2016A-0453 seeing 0.91 MJD 57918.469 object MzLS_613741_z 
    mosaic/CP/V4.3/CP20170613/k4m_170614_111520_ooi_zd_ls9.fits.fz
  k4m_170805_073855_ooi_zd_ls9-CCD1 z expnum 3135803 exptime 129.107 propid 2016A-0453 seeing 0.93 MJD 57970.319 object MzLS_614674_z 
    mosaic/CP/V4.3/CP20170804/k4m_170805_073855_ooi_zd_ls9.fits.fz
  k4m_170529_112233_ooi_zd_ls9-CCD4 z expnum 130666 exptime 84.101 propid 2016A-0453 seeing 0.78 MJD 57902.474 object MzLS_612806_z 
    mosaic/CP/V4.3/CP20170528/k4m_170529_112233_ooi_zd_ls9.fits.fz
  ksb_170621_061427_ooi_g_ls9-CCD1 g expnum 79250026 exptime 132.192 propid BASS seeing 1.21 MJD 57925.260 object 17473 
    90prime/CP/V2.3/CP20170620/ksb_170621_061427_ooi_g_ls9.fits.fz
  ksb_170430_113249_ooi_r_ls9-CCD1 r expnum 78730271 exptime 154.685 propid BASS seeing 1.62 MJD 57873.481 object 17473 
    90prime/CP/V2.3/CP20170429/ksb_170430_113249_ooi_r_ls9.fits.fz
  ksb_160516_101608_ooi_r_ls9-CCD4 r expnum 75240154 exptime 77.9 propid BASS seeing 1.53 MJD 57524.428 object 17472 
    90prime/CP/V2.3/CP20160515/ksb_160516_101608_ooi_r_ls9.fits.fz
  ksb_160704_080551_ooi_g_ls9-CCD4 g expnum 75730127 exptime 90.3 propid BASS seeing 1.75 MJD 57573.337 object 17472 
    90prime/CP/V2.3/CP20160703/ksb_160704_080551_ooi_g_ls9.fits.fz
  ksb_160603_084808_ooi_g_ls9-CCD3 g expnum 75420125 exptime 87.8 propid BASS seeing 1.54 MJD 57542.367 object 17471 
    90prime/CP/V2.3/CP20160602/ksb_160603_084808_ooi_g_ls9.fits.fz
  ksb_160531_084336_ooi_r_ls9-CCD3 r expnum 75390174 exptime 57.5 propid BASS seeing 1.14 MJD 57539.364 object 17471 
    90prime/CP/V2.3/CP20160530/ksb_160531_084336_ooi_r_ls9.fits.fz
Faked up EXPNUM 78730271
Faked up EXPNUM 78730271
Faked up EXPNUM 78730271
90prime get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1906 2117 and amp range 0 2015 and image y 3747 3957 and amp range 2048 4095
Range in image: x 0 110 , y 0 211 (with image size 212 x 211)
dzp -0.041613504 -> scaling image by 0.9623977484321999
Found overlap: image x 1906 2117 and amp range 2016 4031 and image y 3747 3957 and amp range 2048 4095
Range in image: x 110 212 , y 0 211 (with image size 212 x 211)
dzp 0.02308583 -> scaling image by 1.021490500713915
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75240154
Faked up EXPNUM 75240154
Faked up EXPNUM 75240154
90prime get_fwhm: self.fwhm = 3.37
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1716 1926 and amp range 0 2015 and image y 3249 3459 and amp range 2048 4095
Range in image: x 0 211 , y 0 211 (with image size 211 x 211)
dzp 0.004205519 -> scaling image by 1.0038809374310762
Faked up EXPNUM 75420125
Faked up EXPNUM 75420125
Faked up EXPNUM 75420125
90prime get_fwhm: self.fwhm = 3.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3895 4016 and amp range 2016 4031 and image y 1297 1506 and amp range 0 2047
Range in image: x 0 122 , y 0 210 (with image size 122 x 210)
dzp -0.0022715968 -> scaling image by 0.9979099691834846
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75390174
Faked up EXPNUM 75390174
Faked up EXPNUM 75390174
90prime get_fwhm: self.fwhm = 2.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3904 4016 and amp range 2016 4031 and image y 1297 1506 and amp range 0 2047
Range in image: x 0 113 , y 0 210 (with image size 113 x 210)
dzp 0.004245165 -> scaling image by 1.0039175950705865
mosaic get_fwhm: self.fwhm = 3.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2196 2560 and amp range 2006 4053 and image y 3834 4072 and amp range 2040 4078
Range in image: x 0 365 , y 0 239 (with image size 365 x 239)
dzp 0.0036595785 -> scaling image by 1.003376283213225
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 356 719 and amp range 0 2047 and image y 279 642 and amp range 0 2021
Range in image: x 0 364 , y 0 364 (with image size 364 x 364)
dzp -0.018417627 -> scaling image by 0.9831798050134541
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3305 3681 and amp range 2048 4095 and image y 2220 2590 and amp range 2022 4060
Range in image: x 0 377 , y 0 371 (with image size 377 x 371)
dzp -0.02499645 -> scaling image by 0.9772404160512723
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75730127
Faked up EXPNUM 75730127
Faked up EXPNUM 75730127
90prime get_fwhm: self.fwhm = 3.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1736 1946 and amp range 0 2015 and image y 3272 3483 and amp range 2048 4095
Range in image: x 0 211 , y 0 212 (with image size 211 x 212)
dzp 0.009255477 -> scaling image by 1.0085610475070432
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 79250026
Faked up EXPNUM 79250026
Faked up EXPNUM 79250026
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1883 2094 and amp range 0 2015 and image y 3742 3952 and amp range 2048 4095
Range in image: x 0 133 , y 0 211 (with image size 212 x 211)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Found overlap: image x 1883 2094 and amp range 2016 4031 and image y 3742 3952 and amp range 2048 4095
Range in image: x 133 212 , y 0 211 (with image size 212 x 211)
dzp 0.020521455 -> scaling image by 1.0190807119283773
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 24.77 s, CPU: 1.83 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.180892 MB
Stage tims finished: 2020-08-05T21:41:23.900694
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 4.778 s worker CPU, 41.406 s worker Wall, Wall: 24.772 s, Cores in use: 0.27, Total efficiency (on 16 cores): 1.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T21:41:23.924462
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02081.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02209.fits
Matched 12 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/metrics/cus/reference-custom-273539p42013.fits
Stage refs : Wall: 14.48 s, CPU: 6.31 s, VmPeak: 1024 MB, VmSize: 1018 MB, VmRSS: 240 MB, VmData: 270 MB, maxrss: 0.245564 MB
Stage refs finished: 2020-08-05T21:41:38.403712
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 14.481 s, Cores in use: 0.44, Total efficiency (on 16 cores): 2.7 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T21:41:38.428979
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/metrics/cus/outlier-mask-custom-273539p42013.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/metrics/cus/outliers-pre-custom-273539p42013.jpg
Image k4m_170805_073855_ooi_zd_ls9-CCD1 z : masking 179 positive outlier pixels and 0 negative outlier pixels
Image k4m_170529_112233_ooi_zd_ls9-CCD4 z : masking 379 positive outlier pixels and 0 negative outlier pixels
Image k4m_170614_111520_ooi_zd_ls9-CCD4 z : masking 161 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/metrics/cus/outlier-mask-custom-273539p42013.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/metrics/cus/outliers-post-custom-273539p42013.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/metrics/cus/outliers-masked-pos-custom-273539p42013.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/metrics/cus/outliers-masked-neg-custom-273539p42013.jpg
Stage outliers : Wall: 1.29 s, CPU: 0.85 s, VmPeak: 1027 MB, VmSize: 1027 MB, VmRSS: 263 MB, VmData: 291 MB, maxrss: 0.269588 MB
Stage outliers finished: 2020-08-05T21:41:39.717489
Resources for stage outliers : 1.116 s worker CPU, 1.394 s worker Wall, Wall: 1.290 s, Cores in use: 1.52, Total efficiency (on 16 cores): 9.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T21:41:39.741326
Stage halos : Wall: 0.92 s, CPU: 0.89 s, VmPeak: 1027 MB, VmSize: 1027 MB, VmRSS: 263 MB, VmData: 291 MB, maxrss: 0.269588 MB
Stage halos finished: 2020-08-05T21:41:40.659481
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.920 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T21:41:40.767117
PSF sigmas in coadd pixels: ['1.96', '2.85', '2.49']
Using average PSF sigma 2.435216632815056
Gaussian PSF norm 0.11583971133105432 vs pixelized 0.10188995
average tim pixel scale / coadd scale: 1.7288151838752717
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.63', '2.48', '1.85']
Using average PSF sigma 2.3184292358456657
Gaussian PSF norm 0.12167496312259961 vs pixelized 0.093447216
average tim pixel scale / coadd scale: 1.7296015871475443
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.48', '1.51', '1.27']
Using average PSF sigma 1.421014922482317
Gaussian PSF norm 0.1985164176046072 vs pixelized 0.16406365
average tim pixel scale / coadd scale: 0.9909164776335975
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.21 s, VmPeak: 1027 MB, VmSize: 1027 MB, VmRSS: 265 MB, VmData: 291 MB, maxrss: 0.27124 MB
Stage fit_on_coadds finished: 2020-08-05T21:41:41.002020
Resources for stage fit_on_coadds : 0.250 s worker CPU, 0.250 s worker Wall, Wall: 0.236 s, Cores in use: 1.97, Total efficiency (on 16 cores): 12.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T21:41:41.069100
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 88 potential peaks
Of 88 potential peaks: 45 in veto map, 6 cut by saddle test, 0 cut by aper test, 37 kept
SED z : 37 new peaks
Found 134 potential peaks
Of 134 potential peaks: 125 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 136 potential peaks
Of 136 potential peaks: 125 in veto map, 8 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 223 potential peaks
Of 223 potential peaks: 207 in veto map, 9 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 258 potential peaks
Of 258 potential peaks: 242 in veto map, 13 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 53 new sources
Median coadd sky for g : 0.00046990885
Median coadd sky for r : 0.0011084854
Median coadd sky for z : 6.833716e-05
Stage srcs : Wall: 0.97 s, CPU: 0.92 s, VmPeak: 1027 MB, VmSize: 1027 MB, VmRSS: 265 MB, VmData: 291 MB, maxrss: 0.27174 MB
Stage srcs finished: 2020-08-05T21:41:42.041047
Resources for stage srcs : 0.134 s worker CPU, 0.134 s worker Wall, Wall: 0.973 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T21:41:42.062099
Blob 1 of 24, id: 2, sources: 32, size: 302x346, npix 56901, brick X: 15,317, Y: 0,346, one pixel: 182 0
Blob 2 of 24, id: 0, sources: 5, size: 50x39, npix 1548, brick X: 0,50, Y: 0,39, one pixel: 0 0
Blob 3 of 24, id: 21, sources: 4, size: 71x35, npix 1457, brick X: 182,253, Y: 326,361, one pixel: 240 326
Blob 4 of 24, id: 22, sources: 1, size: 46x32, npix 1105, brick X: 59,105, Y: 329,361, one pixel: 78 329
Blob 5 of 24, id: 13, sources: 1, size: 27x39, npix 798, brick X: 0,27, Y: 233,272, one pixel: 6 233
Blob 6 of 24, id: 6, sources: 2, size: 34x38, npix 739, brick X: 0,34, Y: 86,124, one pixel: 19 86
Blob 7 of 24, id: 10, sources: 1, size: 30x31, npix 605, brick X: 308,338, Y: 162,193, one pixel: 322 162
Blob 8 of 24, id: 7, sources: 1, size: 30x30, npix 579, brick X: 326,356, Y: 87,117, one pixel: 338 87
Blob 9 of 24, id: 17, sources: 1, size: 25x31, npix 557, brick X: 336,361, Y: 293,324, one pixel: 350 293
Blob 10 of 24, id: 19, sources: 1, size: 29x28, npix 553, brick X: 307,336, Y: 308,336, one pixel: 319 308
Blob 11 of 24, id: 3, sources: 2, size: 25x38, npix 533, brick X: 294,319, Y: 7,45, one pixel: 306 7
Blob 12 of 24, id: 9, sources: 1, size: 25x30, npix 519, brick X: 336,361, Y: 139,169, one pixel: 348 139
Blob 13 of 24, id: 14, sources: 2, size: 28x34, npix 485, brick X: 54,82, Y: 242,276, one pixel: 63 242
Blob 14 of 24, id: 23, sources: 1, size: 31x21, npix 457, brick X: 326,357, Y: 340,361, one pixel: 336 340
Blob 15 of 24, id: 8, sources: 1, size: 28x28, npix 443, brick X: 301,329, Y: 126,154, one pixel: 309 126
Blob 16 of 24, id: 16, sources: 1, size: 26x25, npix 418, brick X: 22,48, Y: 284,309, one pixel: 33 284
Blob 17 of 24, id: 1, sources: 1, size: 33x17, npix 388, brick X: 123,156, Y: 0,17, one pixel: 127 0
Blob 13 finished, total: Wall: 0.14 s, CPU: 0.14 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15142 MB
Blob 18 of 24, id: 18, sources: 1, size: 24x24, npix 370, brick X: 187,211, Y: 307,331, one pixel: 196 307
Blob 4 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151352 MB
Blob 19 of 24, id: 12, sources: 1, size: 18x26, npix 325, brick X: 343,361, Y: 206,232, one pixel: 355 206
Blob 20 of 24, id: 5, sources: 1, size: 22x24, npix 316, brick X: 29,51, Y: 61,85, one pixel: 39 61
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.57628, 41.98688), pm (-6.5, -2.5), parallax 0.749 with NanoMaggies: g=12.1, r=11.3, z=10.9
Reset brightness to NanoMaggies: g=12.1, r=11.3, z=10.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.59416, 41.99427), pm (8.2, 3.3), parallax 1.735 with NanoMaggies: g=12.3, r=11.8, z=11.7
Reset brightness to NanoMaggies: g=12.3, r=11.8, z=11.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.57144, 41.99843), pm (5.7, -10.1), parallax 0.968 with NanoMaggies: g=13.7, r=13.4, z=13.3
Reset brightness to NanoMaggies: g=13.7, r=13.4, z=13.3
Measuring 2 iterative sources
Blob 18 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151352 MB
Blob 21 of 24, id: 4, sources: 1, size: 15x26, npix 279, brick X: 0,15, Y: 46,72, one pixel: 3 46
Blob 7 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096252 MB
Blob 22 of 24, id: 15, sources: 1, size: 21x22, npix 270, brick X: 27,48, Y: 258,280, one pixel: 36 258
Blob 15 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151772 MB
Blob 11 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 806 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151492 MB
Blob 23 of 24, id: 11, sources: 1, size: 18x21, npix 240, brick X: 0,18, Y: 167,188, one pixel: 8 167
Blob 17 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151528 MB
Blob 24 of 24, id: 20, sources: 1, size: 20x20, npix 209, brick X: 94,114, Y: 314,334, one pixel: 104 314
Blob 10 finished, total: Wall: 0.79 s, CPU: 0.78 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15116 MB
Blob 22 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151528 MB
Blob 24 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151508 MB
Blob 16 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151356 MB
Blob 20 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.09646 MB
Blob 8 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.1516 MB
Blob 21 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151772 MB
Blob 6 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094684 MB
Blob 23 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 806 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151492 MB
Blob 5 finished, total: Wall: 1.10 s, CPU: 1.09 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.0954 MB
Blob 9 finished, total: Wall: 1.12 s, CPU: 1.11 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.09636 MB
Blob 19 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151352 MB
Blob 12 finished, total: Wall: 1.15 s, CPU: 1.15 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100784 MB
Blob 14 finished, total: Wall: 1.53 s, CPU: 1.53 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.096608 MB
Blob 3 finished, total: Wall: 1.92 s, CPU: 1.92 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.152496 MB
Blob 2 finished, total: Wall: 2.05 s, CPU: 2.05 s, VmPeak: 806 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.152688 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.33005, ee1=0.0253767, ee2=-0.0509189
Measuring 12 iterative sources
Blob 1 finished, total: Wall: 33.41 s, CPU: 33.41 s, VmPeak: 742 MB, VmSize: 735 MB, VmRSS: 171 MB, VmData: 206 MB, maxrss: 0.176136 MB
Old catalog: 73
New catalog: 69
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/metrics/cus/blobs-custom-273539p42013.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/metrics/cus/all-models-custom-273539p42013.fits
Stage fitblobs : Wall: 34.06 s, CPU: 0.64 s, VmPeak: 1027 MB, VmSize: 1027 MB, VmRSS: 266 MB, VmData: 291 MB, maxrss: 0.272848 MB
Stage fitblobs finished: 2020-08-05T21:42:16.118318
Resources for stage fitblobs : 51.030 s worker CPU, 51.148 s worker Wall, Wall: 34.058 s, Cores in use: 1.52, Total efficiency (on 16 cores): 9.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T21:42:16.139792
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/tmp-legacysurvey-custom-273539p42013-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/tmp-legacysurvey-custom-273539p42013-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/tmp-legacysurvey-custom-273539p42013-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/tmp-legacysurvey-custom-273539p42013-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-resid.jpg
Stage coadds : Wall: 3.53 s, CPU: 1.11 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 268 MB, VmData: 293 MB, maxrss: 0.274052 MB
Stage coadds finished: 2020-08-05T21:42:19.671142
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 10.606 s worker CPU, 16.301 s worker Wall, Wall: 3.533 s, Cores in use: 3.32, Total efficiency (on 16 cores): 20.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T21:42:19.749329
Cut to 1 unWISE tiles
Reading WISE tile 2730p424 band 1
Reading WISE tile 2730p424 band 3
Reading WISE tile 2730p424 band 2
Reading WISE tile 2730p424 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.49 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 154 MB, VmData: 191 MB, maxrss: 0.194252 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.15 s, CPU: 0.40 s, VmPeak: 1072 MB, VmSize: 1008 MB, VmRSS: 151 MB, VmData: 184 MB, maxrss: 0.213496 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.25 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.207752 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.25 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 151 MB, VmData: 188 MB, maxrss: 0.212408 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/tmp-legacysurvey-custom-273539p42013-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/tmp-legacysurvey-custom-273539p42013-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.79 s, CPU: 1.82 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 268 MB, VmData: 293 MB, maxrss: 0.274564 MB
Stage wise_forced finished: 2020-08-05T21:42:23.541004
Resources for stage wise_forced : 4.427 s worker CPU, 5.444 s worker Wall, Wall: 3.793 s, Cores in use: 1.65, Total efficiency (on 16 cores): 10.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T21:42:23.560803
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/coadd/cus/custom-273539p42013/legacysurvey-custom-273539p42013-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/tractor-i/cus/tractor-custom-273539p42013.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/tractor/cus/tractor-custom-273539p42013.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/tractor/cus/brick-custom-273539p42013.sha256sum
Stage writecat : Wall: 1.30 s, CPU: 0.77 s, VmPeak: 1161 MB, VmSize: 1033 MB, VmRSS: 270 MB, VmData: 293 MB, maxrss: 0.407444 MB
Stage writecat finished: 2020-08-05T21:42:24.862672
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.304 s, Cores in use: 0.60, Total efficiency (on 16 cores): 3.7 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2190844/PGC2190844-largegalaxy-writecat.p
All done: 72.346 s worker CPU, 116.082 s worker Wall, Wall: 85.757 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 %
Finished galaxy PGC2190844 in 1.471 minutes.
Started working on galaxy PGC2190844 at Fri Aug  7 10:11:59 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.538899890438 42.01377137700789 --width 361 --height 361 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T10:12:01.030571
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.538899890438', '42.01377137700789', '--width', '361', '--height', '361', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.538899890438 42.01377137700789 --width 361 --height 361 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 273.538899890438 42.01377137700789
Starting process 47228 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 47229 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47230 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47231 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47232 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB
Starting process 47233 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05936 MB
Starting process 47234 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05936 MB
Starting process 47235 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 47236 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 47237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 47238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 47239 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 47241 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 47242 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 47240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 47243 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T10:12:01.503310
Keeping 9 CCDs:
  k4m_170614_111520_ooi_zd_ls9-CCD4 z expnum 133375 exptime 97.104 propid 2016A-0453 seeing 0.91 MJD 57918.469 object MzLS_613741_z 
    mosaic/CP/V4.3/CP20170613/k4m_170614_111520_ooi_zd_ls9.fits.fz
  k4m_170805_073855_ooi_zd_ls9-CCD1 z expnum 3135803 exptime 129.107 propid 2016A-0453 seeing 0.93 MJD 57970.319 object MzLS_614674_z 
    mosaic/CP/V4.3/CP20170804/k4m_170805_073855_ooi_zd_ls9.fits.fz
  k4m_170529_112233_ooi_zd_ls9-CCD4 z expnum 130666 exptime 84.101 propid 2016A-0453 seeing 0.78 MJD 57902.474 object MzLS_612806_z 
    mosaic/CP/V4.3/CP20170528/k4m_170529_112233_ooi_zd_ls9.fits.fz
  ksb_170621_061427_ooi_g_ls9-CCD1 g expnum 79250026 exptime 132.192 propid BASS seeing 1.21 MJD 57925.260 object 17473 
    90prime/CP/V2.3/CP20170620/ksb_170621_061427_ooi_g_ls9.fits.fz
  ksb_170430_113249_ooi_r_ls9-CCD1 r expnum 78730271 exptime 154.685 propid BASS seeing 1.62 MJD 57873.481 object 17473 
    90prime/CP/V2.3/CP20170429/ksb_170430_113249_ooi_r_ls9.fits.fz
  ksb_160516_101608_ooi_r_ls9-CCD4 r expnum 75240154 exptime 77.9 propid BASS seeing 1.53 MJD 57524.428 object 17472 
    90prime/CP/V2.3/CP20160515/ksb_160516_101608_ooi_r_ls9.fits.fz
  ksb_160704_080551_ooi_g_ls9-CCD4 g expnum 75730127 exptime 90.3 propid BASS seeing 1.75 MJD 57573.337 object 17472 
    90prime/CP/V2.3/CP20160703/ksb_160704_080551_ooi_g_ls9.fits.fz
  ksb_160603_084808_ooi_g_ls9-CCD3 g expnum 75420125 exptime 87.8 propid BASS seeing 1.54 MJD 57542.367 object 17471 
    90prime/CP/V2.3/CP20160602/ksb_160603_084808_ooi_g_ls9.fits.fz
  ksb_160531_084336_ooi_r_ls9-CCD3 r expnum 75390174 exptime 57.5 propid BASS seeing 1.14 MJD 57539.364 object 17471 
    90prime/CP/V2.3/CP20160530/ksb_160531_084336_ooi_r_ls9.fits.fz
Faked up EXPNUM 78730271
Faked up EXPNUM 78730271
Faked up EXPNUM 78730271
90prime get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1908 2118 and amp range 0 2015 and image y 3750 3960 and amp range 2048 4095
Range in image: x 0 108 , y 0 211 (with image size 211 x 211)
dzp -0.041613504 -> scaling image by 0.9623977484321999
Found overlap: image x 1908 2118 and amp range 2016 4031 and image y 3750 3960 and amp range 2048 4095
Range in image: x 108 211 , y 0 211 (with image size 211 x 211)
dzp 0.02308583 -> scaling image by 1.021490500713915
Faked up EXPNUM 75420125
Faked up EXPNUM 75420125
Faked up EXPNUM 75420125
90prime get_fwhm: self.fwhm = 3.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3896 4016 and amp range 2016 4031 and image y 1299 1509 and amp range 0 2047
Range in image: x 0 121 , y 0 211 (with image size 121 x 211)
dzp -0.0022715968 -> scaling image by 0.9979099691834846
Faked up EXPNUM 75240154
Faked up EXPNUM 75240154
Faked up EXPNUM 75240154
90prime get_fwhm: self.fwhm = 3.37
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1717 1928 and amp range 0 2015 and image y 3252 3462 and amp range 2048 4095
Range in image: x 0 212 , y 0 211 (with image size 212 x 211)
dzp 0.004205519 -> scaling image by 1.0038809374310762
mosaic get_fwhm: self.fwhm = 3.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 353 717 and amp range 0 2047 and image y 273 636 and amp range 0 2021
Range in image: x 0 365 , y 0 364 (with image size 365 x 364)
dzp -0.018417627 -> scaling image by 0.9831798050134541
Faked up EXPNUM 75390174
Faked up EXPNUM 75390174
Faked up EXPNUM 75390174
90prime get_fwhm: self.fwhm = 2.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3905 4016 and amp range 2016 4031 and image y 1300 1509 and amp range 0 2047
Range in image: x 0 112 , y 0 210 (with image size 112 x 210)
dzp 0.004245165 -> scaling image by 1.0039175950705865
mosaic get_fwhm: self.fwhm = 3.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2193 2558 and amp range 2006 4053 and image y 3829 4072 and amp range 2040 4078
Range in image: x 0 366 , y 0 244 (with image size 366 x 244)
dzp 0.0036595785 -> scaling image by 1.003376283213225
mosaic get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3302 3679 and amp range 2048 4095 and image y 2215 2585 and amp range 2022 4060
Range in image: x 0 378 , y 0 371 (with image size 378 x 371)
dzp -0.02499645 -> scaling image by 0.9772404160512723
Faked up EXPNUM 75730127
Faked up EXPNUM 75730127
Faked up EXPNUM 75730127
90prime get_fwhm: self.fwhm = 3.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1737 1948 and amp range 0 2015 and image y 3275 3485 and amp range 2048 4095
Range in image: x 0 212 , y 0 211 (with image size 212 x 211)
dzp 0.009255477 -> scaling image by 1.0085610475070432
Faked up EXPNUM 79250026
Faked up EXPNUM 79250026
Faked up EXPNUM 79250026
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1885 2096 and amp range 0 2015 and image y 3745 3955 and amp range 2048 4095
Range in image: x 0 131 , y 0 211 (with image size 212 x 211)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Found overlap: image x 1885 2096 and amp range 2016 4031 and image y 3745 3955 and amp range 2048 4095
Range in image: x 131 212 , y 0 211 (with image size 212 x 211)
dzp 0.020521455 -> scaling image by 1.0190807119283773
Stage tims : Wall: 79.10 s, CPU: 0.93 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.179132 MB
Stage tims finished: 2020-08-07T10:13:20.600475
Resources for stage tims : 4.310 s worker CPU, 134.499 s worker Wall, Wall: 79.099 s, Cores in use: 0.07, Total efficiency (on 16 cores): 0.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T10:13:20.736442
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02081.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02209.fits
Matched 12 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/metrics/cus/reference-custom-273538p42013.fits
Stage refs : Wall: 93.07 s, CPU: 5.39 s, VmPeak: 1017 MB, VmSize: 1012 MB, VmRSS: 239 MB, VmData: 270 MB, maxrss: 0.244328 MB
Stage refs finished: 2020-08-07T10:14:53.811404
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 93.076 s, Cores in use: 0.06, Total efficiency (on 16 cores): 0.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T10:14:54.057036
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/metrics/cus/outlier-mask-custom-273538p42013.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/metrics/cus/outliers-pre-custom-273538p42013.jpg
Image k4m_170805_073855_ooi_zd_ls9-CCD1 z : masking 246 positive outlier pixels and 0 negative outlier pixels
Image k4m_170614_111520_ooi_zd_ls9-CCD4 z : masking 200 positive outlier pixels and 0 negative outlier pixels
Image k4m_170529_112233_ooi_zd_ls9-CCD4 z : masking 367 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/metrics/cus/outlier-mask-custom-273538p42013.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/metrics/cus/outliers-post-custom-273538p42013.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/metrics/cus/outliers-masked-pos-custom-273538p42013.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/metrics/cus/outliers-masked-neg-custom-273538p42013.jpg
Stage outliers : Wall: 1.20 s, CPU: 0.87 s, VmPeak: 1021 MB, VmSize: 1021 MB, VmRSS: 262 MB, VmData: 291 MB, maxrss: 0.268216 MB
Stage outliers finished: 2020-08-07T10:14:55.259148
Resources for stage outliers : 1.105 s worker CPU, 1.201 s worker Wall, Wall: 1.204 s, Cores in use: 1.64, Total efficiency (on 16 cores): 10.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T10:14:55.420600
Stage halos : Wall: 0.38 s, CPU: 0.32 s, VmPeak: 1021 MB, VmSize: 1021 MB, VmRSS: 262 MB, VmData: 291 MB, maxrss: 0.268216 MB
Stage halos finished: 2020-08-07T10:14:55.796695
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.378 s, Cores in use: 0.86, Total efficiency (on 16 cores): 5.4 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-08-07T10:14:55.821281
PSF sigmas in coadd pixels: ['1.96', '2.85', '2.49']
Using average PSF sigma 2.435216632815056
Gaussian PSF norm 0.11583971133105432 vs pixelized 0.10188744
average tim pixel scale / coadd scale: 1.7288151838752717
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.63', '2.48', '1.85']
Using average PSF sigma 2.3184292358456657
Gaussian PSF norm 0.12167496312259961 vs pixelized 0.0934471
average tim pixel scale / coadd scale: 1.7296015871475443
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.48', '1.51', '1.27']
Using average PSF sigma 1.421014922482317
Gaussian PSF norm 0.1985164176046072 vs pixelized 0.16405909
average tim pixel scale / coadd scale: 0.9909164776335975
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.22 s, VmPeak: 1021 MB, VmSize: 1021 MB, VmRSS: 263 MB, VmData: 291 MB, maxrss: 0.269716 MB
Stage fit_on_coadds finished: 2020-08-07T10:14:56.064073
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.256 s worker CPU, 0.257 s worker Wall, Wall: 0.244 s, Cores in use: 1.96, Total efficiency (on 16 cores): 12.2 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T10:14:56.076717
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 90 potential peaks
Of 90 potential peaks: 48 in veto map, 5 cut by saddle test, 0 cut by aper test, 37 kept
SED z : 37 new peaks
Found 132 potential peaks
Of 132 potential peaks: 126 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 132 potential peaks
Of 132 potential peaks: 119 in veto map, 9 cut by saddle test, 1 cut by aper test, 3 kept
SED g : 3 new peaks
Found 219 potential peaks
Of 219 potential peaks: 202 in veto map, 10 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 253 potential peaks
Of 253 potential peaks: 238 in veto map, 12 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 50 new sources
Median coadd sky for g : 0.00046399696
Median coadd sky for r : 0.0011404082
Median coadd sky for z : 5.149287e-05
Stage srcs : Wall: 0.98 s, CPU: 0.92 s, VmPeak: 1021 MB, VmSize: 1021 MB, VmRSS: 264 MB, VmData: 291 MB, maxrss: 0.270208 MB
Stage srcs finished: 2020-08-07T10:14:57.054044
Resources for stage srcs : 0.137 s worker CPU, 0.137 s worker Wall, Wall: 0.979 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T10:14:57.248045
Blob 1 of 22, id: 2, sources: 31, size: 303x348, npix 56624, brick X: 9,312, Y: 0,348, one pixel: 179 0
Blob 2 of 22, id: 0, sources: 5, size: 45x41, npix 1444, brick X: 0,45, Y: 0,41, one pixel: 0 0
Blob 3 of 22, id: 19, sources: 4, size: 69x33, npix 1317, brick X: 178,247, Y: 328,361, one pixel: 236 328
Blob 4 of 22, id: 20, sources: 1, size: 45x30, npix 991, brick X: 54,99, Y: 331,361, one pixel: 74 331
Blob 5 of 22, id: 5, sources: 2, size: 28x37, npix 642, brick X: 0,28, Y: 89,126, one pixel: 13 89
Blob 6 of 22, id: 15, sources: 1, size: 30x32, npix 621, brick X: 331,361, Y: 295,327, one pixel: 346 295
Blob 7 of 22, id: 8, sources: 1, size: 30x30, npix 610, brick X: 331,361, Y: 142,172, one pixel: 342 142
Blob 8 of 22, id: 9, sources: 1, size: 30x30, npix 604, brick X: 303,333, Y: 165,195, one pixel: 316 165
Blob 9 of 22, id: 11, sources: 1, size: 22x38, npix 603, brick X: 0,22, Y: 236,274, one pixel: 5 236
Blob 10 of 22, id: 6, sources: 1, size: 30x30, npix 589, brick X: 321,351, Y: 89,119, one pixel: 335 89
Blob 11 of 22, id: 17, sources: 1, size: 29x29, npix 557, brick X: 302,331, Y: 310,339, one pixel: 315 310
Blob 12 of 22, id: 1, sources: 1, size: 40x19, npix 553, brick X: 115,155, Y: 0,19, one pixel: 120 0
Blob 13 of 22, id: 3, sources: 2, size: 25x38, npix 528, brick X: 289,314, Y: 9,47, one pixel: 301 9
Blob 14 of 22, id: 12, sources: 2, size: 28x34, npix 489, brick X: 49,77, Y: 244,278, one pixel: 58 244
Blob 15 of 22, id: 14, sources: 1, size: 27x25, npix 437, brick X: 16,43, Y: 287,312, one pixel: 27 287
Blob 16 of 22, id: 7, sources: 1, size: 27x28, npix 428, brick X: 296,323, Y: 128,156, one pixel: 304 128
Blob 17 of 22, id: 10, sources: 1, size: 23x27, npix 427, brick X: 338,361, Y: 208,235, one pixel: 351 208
Blob 4 finished, total: Wall: 0.18 s, CPU: 0.17 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147216 MB
Blob 14 finished, total: Wall: 0.15 s, CPU: 0.14 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147588 MB
Blob 18 of 22, id: 21, sources: 1, size: 28x18, npix 366, brick X: 321,349, Y: 343,361, one pixel: 330 343
Blob 19 of 22, id: 16, sources: 1, size: 23x24, npix 359, brick X: 182,205, Y: 309,333, one pixel: 191 309
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.57628, 41.98688), pm (-6.5, -2.5), parallax 0.749 with NanoMaggies: g=12.1, r=11.3, z=10.9
Reset brightness to NanoMaggies: g=12.1, r=11.3, z=10.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.59416, 41.99427), pm (8.2, 3.3), parallax 1.735 with NanoMaggies: g=12.3, r=11.8, z=11.7
Reset brightness to NanoMaggies: g=12.3, r=11.8, z=11.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.57144, 41.99843), pm (5.7, -10.1), parallax 0.968 with NanoMaggies: g=13.7, r=13.4, z=13.3
Reset brightness to NanoMaggies: g=13.7, r=13.4, z=13.3
Measuring 2 iterative sources
Blob 13 finished, total: Wall: 0.48 s, CPU: 0.47 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147972 MB
Blob 20 of 22, id: 4, sources: 1, size: 22x23, npix 315, brick X: 24,46, Y: 64,87, one pixel: 33 64
Blob 21 of 22, id: 13, sources: 1, size: 20x22, npix 269, brick X: 22,42, Y: 260,282, one pixel: 31 260
Blob 8 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147624 MB
Blob 22 of 22, id: 18, sources: 1, size: 20x19, npix 218, brick X: 89,109, Y: 317,336, one pixel: 98 317
Blob 16 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148188 MB
Blob 19 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147972 MB
Blob 21 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148188 MB
Blob 22 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14842 MB
Blob 11 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148224 MB
Blob 20 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147624 MB
Blob 10 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147832 MB
Blob 9 finished, total: Wall: 0.92 s, CPU: 0.86 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147372 MB
Blob 17 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147216 MB
Blob 15 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097508 MB
Blob 7 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.09498 MB
Blob 6 finished, total: Wall: 1.04 s, CPU: 0.97 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.098032 MB
Blob 5 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.096796 MB
Blob 18 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148456 MB
Blob 12 finished, total: Wall: 1.65 s, CPU: 1.65 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095672 MB
Blob 3 finished, total: Wall: 1.75 s, CPU: 1.75 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097308 MB
Blob 2 finished, total: Wall: 1.97 s, CPU: 1.97 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 96 MB, VmData: 140 MB, maxrss: 0.09812 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.892569, ee1=0.0235662, ee2=-0.0476302
Measuring 12 iterative sources
Blob 1 finished, total: Wall: 36.52 s, CPU: 36.52 s, VmPeak: 811 MB, VmSize: 734 MB, VmRSS: 159 MB, VmData: 189 MB, maxrss: 0.201912 MB
Old catalog: 69
New catalog: 65
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/metrics/cus/blobs-custom-273538p42013.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/metrics/cus/all-models-custom-273538p42013.fits
Stage fitblobs : Wall: 38.74 s, CPU: 0.50 s, VmPeak: 1021 MB, VmSize: 1021 MB, VmRSS: 265 MB, VmData: 291 MB, maxrss: 0.271296 MB
Stage fitblobs finished: 2020-08-07T10:15:35.989227
Resources for stage fitblobs : 53.775 s worker CPU, 53.988 s worker Wall, Wall: 38.743 s, Cores in use: 1.40, Total efficiency (on 16 cores): 8.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T10:15:36.046088
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/tmp-legacysurvey-custom-273538p42013-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/tmp-legacysurvey-custom-273538p42013-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/tmp-legacysurvey-custom-273538p42013-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/tmp-legacysurvey-custom-273538p42013-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-resid.jpg
Stage coadds : Wall: 9.92 s, CPU: 0.75 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 266 MB, VmData: 293 MB, maxrss: 0.2725 MB
Stage coadds finished: 2020-08-07T10:15:45.969690
Resources for stage coadds : 10.201 s worker CPU, 10.789 s worker Wall, Wall: 9.925 s, Cores in use: 1.10, Total efficiency (on 16 cores): 6.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T10:15:46.066778
Cut to 1 unWISE tiles
Reading WISE tile 2730p424 band 1
Reading WISE tile 2730p424 band 2
Reading WISE tile 2730p424 band 3
Reading WISE tile 2730p424 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.16 s, CPU: 0.46 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 150 MB, VmData: 192 MB, maxrss: 0.190952 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.53 s, VmPeak: 1129 MB, VmSize: 1065 MB, VmRSS: 204 MB, VmData: 247 MB, maxrss: 0.209356 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.24 s, VmPeak: 1003 MB, VmSize: 1003 MB, VmRSS: 145 MB, VmData: 186 MB, maxrss: 0.20664 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.22 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 148 MB, VmData: 188 MB, maxrss: 0.210616 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/tmp-legacysurvey-custom-273538p42013-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/tmp-legacysurvey-custom-273538p42013-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.92 s, CPU: 0.67 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 267 MB, VmData: 293 MB, maxrss: 0.273016 MB
Stage wise_forced finished: 2020-08-07T10:15:47.984203
Resources for stage wise_forced : 4.581 s worker CPU, 3.964 s worker Wall, Wall: 1.919 s, Cores in use: 2.74, Total efficiency (on 16 cores): 17.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T10:15:48.003675
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/coadd/cus/custom-273538p42013/legacysurvey-custom-273538p42013-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/tractor-i/cus/tractor-custom-273538p42013.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/tractor/cus/tractor-custom-273538p42013.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/tractor/cus/brick-custom-273538p42013.sha256sum
Stage writecat : Wall: 0.88 s, CPU: 0.73 s, VmPeak: 1155 MB, VmSize: 1027 MB, VmRSS: 268 MB, VmData: 293 MB, maxrss: 0.4059 MB
Stage writecat finished: 2020-08-07T10:15:48.886416
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.884 s, Cores in use: 0.82, Total efficiency (on 16 cores): 5.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2190844/PGC2190844-largegalaxy-writecat.p
All done: 74.369 s worker CPU, 204.839 s worker Wall, Wall: 227.481 s, Cores in use: 0.38, Total efficiency (on 16 cores): 2.4 %
Finished galaxy PGC2190844 in 3.831 minutes.