Started working on galaxy PGC2045464 at Wed Aug 5 19:34:14 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.83928799999995 34.2014847 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:34:16.594456 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.83928799999995', '34.2014847', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.83928799999995 34.2014847 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 277.83928799999995 34.2014847 Starting process 9109 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 9110 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 9111 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 9112 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 9113 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 9114 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 9115 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 9116 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 9118 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 9119 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 9120 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 9121 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 9122 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 9124 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 9123 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 9126 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:34:17.640175 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_160417_120058_ooi_zd_ls9-CCD3 z expnum 82869 exptime 80.103 propid 2016A-0453 seeing 1.19 MJD 57495.501 object MzLS_575295_z mosaic/CP/V4.3/CP20160416/k4m_160417_120058_ooi_zd_ls9.fits.fz k4m_170929_040652_ooi_zd_ls9-CCD4 z expnum 141283 exptime 135.103 propid 2016A-0453 seeing 0.90 MJD 58025.171 object MzLS_573220_z mosaic/CP/V4.3/CP20170928/k4m_170929_040652_ooi_zd_ls9.fits.fz k4m_160416_120722_ooi_zd_ls9-CCD2 z expnum 82616 exptime 171.102 propid 2016A-0453 seeing 2.06 MJD 57494.505 object MzLS_574259_z mosaic/CP/V4.3/CP20160415/k4m_160416_120722_ooi_zd_ls9.fits.fz ksb_160602_085337_ooi_g_ls9-CCD2 g expnum 75410139 exptime 126.7 propid BASS seeing 1.22 MJD 57541.371 object 60732 90prime/CP/V2.3/CP20160601/ksb_160602_085337_ooi_g_ls9.fits.fz ksb_160510_110400_ooi_r_ls9-CCD2 r expnum 75180256 exptime 63.5 propid BASS seeing 1.24 MJD 57518.461 object 60732 90prime/CP/V2.3/CP20160509/ksb_160510_110400_ooi_r_ls9.fits.fz ksb_160504_110120_ooi_g_ls9-CCD3 g expnum 75120212 exptime 126.5 propid BASS seeing 1.53 MJD 57512.459 object 60741 90prime/CP/V2.3/CP20160503/ksb_160504_110120_ooi_g_ls9.fits.fz ksb_160531_090048_ooi_r_ls9-CCD3 r expnum 75390183 exptime 64.599 propid BASS seeing 1.10 MJD 57539.376 object 60741 90prime/CP/V2.3/CP20160530/ksb_160531_090048_ooi_r_ls9.fits.fz ksb_160504_105239_ooi_g_ls9-CCD1 g expnum 75120209 exptime 107.6 propid BASS seeing 1.67 MJD 57512.453 object 60731 90prime/CP/V2.3/CP20160503/ksb_160504_105239_ooi_g_ls9.fits.fz ksb_160430_105803_ooi_r_ls9-CCD1 r expnum 75080190 exptime 105.6 propid BASS seeing 1.15 MJD 57508.457 object 60731 90prime/CP/V2.3/CP20160429/ksb_160430_105803_ooi_r_ls9.fits.fz ksb_180518_074742_ooi_r_ls9-CCD3 r expnum 82560142 exptime 134.753 propid NOTBASS seeing 1.61 MJD 58256.325 object 60743 90prime/CP/V2.3/CP20180517/ksb_180518_074742_ooi_r_ls9.fits.fz ksb_160628_065706_ooi_g_ls9-CCD3 g expnum 75670098 exptime 109.6 propid BASS seeing 1.56 MJD 57567.290 object 60743 90prime/CP/V2.3/CP20160627/ksb_160628_065706_ooi_g_ls9.fits.fz Faked up EXPNUM 75120209 Faked up EXPNUM 75120209 Faked up EXPNUM 75120209 90prime get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2397 2541 and amp range 2016 4031 and image y 509 653 and amp range 0 2047 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp -0.0032519526 -> scaling image by 0.9970093219958882 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75180256 Faked up EXPNUM 75180256 Faked up EXPNUM 75180256 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 218 361 and amp range 0 2015 and image y 2507 2650 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.016961161 -> scaling image by 1.0157444649385616 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3458 3713 and amp range 2048 4095 and image y 1692 1941 and amp range 0 2021 Range in image: x 0 256 , y 0 250 (with image size 256 x 250) dzp -0.029506588 -> scaling image by 0.9731893881648719 Faked up EXPNUM 75080190 Faked up EXPNUM 75080190 Faked up EXPNUM 75080190 90prime get_fwhm: self.fwhm = 2.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2399 2543 and amp range 2016 4031 and image y 512 656 and amp range 0 2047 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp -0.0041296566 -> scaling image by 0.9962036700684744 mosaic get_fwhm: self.fwhm = 4.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2342 2590 and amp range 2006 4053 and image y 3211 3464 and amp range 2040 4078 Range in image: x 0 249 , y 0 254 (with image size 249 x 254) dzp -0.0026360443 -> scaling image by 0.99757505842151 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75410139 Faked up EXPNUM 75410139 Faked up EXPNUM 75410139 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 221 364 and amp range 0 2015 and image y 2492 2635 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75670098 Faked up EXPNUM 75670098 Faked up EXPNUM 75670098 90prime get_fwhm: self.fwhm = 3.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 451 594 and amp range 0 2015 and image y 2098 2242 and amp range 2048 4095 Range in image: x 0 144 , y 0 145 (with image size 144 x 145) dzp -0.0045482004 -> scaling image by 0.9958197144381092 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 7.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 742 989 and amp range 0 2047 and image y 3710 3956 and amp range 2040 4078 Range in image: x 0 248 , y 0 247 (with image size 248 x 247) dzp 0.008550294 -> scaling image by 1.0079062018164673 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82560142 Faked up EXPNUM 82560142 Faked up EXPNUM 82560142 90prime get_fwhm: self.fwhm = 3.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 466 609 and amp range 0 2015 and image y 2099 2242 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp -0.038361903 -> scaling image by 0.9652842912941227 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 18.96 s, CPU: 1.56 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 174 MB, VmData: 206 MB, maxrss: 0.17848 MB Stage tims finished: 2020-08-05T19:34:36.597277 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Faked up EXPNUM 75120212 Faked up EXPNUM 75120212 Faked up EXPNUM 75120212 Faked up EXPNUM 75390183 Faked up EXPNUM 75390183 Faked up EXPNUM 75390183 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.701 s worker CPU, 52.192 s worker Wall, Wall: 18.959 s, Cores in use: 0.44, Total efficiency (on 16 cores): 2.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:34:37.572764 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02850.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02723.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02594.fits Matched 12 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/reference-custom-277839p34201.fits Stage refs : Wall: 15.37 s, CPU: 9.57 s, VmPeak: 1073 MB, VmSize: 1067 MB, VmRSS: 287 MB, VmData: 316 MB, maxrss: 0.294104 MB Stage refs finished: 2020-08-05T19:34:52.947121 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 15.376 s, Cores in use: 0.62, Total efficiency (on 16 cores): 3.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:34:53.029782 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outlier-mask-custom-277839p34201.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outliers-pre-custom-277839p34201.jpg Image ksb_160602_085337_ooi_g_ls9-CCD2 g : masking 90 positive outlier pixels and 0 negative outlier pixels Image ksb_160430_105803_ooi_r_ls9-CCD1 r : masking 86 positive outlier pixels and 0 negative outlier pixels Image ksb_180518_074742_ooi_r_ls9-CCD3 r : masking 475 positive outlier pixels and 0 negative outlier pixels Image k4m_160416_120722_ooi_zd_ls9-CCD2 z : masking 1532 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outlier-mask-custom-277839p34201.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outliers-post-custom-277839p34201.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outliers-masked-pos-custom-277839p34201.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outliers-masked-neg-custom-277839p34201.jpg Stage outliers : Wall: 1.23 s, CPU: 0.95 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 300 MB, VmData: 327 MB, maxrss: 0.306952 MB Stage outliers finished: 2020-08-05T19:34:54.256556 Resources for stage outliers : 0.732 s worker CPU, 0.806 s worker Wall, Wall: 1.228 s, Cores in use: 1.37, Total efficiency (on 16 cores): 8.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:34:54.397833 Stage halos : Wall: 0.46 s, CPU: 0.45 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 300 MB, VmData: 327 MB, maxrss: 0.307188 MB Stage halos finished: 2020-08-05T19:34:54.859226 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.463 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T19:34:54.942954 PSF sigmas in coadd pixels: ['1.98', '2.72', '2.54'] Using average PSF sigma 2.4108259099108 Gaussian PSF norm 0.11701168077470828 vs pixelized 0.09863373 average tim pixel scale / coadd scale: 1.729054923901576 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.01', '1.86', '2.61'] Using average PSF sigma 2.1618886582381127 Gaussian PSF norm 0.13048534701309672 vs pixelized 0.110374846 average tim pixel scale / coadd scale: 1.729947767213328 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.93', '1.46', '3.34'] Using average PSF sigma 2.2447830545046252 Gaussian PSF norm 0.1256668394782276 vs pixelized 0.10665072 average tim pixel scale / coadd scale: 0.990941371406137 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.16 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 302 MB, VmData: 327 MB, maxrss: 0.309296 MB Stage fit_on_coadds finished: 2020-08-05T19:34:55.110219 Resources for stage fit_on_coadds : 0.168 s worker CPU, 0.168 s worker Wall, Wall: 0.169 s, Cores in use: 1.92, Total efficiency (on 16 cores): 12.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:34:55.122559 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 10 in veto map, 3 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 32 potential peaks Of 32 potential peaks: 29 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 24 potential peaks Of 24 potential peaks: 21 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 42 potential peaks Of 42 potential peaks: 34 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 41 potential peaks Of 41 potential peaks: 37 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 24 new sources Median coadd sky for g : 0.0001224051 Median coadd sky for r : 0.00058739097 Median coadd sky for z : -0.00049269793 Stage srcs : Wall: 0.52 s, CPU: 0.49 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 303 MB, VmData: 327 MB, maxrss: 0.310008 MB Stage srcs finished: 2020-08-05T19:34:55.640906 Resources for stage srcs : 0.073 s worker CPU, 0.073 s worker Wall, Wall: 0.520 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:34:55.653655 Blob 1 of 9, id: 1, sources: 20, size: 211x221, npix 24984, brick X: 34,245, Y: 0,221, one pixel: 183 0 Blob 2 of 9, id: 3, sources: 5, size: 65x91, npix 3198, brick X: 0,65, Y: 23,114, one pixel: 8 23 Blob 3 of 9, id: 0, sources: 2, size: 77x66, npix 2452, brick X: 41,118, Y: 0,66, one pixel: 78 0 Blob 4 of 9, id: 5, sources: 4, size: 56x38, npix 1374, brick X: 151,207, Y: 207,245, one pixel: 185 207 Blob 5 of 9, id: 4, sources: 3, size: 43x34, npix 751, brick X: 17,60, Y: 191,225, one pixel: 51 191 Blob 6 of 9, id: 2, sources: 2, size: 47x28, npix 747, brick X: 94,141, Y: 1,29, one pixel: 122 1 Blob 7 of 9, id: 7, sources: 1, size: 24x24, npix 365, brick X: 3,27, Y: 221,245, one pixel: 13 221 Blob 8 of 9, id: 6, sources: 1, size: 22x21, npix 281, brick X: 60,82, Y: 217,238, one pixel: 69 217 Blob 9 of 9, id: 8, sources: 1, size: 21x16, npix 215, brick X: 45,66, Y: 229,245, one pixel: 55 229 Blob 8 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 814 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149172 MB Blob 9 finished, total: Wall: 0.18 s, CPU: 0.17 s, VmPeak: 817 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150108 MB Blob 7 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 815 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150172 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.52 s, CPU: 0.51 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092568 MB Blob 3 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.094836 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.83542, 34.21446), pm (-5.0, -9.0), parallax 0.924 with NanoMaggies: g=14.7, r=14.2, z=14.1 Reset brightness to NanoMaggies: g=14.7, r=14.2, z=14.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.83554, 34.21242), pm (-5.0, 0.7), parallax 0.535 with NanoMaggies: g=16.7, r=16.2, z=(flux -1.66e+03) Reset brightness to NanoMaggies: g=16.7, r=16.2, z=16 Blob 4 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093376 MB Blob 5 finished, total: Wall: 1.05 s, CPU: 1.04 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093432 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.85289, 34.19845), pm (-1.0, -7.6), parallax 0.574 with NanoMaggies: g=19.9, r=19, z=18.6 Reset brightness to NanoMaggies: g=19.9, r=19, z=18.6 Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.16 s, CPU: 2.16 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151068 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.82717, 34.19928), pm (-5.8, -9.8), parallax 1.858 with NanoMaggies: g=15.1, r=(flux -1.05e+05), z=14.6 Reset brightness to NanoMaggies: g=14.7, r=14.1, z=13.8 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.70809, ee1=-0.0611125, ee2=0.0749085 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.82533, 34.20011), pm (-4.4, -8.0), parallax 0.164 with NanoMaggies: g=18.4, r=17.9, z=17.8 Reset brightness to NanoMaggies: g=18.4, r=17.9, z=17.8 Measuring 3 iterative sources Blob 1 finished, total: Wall: 13.32 s, CPU: 13.31 s, VmPeak: 705 MB, VmSize: 689 MB, VmRSS: 121 MB, VmData: 160 MB, maxrss: 0.140492 MB Old catalog: 48 New catalog: 40 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/blobs-custom-277839p34201.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/all-models-custom-277839p34201.fits Stage fitblobs : Wall: 13.73 s, CPU: 0.36 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 303 MB, VmData: 328 MB, maxrss: 0.310708 MB Stage fitblobs finished: 2020-08-05T19:35:09.379693 Resources for stage fitblobs : 19.107 s worker CPU, 19.167 s worker Wall, Wall: 13.727 s, Cores in use: 1.42, Total efficiency (on 16 cores): 8.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:35:09.449791 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-resid.jpg Stage coadds : Wall: 3.95 s, CPU: 1.57 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 304 MB, VmData: 328 MB, maxrss: 0.311032 MB Stage coadds finished: 2020-08-05T19:35:13.395872 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.818 s worker CPU, 16.241 s worker Wall, Wall: 3.948 s, Cores in use: 2.63, Total efficiency (on 16 cores): 16.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:35:13.423806 Cut to 1 unWISE tiles Reading WISE tile 2777p348 band 1 Reading WISE tile 2777p348 band 2 Reading WISE tile 2777p348 band 3 Reading WISE tile 2777p348 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 814 MB, VmSize: 799 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.202176 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 809 MB, VmSize: 809 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.196252 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 807 MB, VmSize: 804 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.206772 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 863 MB, VmSize: 863 MB, VmRSS: 202 MB, VmData: 235 MB, maxrss: 0.207184 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.50 s, CPU: 2.50 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 304 MB, VmData: 328 MB, maxrss: 0.311544 MB Stage wise_forced finished: 2020-08-05T19:35:18.927956 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.050 s worker CPU, 7.786 s worker Wall, Wall: 5.506 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:35:18.948345 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/tractor-i/cus/tractor-custom-277839p34201.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/tractor/cus/tractor-custom-277839p34201.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/tractor/cus/brick-custom-277839p34201.sha256sum Stage writecat : Wall: 1.40 s, CPU: 1.05 s, VmPeak: 1209 MB, VmSize: 1081 MB, VmRSS: 306 MB, VmData: 328 MB, maxrss: 0.444424 MB Stage writecat finished: 2020-08-05T19:35:20.352260 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.406 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-writecat.p All done: 38.654 s worker CPU, 96.437 s worker Wall, Wall: 62.735 s, Cores in use: 0.92, Total efficiency (on 16 cores): 5.7 % Finished galaxy PGC2045464 in 1.106 minutes. Started working on galaxy PGC2045464 at Wed Aug 5 19:52:38 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.83928799999995 34.2014847 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:52:39.786744 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.83928799999995', '34.2014847', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.83928799999995 34.2014847 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 277.83928799999995 34.2014847 Starting process 13589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 13590 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 13591 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 13592 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 13593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 13594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 13595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 13596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 13597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 13598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 13599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 13600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 13605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 13606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 13607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 13608 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 13609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 13610 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 13611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 13612 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 13613 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 13615 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 13616 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 13617 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 13618 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 13619 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 13620 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 13621 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:52:40.355236 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_160417_120058_ooi_zd_ls9-CCD3 z expnum 82869 exptime 80.103 propid 2016A-0453 seeing 1.19 MJD 57495.501 object MzLS_575295_z mosaic/CP/V4.3/CP20160416/k4m_160417_120058_ooi_zd_ls9.fits.fz k4m_170929_040652_ooi_zd_ls9-CCD4 z expnum 141283 exptime 135.103 propid 2016A-0453 seeing 0.90 MJD 58025.171 object MzLS_573220_z mosaic/CP/V4.3/CP20170928/k4m_170929_040652_ooi_zd_ls9.fits.fz k4m_160416_120722_ooi_zd_ls9-CCD2 z expnum 82616 exptime 171.102 propid 2016A-0453 seeing 2.06 MJD 57494.505 object MzLS_574259_z mosaic/CP/V4.3/CP20160415/k4m_160416_120722_ooi_zd_ls9.fits.fz ksb_160602_085337_ooi_g_ls9-CCD2 g expnum 75410139 exptime 126.7 propid BASS seeing 1.22 MJD 57541.371 object 60732 90prime/CP/V2.3/CP20160601/ksb_160602_085337_ooi_g_ls9.fits.fz ksb_160510_110400_ooi_r_ls9-CCD2 r expnum 75180256 exptime 63.5 propid BASS seeing 1.24 MJD 57518.461 object 60732 90prime/CP/V2.3/CP20160509/ksb_160510_110400_ooi_r_ls9.fits.fz ksb_160504_110120_ooi_g_ls9-CCD3 g expnum 75120212 exptime 126.5 propid BASS seeing 1.53 MJD 57512.459 object 60741 90prime/CP/V2.3/CP20160503/ksb_160504_110120_ooi_g_ls9.fits.fz ksb_160531_090048_ooi_r_ls9-CCD3 r expnum 75390183 exptime 64.599 propid BASS seeing 1.10 MJD 57539.376 object 60741 90prime/CP/V2.3/CP20160530/ksb_160531_090048_ooi_r_ls9.fits.fz ksb_160504_105239_ooi_g_ls9-CCD1 g expnum 75120209 exptime 107.6 propid BASS seeing 1.67 MJD 57512.453 object 60731 90prime/CP/V2.3/CP20160503/ksb_160504_105239_ooi_g_ls9.fits.fz ksb_160430_105803_ooi_r_ls9-CCD1 r expnum 75080190 exptime 105.6 propid BASS seeing 1.15 MJD 57508.457 object 60731 90prime/CP/V2.3/CP20160429/ksb_160430_105803_ooi_r_ls9.fits.fz ksb_180518_074742_ooi_r_ls9-CCD3 r expnum 82560142 exptime 134.753 propid NOTBASS seeing 1.61 MJD 58256.325 object 60743 90prime/CP/V2.3/CP20180517/ksb_180518_074742_ooi_r_ls9.fits.fz ksb_160628_065706_ooi_g_ls9-CCD3 g expnum 75670098 exptime 109.6 propid BASS seeing 1.56 MJD 57567.290 object 60743 90prime/CP/V2.3/CP20160627/ksb_160628_065706_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 4.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2342 2590 and amp range 2006 4053 and image y 3211 3464 and amp range 2040 4078 Range in image: x 0 249 , y 0 254 (with image size 249 x 254) dzp -0.0026360443 -> scaling image by 0.99757505842151 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75080190 Faked up EXPNUM 75080190 Faked up EXPNUM 75080190 90prime get_fwhm: self.fwhm = 2.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2399 2543 and amp range 2016 4031 and image y 512 656 and amp range 0 2047 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp -0.0041296566 -> scaling image by 0.9962036700684744 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75410139 Faked up EXPNUM 75410139 Faked up EXPNUM 75410139 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 221 364 and amp range 0 2015 and image y 2492 2635 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.01693853 -> scaling image by 1.015723292931903 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3458 3713 and amp range 2048 4095 and image y 1692 1941 and amp range 0 2021 Range in image: x 0 256 , y 0 250 (with image size 256 x 250) dzp -0.029506588 -> scaling image by 0.9731893881648719 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75180256 Faked up EXPNUM 75180256 Faked up EXPNUM 75180256 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 218 361 and amp range 0 2015 and image y 2507 2650 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.016961161 -> scaling image by 1.0157444649385616 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75120209 Faked up EXPNUM 75120209 Faked up EXPNUM 75120209 90prime get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2397 2541 and amp range 2016 4031 and image y 509 653 and amp range 0 2047 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp -0.0032519526 -> scaling image by 0.9970093219958882 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75670098 Faked up EXPNUM 75670098 Faked up EXPNUM 75670098 90prime get_fwhm: self.fwhm = 3.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 451 594 and amp range 0 2015 and image y 2098 2242 and amp range 2048 4095 Range in image: x 0 144 , y 0 145 (with image size 144 x 145) dzp -0.0045482004 -> scaling image by 0.9958197144381092 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82560142 Faked up EXPNUM 82560142 Faked up EXPNUM 82560142 90prime get_fwhm: self.fwhm = 3.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 466 609 and amp range 0 2015 and image y 2099 2242 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp -0.038361903 -> scaling image by 0.9652842912941227 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 7.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 742 989 and amp range 0 2047 and image y 3710 3956 and amp range 2040 4078 Range in image: x 0 248 , y 0 247 (with image size 248 x 247) dzp 0.008550294 -> scaling image by 1.0079062018164673 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 21.96 s, CPU: 0.96 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.178724 MB Stage tims finished: 2020-08-05T19:53:02.313799 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Faked up EXPNUM 75390183 Faked up EXPNUM 75390183 Faked up EXPNUM 75390183 Faked up EXPNUM 75120212 Faked up EXPNUM 75120212 Faked up EXPNUM 75120212 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.234 s worker CPU, 73.377 s worker Wall, Wall: 21.961 s, Cores in use: 0.28, Total efficiency (on 32 cores): 0.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:53:02.428095 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02850.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02723.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02594.fits Matched 12 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/reference-custom-277839p34201.fits Stage refs : Wall: 27.67 s, CPU: 10.91 s, VmPeak: 1073 MB, VmSize: 1067 MB, VmRSS: 287 MB, VmData: 317 MB, maxrss: 0.294352 MB Stage refs finished: 2020-08-05T19:53:30.100173 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 27.674 s, Cores in use: 0.39, Total efficiency (on 32 cores): 1.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:53:30.229884 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outlier-mask-custom-277839p34201.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outliers-pre-custom-277839p34201.jpg Image ksb_160602_085337_ooi_g_ls9-CCD2 g : masking 90 positive outlier pixels and 0 negative outlier pixels Image ksb_160430_105803_ooi_r_ls9-CCD1 r : masking 86 positive outlier pixels and 0 negative outlier pixels Image ksb_180518_074742_ooi_r_ls9-CCD3 r : masking 475 positive outlier pixels and 0 negative outlier pixels Image k4m_160416_120722_ooi_zd_ls9-CCD2 z : masking 1532 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outlier-mask-custom-277839p34201.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outliers-post-custom-277839p34201.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outliers-masked-pos-custom-277839p34201.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/outliers-masked-neg-custom-277839p34201.jpg Stage outliers : Wall: 1.92 s, CPU: 1.37 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 300 MB, VmData: 327 MB, maxrss: 0.307672 MB Stage outliers finished: 2020-08-05T19:53:32.151860 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage outliers : 0.884 s worker CPU, 1.127 s worker Wall, Wall: 1.924 s, Cores in use: 1.17, Total efficiency (on 32 cores): 3.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:53:32.232205 Stage halos : Wall: 1.02 s, CPU: 0.96 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 301 MB, VmData: 328 MB, maxrss: 0.307904 MB Stage halos finished: 2020-08-05T19:53:33.251307 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.021 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T19:53:33.277955 PSF sigmas in coadd pixels: ['1.98', '2.72', '2.54'] Using average PSF sigma 2.4108259099108 Gaussian PSF norm 0.11701168077470828 vs pixelized 0.09863374 average tim pixel scale / coadd scale: 1.729054923901576 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.01', '1.86', '2.61'] Using average PSF sigma 2.1618886582381127 Gaussian PSF norm 0.13048534701309672 vs pixelized 0.110374846 average tim pixel scale / coadd scale: 1.729947767213328 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.93', '1.46', '3.34'] Using average PSF sigma 2.2447830545046252 Gaussian PSF norm 0.1256668394782276 vs pixelized 0.10665072 average tim pixel scale / coadd scale: 0.990941371406137 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.14 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 302 MB, VmData: 328 MB, maxrss: 0.309532 MB Stage fit_on_coadds finished: 2020-08-05T19:53:33.440431 Resources for stage fit_on_coadds : 0.161 s worker CPU, 0.161 s worker Wall, Wall: 0.165 s, Cores in use: 1.83, Total efficiency (on 32 cores): 5.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:53:33.457654 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 10 in veto map, 3 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 32 potential peaks Of 32 potential peaks: 29 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 24 potential peaks Of 24 potential peaks: 21 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 42 potential peaks Of 42 potential peaks: 34 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 41 potential peaks Of 41 potential peaks: 37 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 24 new sources Median coadd sky for g : 0.0001224051 Median coadd sky for r : 0.00058739097 Median coadd sky for z : -0.00049269793 Stage srcs : Wall: 1.11 s, CPU: 1.07 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 303 MB, VmData: 328 MB, maxrss: 0.310032 MB Stage srcs finished: 2020-08-05T19:53:34.566353 Resources for stage srcs : 0.085 s worker CPU, 0.086 s worker Wall, Wall: 1.111 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:53:34.585523 Blob 1 of 9, id: 1, sources: 20, size: 211x221, npix 24984, brick X: 34,245, Y: 0,221, one pixel: 183 0 Blob 2 of 9, id: 3, sources: 5, size: 65x91, npix 3198, brick X: 0,65, Y: 23,114, one pixel: 8 23 Blob 3 of 9, id: 0, sources: 2, size: 77x66, npix 2452, brick X: 41,118, Y: 0,66, one pixel: 78 0 Blob 4 of 9, id: 5, sources: 4, size: 56x38, npix 1374, brick X: 151,207, Y: 207,245, one pixel: 185 207 Blob 5 of 9, id: 4, sources: 3, size: 43x34, npix 751, brick X: 17,60, Y: 191,225, one pixel: 51 191 Blob 6 of 9, id: 2, sources: 2, size: 47x28, npix 747, brick X: 94,141, Y: 1,29, one pixel: 122 1 Blob 7 of 9, id: 7, sources: 1, size: 24x24, npix 365, brick X: 3,27, Y: 221,245, one pixel: 13 221 Blob 8 of 9, id: 6, sources: 1, size: 22x21, npix 281, brick X: 60,82, Y: 217,238, one pixel: 69 217 Blob 9 of 9, id: 8, sources: 1, size: 21x16, npix 215, brick X: 45,66, Y: 229,245, one pixel: 55 229 Blob 8 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094332 MB Blob 9 finished, total: Wall: 0.19 s, CPU: 0.18 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.095516 MB Blob 7 finished, total: Wall: 0.22 s, CPU: 0.21 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092356 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 0.44 s, CPU: 0.43 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.09386 MB Blob 6 finished, total: Wall: 0.53 s, CPU: 0.52 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092972 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.83542, 34.21446), pm (-5.0, -9.0), parallax 0.924 with NanoMaggies: g=14.7, r=14.2, z=14.1 Reset brightness to NanoMaggies: g=14.7, r=14.2, z=14.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.83554, 34.21242), pm (-5.0, 0.7), parallax 0.535 with NanoMaggies: g=16.7, r=16.2, z=(flux -1.66e+03) Reset brightness to NanoMaggies: g=16.7, r=16.2, z=16 Blob 4 finished, total: Wall: 0.96 s, CPU: 0.95 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093668 MB Blob 5 finished, total: Wall: 0.99 s, CPU: 0.98 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092792 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.85289, 34.19845), pm (-1.0, -7.6), parallax 0.574 with NanoMaggies: g=19.9, r=19, z=18.6 Reset brightness to NanoMaggies: g=19.9, r=19, z=18.6 Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.32 s, CPU: 2.31 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 95 MB, VmData: 142 MB, maxrss: 0.097696 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.82717, 34.19928), pm (-5.8, -9.8), parallax 1.858 with NanoMaggies: g=15.1, r=(flux -1.05e+05), z=14.6 Reset brightness to NanoMaggies: g=14.7, r=14.1, z=13.8 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.70809, ee1=-0.0611125, ee2=0.0749085 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.82533, 34.20011), pm (-4.4, -8.0), parallax 0.164 with NanoMaggies: g=18.4, r=17.9, z=17.8 Reset brightness to NanoMaggies: g=18.4, r=17.9, z=17.8 Measuring 3 iterative sources Blob 1 finished, total: Wall: 13.50 s, CPU: 13.50 s, VmPeak: 817 MB, VmSize: 743 MB, VmRSS: 166 MB, VmData: 195 MB, maxrss: 0.169532 MB Old catalog: 48 New catalog: 40 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/blobs-custom-277839p34201.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/metrics/cus/all-models-custom-277839p34201.fits Stage fitblobs : Wall: 15.12 s, CPU: 1.52 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 303 MB, VmData: 328 MB, maxrss: 0.310732 MB Stage fitblobs finished: 2020-08-05T19:53:49.700665 Resources for stage fitblobs : 19.392 s worker CPU, 19.630 s worker Wall, Wall: 15.117 s, Cores in use: 1.38, Total efficiency (on 32 cores): 4.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:53:49.723665 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-resid.jpg Stage coadds : Wall: 4.48 s, CPU: 1.83 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 304 MB, VmData: 328 MB, maxrss: 0.311056 MB Stage coadds finished: 2020-08-05T19:53:54.203761 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 25.740 s worker CPU, 48.372 s worker Wall, Wall: 4.482 s, Cores in use: 6.15, Total efficiency (on 32 cores): 19.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:53:54.221407 Cut to 1 unWISE tiles Reading WISE tile 2777p348 band 2 Reading WISE tile 2777p348 band 1 Reading WISE tile 2777p348 band 3 Reading WISE tile 2777p348 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 802 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.205476 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 815 MB, VmSize: 800 MB, VmRSS: 141 MB, VmData: 172 MB, maxrss: 0.203716 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.186572 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 808 MB, VmSize: 802 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.205508 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/tmp-legacysurvey-custom-277839p34201-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.11 s, CPU: 0.87 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 304 MB, VmData: 328 MB, maxrss: 0.311568 MB Stage wise_forced finished: 2020-08-05T19:53:57.332145 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.252 s worker CPU, 6.317 s worker Wall, Wall: 3.113 s, Cores in use: 1.32, Total efficiency (on 32 cores): 4.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:53:57.352969 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/coadd/cus/custom-277839p34201/legacysurvey-custom-277839p34201-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/tractor-i/cus/tractor-custom-277839p34201.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/tractor/cus/tractor-custom-277839p34201.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/tractor/cus/brick-custom-277839p34201.sha256sum Stage writecat : Wall: 1.16 s, CPU: 0.85 s, VmPeak: 1210 MB, VmSize: 1082 MB, VmRSS: 306 MB, VmData: 328 MB, maxrss: 0.444448 MB Stage writecat finished: 2020-08-05T19:53:58.514725 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.164 s, Cores in use: 0.74, Total efficiency (on 32 cores): 2.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2045464/PGC2045464-largegalaxy-writecat.p All done: 54.755 s worker CPU, 149.077 s worker Wall, Wall: 78.185 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 % Finished galaxy PGC2045464 in 1.339 minutes. Started working on galaxy PGC2045464 at Fri Aug 7 12:03:25 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.838934540186 34.20159817289879 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:03:26.512451 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.838934540186', '34.20159817289879', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.838934540186 34.20159817289879 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 277.838934540186 34.20159817289879 Starting process 16822 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 16823 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16824 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16825 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16826 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 16827 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16828 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16829 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16830 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16831 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16832 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16833 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16834 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16835 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16836 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16837 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16838 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 16839 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16840 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16842 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16844 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16845 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16846 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16847 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16848 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16849 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16850 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16852 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16853 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T12:03:26.920696 Keeping 11 CCDs: k4m_160417_120058_ooi_zd_ls9-CCD3 z expnum 82869 exptime 80.103 propid 2016A-0453 seeing 1.19 MJD 57495.501 object MzLS_575295_z mosaic/CP/V4.3/CP20160416/k4m_160417_120058_ooi_zd_ls9.fits.fz k4m_170929_040652_ooi_zd_ls9-CCD4 z expnum 141283 exptime 135.103 propid 2016A-0453 seeing 0.90 MJD 58025.171 object MzLS_573220_z mosaic/CP/V4.3/CP20170928/k4m_170929_040652_ooi_zd_ls9.fits.fz k4m_160416_120722_ooi_zd_ls9-CCD2 z expnum 82616 exptime 171.102 propid 2016A-0453 seeing 2.06 MJD 57494.505 object MzLS_574259_z mosaic/CP/V4.3/CP20160415/k4m_160416_120722_ooi_zd_ls9.fits.fz ksb_160602_085337_ooi_g_ls9-CCD2 g expnum 75410139 exptime 126.7 propid BASS seeing 1.22 MJD 57541.371 object 60732 90prime/CP/V2.3/CP20160601/ksb_160602_085337_ooi_g_ls9.fits.fz ksb_160510_110400_ooi_r_ls9-CCD2 r expnum 75180256 exptime 63.5 propid BASS seeing 1.24 MJD 57518.461 object 60732 90prime/CP/V2.3/CP20160509/ksb_160510_110400_ooi_r_ls9.fits.fz ksb_160504_110120_ooi_g_ls9-CCD3 g expnum 75120212 exptime 126.5 propid BASS seeing 1.53 MJD 57512.459 object 60741 90prime/CP/V2.3/CP20160503/ksb_160504_110120_ooi_g_ls9.fits.fz ksb_160531_090048_ooi_r_ls9-CCD3 r expnum 75390183 exptime 64.599 propid BASS seeing 1.10 MJD 57539.376 object 60741 90prime/CP/V2.3/CP20160530/ksb_160531_090048_ooi_r_ls9.fits.fz ksb_160504_105239_ooi_g_ls9-CCD1 g expnum 75120209 exptime 107.6 propid BASS seeing 1.67 MJD 57512.453 object 60731 90prime/CP/V2.3/CP20160503/ksb_160504_105239_ooi_g_ls9.fits.fz ksb_160430_105803_ooi_r_ls9-CCD1 r expnum 75080190 exptime 105.6 propid BASS seeing 1.15 MJD 57508.457 object 60731 90prime/CP/V2.3/CP20160429/ksb_160430_105803_ooi_r_ls9.fits.fz ksb_180518_074742_ooi_r_ls9-CCD3 r expnum 82560142 exptime 134.753 propid NOTBASS seeing 1.61 MJD 58256.325 object 60743 90prime/CP/V2.3/CP20180517/ksb_180518_074742_ooi_r_ls9.fits.fz ksb_160628_065706_ooi_g_ls9-CCD3 g expnum 75670098 exptime 109.6 propid BASS seeing 1.56 MJD 57567.290 object 60743 90prime/CP/V2.3/CP20160627/ksb_160628_065706_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 4.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2343 2591 and amp range 2006 4053 and image y 3206 3460 and amp range 2040 4078 Range in image: x 0 249 , y 0 255 (with image size 249 x 255) dzp -0.0026360443 -> scaling image by 0.99757505842151 Faked up EXPNUM 75080190 Faked up EXPNUM 75080190 Faked up EXPNUM 75080190 90prime get_fwhm: self.fwhm = 2.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2398 2542 and amp range 2016 4031 and image y 514 659 and amp range 0 2047 Range in image: x 0 145 , y 0 146 (with image size 145 x 146) dzp -0.0041296566 -> scaling image by 0.9962036700684744 Faked up EXPNUM 82560142 Faked up EXPNUM 82560142 Faked up EXPNUM 82560142 90prime get_fwhm: self.fwhm = 3.55 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 75670098 Faked up EXPNUM 75670098 Faked up EXPNUM 75670098 90prime get_fwhm: self.fwhm = 3.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 465 608 and amp range 0 2015 and image y 2101 2245 and amp range 2048 4095 Range in image: x 0 144 , y 0 145 (with image size 144 x 145) dzp -0.038361903 -> scaling image by 0.9652842912941227 Found overlap: image x 450 593 and amp range 0 2015 and image y 2101 2244 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp -0.0045482004 -> scaling image by 0.9958197144381092 mosaic get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3460 3715 and amp range 2048 4095 and image y 1688 1937 and amp range 0 2021 Range in image: x 0 256 , y 0 250 (with image size 256 x 250) dzp -0.029506588 -> scaling image by 0.9731893881648719 Faked up EXPNUM 75410139 Faked up EXPNUM 75410139 Faked up EXPNUM 75410139 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 220 363 and amp range 0 2015 and image y 2495 2638 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75180256 Faked up EXPNUM 75180256 Faked up EXPNUM 75180256 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 217 360 and amp range 0 2015 and image y 2509 2652 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.016961161 -> scaling image by 1.0157444649385616 Faked up EXPNUM 75120209 Faked up EXPNUM 75120209 Faked up EXPNUM 75120209 90prime get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2396 2540 and amp range 2016 4031 and image y 511 656 and amp range 0 2047 Range in image: x 0 145 , y 0 146 (with image size 145 x 146) dzp -0.0032519526 -> scaling image by 0.9970093219958882 mosaic get_fwhm: self.fwhm = 7.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 744 990 and amp range 0 2047 and image y 3706 3952 and amp range 2040 4078 Range in image: x 0 247 , y 0 247 (with image size 247 x 247) dzp 0.008550294 -> scaling image by 1.0079062018164673 Stage tims : Wall: 2.35 s, CPU: 0.90 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.176556 MB Stage tims finished: 2020-08-07T12:03:29.269363 Faked up EXPNUM 75120212 Faked up EXPNUM 75120212 Faked up EXPNUM 75120212 Resources for stage tims : 5.003 s worker CPU, 11.352 s worker Wall, Wall: 2.351 s, Cores in use: 2.51, Total efficiency (on 32 cores): 7.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-tims.p Running stage refs Faked up EXPNUM 75390183 Faked up EXPNUM 75390183 Faked up EXPNUM 75390183 Running stage refs at 2020-08-07T12:03:32.860252 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02850.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02723.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02594.fits Matched 12 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/metrics/cus/reference-custom-277838p34201.fits Stage refs : Wall: 9.29 s, CPU: 9.01 s, VmPeak: 1066 MB, VmSize: 1061 MB, VmRSS: 286 MB, VmData: 316 MB, maxrss: 0.29284 MB Stage refs finished: 2020-08-07T12:03:42.151155 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 9.293 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:03:42.186157 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/metrics/cus/outlier-mask-custom-277838p34201.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/metrics/cus/outliers-pre-custom-277838p34201.jpg Image ksb_160602_085337_ooi_g_ls9-CCD2 g : masking 93 positive outlier pixels and 0 negative outlier pixels Image ksb_180518_074742_ooi_r_ls9-CCD3 r : masking 545 positive outlier pixels and 0 negative outlier pixels Image ksb_160430_105803_ooi_r_ls9-CCD1 r : masking 86 positive outlier pixels and 0 negative outlier pixels Image k4m_160416_120722_ooi_zd_ls9-CCD2 z : masking 1965 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/metrics/cus/outlier-mask-custom-277838p34201.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/metrics/cus/outliers-post-custom-277838p34201.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/metrics/cus/outliers-masked-pos-custom-277838p34201.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/metrics/cus/outliers-masked-neg-custom-277838p34201.jpg Stage outliers : Wall: 0.93 s, CPU: 0.58 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 299 MB, VmData: 327 MB, maxrss: 0.305848 MB Stage outliers finished: 2020-08-07T12:03:43.112365 Resources for stage outliers : 0.827 s worker CPU, 1.042 s worker Wall, Wall: 0.928 s, Cores in use: 1.52, Total efficiency (on 32 cores): 4.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:03:43.133659 Stage halos : Wall: 0.21 s, CPU: 0.20 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 299 MB, VmData: 327 MB, maxrss: 0.306164 MB Stage halos finished: 2020-08-07T12:03:43.346518 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.215 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:03:43.424675 PSF sigmas in coadd pixels: ['1.98', '2.72', '2.54'] Using average PSF sigma 2.4108259099108 Gaussian PSF norm 0.11701168077470828 vs pixelized 0.0986335 average tim pixel scale / coadd scale: 1.729054923901576 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.01', '1.86', '2.61'] Using average PSF sigma 2.1618886582381127 Gaussian PSF norm 0.13048534701309672 vs pixelized 0.11037307 average tim pixel scale / coadd scale: 1.729947767213328 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.93', '1.46', '3.34'] Using average PSF sigma 2.2447830545046252 Gaussian PSF norm 0.1256668394782276 vs pixelized 0.10665177 average tim pixel scale / coadd scale: 0.990941371406137 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.13 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 300 MB, VmData: 327 MB, maxrss: 0.307664 MB Stage fit_on_coadds finished: 2020-08-07T12:03:43.585429 Resources for stage fit_on_coadds : 0.159 s worker CPU, 0.159 s worker Wall, Wall: 0.163 s, Cores in use: 1.80, Total efficiency (on 32 cores): 5.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:03:43.597233 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 36 potential peaks Of 36 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 22 kept SED z : 22 new peaks Found 32 potential peaks Of 32 potential peaks: 27 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 25 potential peaks Of 25 potential peaks: 20 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 45 potential peaks Of 45 potential peaks: 37 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 42 potential peaks Of 42 potential peaks: 38 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 24 new sources Median coadd sky for g : 0.000106746076 Median coadd sky for r : 0.00053186825 Median coadd sky for z : -0.0005833131 Stage srcs : Wall: 0.52 s, CPU: 0.49 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 301 MB, VmData: 327 MB, maxrss: 0.308152 MB Stage srcs finished: 2020-08-07T12:03:44.118122 Resources for stage srcs : 0.080 s worker CPU, 0.080 s worker Wall, Wall: 0.523 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:03:44.131957 Blob 1 of 9, id: 2, sources: 20, size: 215x219, npix 25652, brick X: 30,245, Y: 0,219, one pixel: 178 0 Blob 2 of 9, id: 3, sources: 5, size: 61x91, npix 2864, brick X: 0,61, Y: 22,113, one pixel: 5 22 Blob 3 of 9, id: 0, sources: 2, size: 77x65, npix 2441, brick X: 37,114, Y: 0,65, one pixel: 73 0 Blob 4 of 9, id: 5, sources: 4, size: 56x39, npix 1400, brick X: 147,203, Y: 206,245, one pixel: 178 206 Blob 5 of 9, id: 4, sources: 3, size: 43x35, npix 771, brick X: 13,56, Y: 189,224, one pixel: 47 189 Blob 6 of 9, id: 1, sources: 2, size: 47x27, npix 749, brick X: 90,137, Y: 0,27, one pixel: 117 0 Blob 7 of 9, id: 7, sources: 1, size: 23x24, npix 352, brick X: 0,23, Y: 219,243, one pixel: 9 219 Blob 8 of 9, id: 6, sources: 1, size: 22x22, npix 292, brick X: 56,78, Y: 215,237, one pixel: 65 215 Blob 9 of 9, id: 8, sources: 1, size: 23x17, npix 259, brick X: 40,63, Y: 228,245, one pixel: 49 228 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.83554, 34.21242), pm (-5.0, 0.7), parallax 0.535 with NanoMaggies: g=13.9, r=12.2, z=(flux -20.6) Reset brightness to NanoMaggies: g=16.7, r=16.2, z=16 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.83542, 34.21446), pm (-5.0, -9.0), parallax 0.924 with NanoMaggies: g=14.7, r=14.2, z=14.1 Reset brightness to NanoMaggies: g=14.7, r=14.2, z=14.1 Blob 8 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092052 MB Blob 9 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.091388 MB Blob 7 finished, total: Wall: 0.19 s, CPU: 0.18 s, VmPeak: 814 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145092 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.85289, 34.19845), pm (-1.0, -7.6), parallax 0.574 with NanoMaggies: g=19.9, r=19, z=18.6 Reset brightness to NanoMaggies: g=19.9, r=19, z=18.6 Measuring 1 iterative sources Blob 3 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095172 MB Blob 6 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.095804 MB Blob 4 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093436 MB Blob 5 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 815 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.145992 MB Measuring 1 iterative sources Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.82717, 34.19928), pm (-5.8, -9.8), parallax 1.858 with NanoMaggies: g=15.1, r=14.3, z=14.6 Reset brightness to NanoMaggies: g=14.7, r=14.1, z=13.8 Blob 2 finished, total: Wall: 2.09 s, CPU: 2.09 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 95 MB, VmData: 142 MB, maxrss: 0.097488 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.46003, ee1=-0.0632519, ee2=0.0904591 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.82533, 34.20011), pm (-4.4, -8.0), parallax 0.164 with NanoMaggies: g=18.4, r=17.9, z=17.8 Reset brightness to NanoMaggies: g=18.4, r=17.9, z=17.8 Measuring 1 iterative sources Blob 1 finished, total: Wall: 13.65 s, CPU: 13.65 s, VmPeak: 703 MB, VmSize: 698 MB, VmRSS: 128 MB, VmData: 166 MB, maxrss: 0.13556 MB Old catalog: 49 New catalog: 40 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/metrics/cus/blobs-custom-277838p34201.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/metrics/cus/all-models-custom-277838p34201.fits Stage fitblobs : Wall: 14.02 s, CPU: 0.33 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 302 MB, VmData: 328 MB, maxrss: 0.308868 MB Stage fitblobs finished: 2020-08-07T12:03:58.151592 Resources for stage fitblobs : 19.291 s worker CPU, 19.346 s worker Wall, Wall: 14.022 s, Cores in use: 1.40, Total efficiency (on 32 cores): 4.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T12:03:58.196144 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/tmp-legacysurvey-custom-277838p34201-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/tmp-legacysurvey-custom-277838p34201-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/tmp-legacysurvey-custom-277838p34201-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/tmp-legacysurvey-custom-277838p34201-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-resid.jpg Stage coadds : Wall: 2.05 s, CPU: 0.58 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 302 MB, VmData: 328 MB, maxrss: 0.309208 MB Stage coadds finished: 2020-08-07T12:04:00.245315 Resources for stage coadds : 26.902 s worker CPU, 27.811 s worker Wall, Wall: 2.051 s, Cores in use: 13.40, Total efficiency (on 32 cores): 41.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T12:04:00.260138 Cut to 1 unWISE tiles Reading WISE tile 2777p348 band 1 Reading WISE tile 2777p348 band 2 Reading WISE tile 2777p348 band 3 Reading WISE tile 2777p348 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 814 MB, VmSize: 802 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.19122 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 792 MB, VmRSS: 137 MB, VmData: 170 MB, maxrss: 0.198912 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 815 MB, VmSize: 792 MB, VmRSS: 136 MB, VmData: 170 MB, maxrss: 0.198532 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2777p348/unwise-2777p348-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 817 MB, VmSize: 793 MB, VmRSS: 138 MB, VmData: 171 MB, maxrss: 0.19978 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/tmp-legacysurvey-custom-277838p34201-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/tmp-legacysurvey-custom-277838p34201-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 12.33 s, CPU: 0.48 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 302 MB, VmData: 328 MB, maxrss: 0.30972 MB Stage wise_forced finished: 2020-08-07T12:04:12.588108 Resources for stage wise_forced : 3.174 s worker CPU, 4.254 s worker Wall, Wall: 12.330 s, Cores in use: 0.30, Total efficiency (on 32 cores): 0.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T12:04:13.083269 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/coadd/cus/custom-277838p34201/legacysurvey-custom-277838p34201-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/tractor-i/cus/tractor-custom-277838p34201.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/tractor/cus/tractor-custom-277838p34201.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/tractor/cus/brick-custom-277838p34201.sha256sum Stage writecat : Wall: 2.35 s, CPU: 0.64 s, VmPeak: 1203 MB, VmSize: 1075 MB, VmRSS: 304 MB, VmData: 328 MB, maxrss: 0.442604 MB Stage writecat finished: 2020-08-07T12:04:15.429921 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.350 s, Cores in use: 0.27, Total efficiency (on 32 cores): 0.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2045464/PGC2045464-largegalaxy-writecat.p All done: 55.443 s worker CPU, 64.052 s worker Wall, Wall: 48.537 s, Cores in use: 1.42, Total efficiency (on 32 cores): 4.4 % Finished galaxy PGC2045464 in 0.864 minutes.