Started working on galaxy PGC2369175 at Wed Aug 5 20:11:46 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.00872749999996 50.3090172 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:11:49.379475 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '283.00872749999996', '50.3090172', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.00872749999996 50.3090172 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 283.00872749999996 50.3090172 Starting process 5889 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 5890 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 5891 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 5892 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 5893 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB Starting process 5894 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB Starting process 5895 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB Starting process 5896 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 5897 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 5898 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 5899 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 5900 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 5901 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 5902 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 5903 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 5904 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:11:50.621778 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 8 CCDs: k4m_160525_101745_ooi_zd_ls9-CCD1 z expnum 91490 exptime 103.103 propid 2016A-0453 seeing 1.31 MJD 57533.429 object MzLS_651138_z mosaic/CP/V4.3/CP20160524/k4m_160525_101745_ooi_zd_ls9.fits.fz k4m_160523_103139_ooi_zd_ls9-CCD2 z expnum 90960 exptime 80.103 propid 2016A-0453 seeing 1.11 MJD 57531.439 object MzLS_650335_z mosaic/CP/V4.3/CP20160522/k4m_160523_103139_ooi_zd_ls9.fits.fz k4m_171126_012201_ooi_zd_ls9-CCD2 z expnum 149123 exptime 100.105 propid 2016A-0453 seeing 0.69 MJD 58083.057 object MzLS_650335_z mosaic/CP/V4.3/CP20171125/k4m_171126_012201_ooi_zd_ls9.fits.fz k4m_170910_065838_ooi_zd_ls9-CCD3 z expnum 139002 exptime 183.103 propid 2016A-0453 seeing 1.08 MJD 58006.291 object MzLS_651938_z mosaic/CP/V4.3/CP20170909/k4m_170910_065838_ooi_zd_ls9.fits.fz ksb_160705_094252_ooi_g_ls9-CCD2 g expnum 75740145 exptime 79.9 propid BASS seeing 1.27 MJD 57574.405 object 28393 90prime/CP/V2.3/CP20160704/ksb_160705_094252_ooi_g_ls9.fits.fz ksb_170624_071328_ooi_r_ls9-CCD2 r expnum 79280096 exptime 75.459 propid BASS seeing 1.17 MJD 57928.301 object 28393 90prime/CP/V2.3/CP20170623/ksb_170624_071328_ooi_r_ls9.fits.fz ksb_160704_092654_ooi_g_ls9-CCD3 g expnum 75730157 exptime 103.4 propid BASS seeing 1.19 MJD 57573.394 object 27252 90prime/CP/V2.3/CP20160703/ksb_160704_092654_ooi_g_ls9.fits.fz ksb_160712_071915_ooi_r_ls9-CCD3 r expnum 75810094 exptime 99.8 propid BASS seeing 1.83 MJD 57581.305 object 27252 90prime/CP/V2.3/CP20160711/ksb_160712_071915_ooi_r_ls9.fits.fz Faked up EXPNUM 75740145 Faked up EXPNUM 75740145 Faked up EXPNUM 75740145 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3317 3476 and amp range 2016 4031 and image y 492 653 and amp range 0 2047 Range in image: x 0 160 , y 0 162 (with image size 160 x 162) dzp -0.008960029 -> scaling image by 0.9917814665476246 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75810094 Faked up EXPNUM 75810094 Faked up EXPNUM 75810094 90prime get_fwhm: self.fwhm = 4.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3581 3737 and amp range 2016 4031 and image y 1629 1785 and amp range 0 2047 Range in image: x 0 157 , y 0 157 (with image size 157 x 157) dzp 0.004245165 -> scaling image by 1.0039175950705865 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3386 3656 and amp range 2006 4053 and image y 3878 4072 and amp range 2040 4078 Range in image: x 0 271 , y 0 195 (with image size 271 x 195) dzp -0.006092005 -> scaling image by 0.9944047680378836 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 697 972 and amp range 0 2005 and image y 2188 2467 and amp range 2040 4078 Range in image: x 0 276 , y 0 280 (with image size 276 x 280) dzp 0.01523814 -> scaling image by 1.014133796220052 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1759 2032 and amp range 0 2047 and image y 1197 1472 and amp range 0 2039 Range in image: x 0 274 , y 0 276 (with image size 274 x 276) dzp 0.007023884 -> scaling image by 1.0064902069278665 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79280096 Faked up EXPNUM 79280096 Faked up EXPNUM 79280096 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3307 3465 and amp range 2016 4031 and image y 504 665 and amp range 0 2047 Range in image: x 0 159 , y 0 162 (with image size 159 x 162) dzp 0.032776505 -> scaling image by 1.0306485625912574 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1819 2093 and amp range 0 2047 and image y 1214 1489 and amp range 0 2039 Range in image: x 0 229 , y 0 276 (with image size 275 x 276) dzp -0.006320339 -> scaling image by 0.9941956631368829 Found overlap: image x 1819 2093 and amp range 2048 4095 and image y 1214 1489 and amp range 0 2039 Range in image: x 229 275 , y 0 276 (with image size 275 x 276) dzp 0.0072022504 -> scaling image by 1.0066555682883527 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75730157 Faked up EXPNUM 75730157 Faked up EXPNUM 75730157 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3578 3734 and amp range 2016 4031 and image y 1615 1771 and amp range 0 2047 Range in image: x 0 157 , y 0 157 (with image size 157 x 157) dzp -0.0022715968 -> scaling image by 0.9979099691834846 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 17.70 s, CPU: 2.24 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.17902 MB Stage tims finished: 2020-08-05T20:12:08.326480 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 3.954 s worker CPU, 43.528 s worker Wall, Wall: 17.707 s, Cores in use: 0.35, Total efficiency (on 16 cores): 2.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:12:08.418736 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01488.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01489.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01381.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/reference-custom-283008p50309.fits Stage refs : Wall: 10.91 s, CPU: 6.34 s, VmPeak: 1049 MB, VmSize: 1044 MB, VmRSS: 264 MB, VmData: 294 MB, maxrss: 0.270404 MB Stage refs finished: 2020-08-05T20:12:19.327171 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.910 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:12:19.364604 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outlier-mask-custom-283008p50309.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outliers-pre-custom-283008p50309.jpg Image ksb_160704_092654_ooi_g_ls9-CCD3 g : masking 190 positive outlier pixels and 0 negative outlier pixels Image ksb_170624_071328_ooi_r_ls9-CCD2 r : masking 335 positive outlier pixels and 0 negative outlier pixels Image ksb_160712_071915_ooi_r_ls9-CCD3 r : masking 90 positive outlier pixels and 0 negative outlier pixels Image k4m_170910_065838_ooi_zd_ls9-CCD3 z : masking 536 positive outlier pixels and 0 negative outlier pixels Image k4m_160523_103139_ooi_zd_ls9-CCD2 z : masking 213 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outlier-mask-custom-283008p50309.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outliers-post-custom-283008p50309.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outliers-masked-pos-custom-283008p50309.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outliers-masked-neg-custom-283008p50309.jpg Stage outliers : Wall: 3.83 s, CPU: 3.28 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 278 MB, VmData: 305 MB, maxrss: 0.2849 MB Stage outliers finished: 2020-08-05T20:12:23.196340 Resources for stage outliers : 0.788 s worker CPU, 0.869 s worker Wall, Wall: 3.833 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:12:23.320625 Stage halos : Wall: 0.72 s, CPU: 0.71 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 279 MB, VmData: 305 MB, maxrss: 0.285316 MB Stage halos finished: 2020-08-05T20:12:24.039661 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.720 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T20:12:24.061019 PSF sigmas in coadd pixels: ['2.07', '1.94'] Using average PSF sigma 2.0014014779100817 Gaussian PSF norm 0.14094862769285516 vs pixelized 0.10572119 average tim pixel scale / coadd scale: 1.7291476340424126 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.91', '2.96'] Using average PSF sigma 2.4352003159392273 Gaussian PSF norm 0.11584048750629274 vs pixelized 0.10768687 average tim pixel scale / coadd scale: 1.728963180185644 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.13', '1.81', '1.13', '1.76'] Using average PSF sigma 1.7056998367428782 Gaussian PSF norm 0.16538360718410616 vs pixelized 0.13598166 average tim pixel scale / coadd scale: 0.9909482280242093 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.14 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 281 MB, VmData: 306 MB, maxrss: 0.287708 MB Stage fit_on_coadds finished: 2020-08-05T20:12:24.218751 Resources for stage fit_on_coadds : 0.172 s worker CPU, 0.172 s worker Wall, Wall: 0.159 s, Cores in use: 1.95, Total efficiency (on 16 cores): 12.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:12:24.231323 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 27 potential peaks Of 27 potential peaks: 8 in veto map, 3 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 49 potential peaks Of 49 potential peaks: 45 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 85 potential peaks Of 85 potential peaks: 81 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 52 potential peaks Of 52 potential peaks: 44 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 49 potential peaks Of 49 potential peaks: 41 in veto map, 3 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 25 new sources Median coadd sky for g : 0.00046481143 Median coadd sky for r : 0.00086174655 Median coadd sky for z : -9.2676655e-06 Stage srcs : Wall: 0.57 s, CPU: 0.53 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 282 MB, VmData: 306 MB, maxrss: 0.288272 MB Stage srcs finished: 2020-08-05T20:12:24.797097 Resources for stage srcs : 0.090 s worker CPU, 0.090 s worker Wall, Wall: 0.567 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:12:24.819231 Blob 1 of 16, id: 5, sources: 10, size: 186x173, npix 18041, brick X: 44,230, Y: 69,242, one pixel: 140 69 Blob 2 of 16, id: 1, sources: 4, size: 73x77, npix 3251, brick X: 158,231, Y: 0,77, one pixel: 172 0 Blob 3 of 16, id: 0, sources: 3, size: 41x50, npix 1380, brick X: 76,117, Y: 0,50, one pixel: 100 0 Blob 4 of 16, id: 4, sources: 2, size: 46x44, npix 1256, brick X: 48,94, Y: 48,92, one pixel: 70 48 Blob 5 of 16, id: 12, sources: 3, size: 45x37, npix 1077, brick X: 224,269, Y: 232,269, one pixel: 251 232 Blob 6 of 16, id: 2, sources: 3, size: 34x44, npix 950, brick X: 235,269, Y: 0,44, one pixel: 250 0 Blob 7 of 16, id: 7, sources: 1, size: 33x40, npix 825, brick X: 0,33, Y: 96,136, one pixel: 3 96 Blob 8 of 16, id: 10, sources: 2, size: 31x40, npix 719, brick X: 165,196, Y: 208,248, one pixel: 180 208 Blob 9 of 16, id: 8, sources: 1, size: 25x28, npix 503, brick X: 244,269, Y: 105,133, one pixel: 254 105 Blob 10 of 16, id: 9, sources: 1, size: 23x26, npix 374, brick X: 3,26, Y: 185,211, one pixel: 13 185 Blob 11 of 16, id: 3, sources: 1, size: 20x19, npix 209, brick X: 230,250, Y: 42,61, one pixel: 239 42 Blob 12 of 16, id: 6, sources: 1, size: 19x20, npix 199, brick X: 5,24, Y: 79,99, one pixel: 14 79 Blob 13 of 16, id: 11, sources: 1, size: 19x19, npix 199, brick X: 41,60, Y: 225,244, one pixel: 50 225 Blob 14 of 16, id: 13, sources: 1, size: 18x18, npix 180, brick X: 147,165, Y: 236,254, one pixel: 155 236 Blob 15 of 16, id: 15, sources: 1, size: 17x18, npix 162, brick X: 205,222, Y: 251,269, one pixel: 213 251 Blob 16 of 16, id: 14, sources: 1, size: 17x17, npix 145, brick X: 157,174, Y: 251,268, one pixel: 165 251 Blob 11 finished, total: Wall: 0.09 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150712 MB Blob 7 finished, total: Wall: 0.17 s, CPU: 0.15 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 88 MB, VmData: 139 MB, maxrss: 0.090304 MB Blob 16 finished, total: Wall: 0.14 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.151 MB Blob 13 finished, total: Wall: 0.21 s, CPU: 0.20 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095304 MB Blob 12 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097428 MB Blob 10 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.09704 MB Blob 15 finished, total: Wall: 0.27 s, CPU: 0.26 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151232 MB Measuring 1 iterative sources Blob 14 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151368 MB Blob 8 finished, total: Wall: 0.60 s, CPU: 0.59 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096084 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 0.74 s, CPU: 0.72 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151176 MB Blob 9 finished, total: Wall: 0.87 s, CPU: 0.80 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.0964 MB Blob 2 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 670 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.097588 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.96286, 50.29308), pm (1.3, -16.8), parallax 1.415 with NanoMaggies: g=13.4, r=13.1, z=13 Reset brightness to NanoMaggies: g=13.4, r=13.1, z=13 Measuring 2 iterative sources Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.64 s, CPU: 1.63 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150864 MB Blob 5 finished, total: Wall: 1.79 s, CPU: 1.78 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.09706 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.82 s, CPU: 2.81 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.152112 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.23844, ee1=0.0749299, ee2=0.03794 Measuring 1 iterative sources Blob 1 finished, total: Wall: 7.98 s, CPU: 7.97 s, VmPeak: 805 MB, VmSize: 732 MB, VmRSS: 154 MB, VmData: 183 MB, maxrss: 0.158124 MB Old catalog: 42 New catalog: 32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/blobs-custom-283008p50309.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/all-models-custom-283008p50309.fits Stage fitblobs : Wall: 8.57 s, CPU: 0.54 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 282 MB, VmData: 306 MB, maxrss: 0.288628 MB Stage fitblobs finished: 2020-08-05T20:12:33.391165 Resources for stage fitblobs : 19.241 s worker CPU, 19.778 s worker Wall, Wall: 8.574 s, Cores in use: 2.31, Total efficiency (on 16 cores): 14.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:12:33.408735 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-resid.jpg Stage coadds : Wall: 4.44 s, CPU: 1.51 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 282 MB, VmData: 306 MB, maxrss: 0.288948 MB Stage coadds finished: 2020-08-05T20:12:37.848994 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 9.919 s worker CPU, 20.311 s worker Wall, Wall: 4.442 s, Cores in use: 2.57, Total efficiency (on 16 cores): 16.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:12:37.862906 Cut to 1 unWISE tiles Reading WISE tile 2833p499 band 1 Reading WISE tile 2833p499 band 2 Reading WISE tile 2833p499 band 3 Reading WISE tile 2833p499 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 808 MB, VmSize: 808 MB, VmRSS: 149 MB, VmData: 176 MB, maxrss: 0.191532 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 806 MB, VmSize: 803 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.20636 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 813 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.206952 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 813 MB, VmSize: 805 MB, VmRSS: 146 MB, VmData: 173 MB, maxrss: 0.209336 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.76 s, CPU: 1.00 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 283 MB, VmData: 306 MB, maxrss: 0.289464 MB Stage wise_forced finished: 2020-08-05T20:12:40.620798 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.146 s worker CPU, 4.801 s worker Wall, Wall: 2.759 s, Cores in use: 1.50, Total efficiency (on 16 cores): 9.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:12:40.640848 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/tractor-i/cus/tractor-custom-283008p50309.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/tractor/cus/tractor-custom-283008p50309.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/tractor/cus/brick-custom-283008p50309.sha256sum Stage writecat : Wall: 4.04 s, CPU: 1.76 s, VmPeak: 1186 MB, VmSize: 1058 MB, VmRSS: 284 MB, VmData: 306 MB, maxrss: 0.422344 MB Stage writecat finished: 2020-08-05T20:12:44.679361 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.040 s, Cores in use: 0.44, Total efficiency (on 16 cores): 2.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-writecat.p All done: 37.314 s worker CPU, 89.554 s worker Wall, Wall: 54.089 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.4 % Finished galaxy PGC2369175 in 0.978 minutes. Started working on galaxy PGC2369175 at Wed Aug 5 21:05:53 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.00872749999996 50.3090172 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:05:57.901663 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '283.00872749999996', '50.3090172', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.00872749999996 50.3090172 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 283.00872749999996 50.3090172 Starting process 15191 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 15192 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 15193 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 15194 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 15195 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 15196 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 15197 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 15198 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 15199 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 15200 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 15201 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 15202 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 15203 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 15204 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 15205 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 15206 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 15207 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 15208 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 15209 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 15210 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 15211 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 15212 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 15214 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 15213 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 15215 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 15216 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 15217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 15218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 15219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 15220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 15221 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 15222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:05:59.022495 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 8 CCDs: k4m_160525_101745_ooi_zd_ls9-CCD1 z expnum 91490 exptime 103.103 propid 2016A-0453 seeing 1.31 MJD 57533.429 object MzLS_651138_z mosaic/CP/V4.3/CP20160524/k4m_160525_101745_ooi_zd_ls9.fits.fz k4m_160523_103139_ooi_zd_ls9-CCD2 z expnum 90960 exptime 80.103 propid 2016A-0453 seeing 1.11 MJD 57531.439 object MzLS_650335_z mosaic/CP/V4.3/CP20160522/k4m_160523_103139_ooi_zd_ls9.fits.fz k4m_171126_012201_ooi_zd_ls9-CCD2 z expnum 149123 exptime 100.105 propid 2016A-0453 seeing 0.69 MJD 58083.057 object MzLS_650335_z mosaic/CP/V4.3/CP20171125/k4m_171126_012201_ooi_zd_ls9.fits.fz k4m_170910_065838_ooi_zd_ls9-CCD3 z expnum 139002 exptime 183.103 propid 2016A-0453 seeing 1.08 MJD 58006.291 object MzLS_651938_z mosaic/CP/V4.3/CP20170909/k4m_170910_065838_ooi_zd_ls9.fits.fz ksb_160705_094252_ooi_g_ls9-CCD2 g expnum 75740145 exptime 79.9 propid BASS seeing 1.27 MJD 57574.405 object 28393 90prime/CP/V2.3/CP20160704/ksb_160705_094252_ooi_g_ls9.fits.fz ksb_170624_071328_ooi_r_ls9-CCD2 r expnum 79280096 exptime 75.459 propid BASS seeing 1.17 MJD 57928.301 object 28393 90prime/CP/V2.3/CP20170623/ksb_170624_071328_ooi_r_ls9.fits.fz ksb_160704_092654_ooi_g_ls9-CCD3 g expnum 75730157 exptime 103.4 propid BASS seeing 1.19 MJD 57573.394 object 27252 90prime/CP/V2.3/CP20160703/ksb_160704_092654_ooi_g_ls9.fits.fz ksb_160712_071915_ooi_r_ls9-CCD3 r expnum 75810094 exptime 99.8 propid BASS seeing 1.83 MJD 57581.305 object 27252 90prime/CP/V2.3/CP20160711/ksb_160712_071915_ooi_r_ls9.fits.fz Faked up EXPNUM 75810094 Faked up EXPNUM 75810094 Faked up EXPNUM 75810094 90prime get_fwhm: self.fwhm = 4.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3581 3737 and amp range 2016 4031 and image y 1629 1785 and amp range 0 2047 Range in image: x 0 157 , y 0 157 (with image size 157 x 157) dzp 0.004245165 -> scaling image by 1.0039175950705865 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1819 2093 and amp range 0 2047 and image y 1214 1489 and amp range 0 2039 Range in image: x 0 229 , y 0 276 (with image size 275 x 276) dzp -0.006320339 -> scaling image by 0.9941956631368829 Found overlap: image x 1819 2093 and amp range 2048 4095 and image y 1214 1489 and amp range 0 2039 Range in image: x 229 275 , y 0 276 (with image size 275 x 276) dzp 0.0072022504 -> scaling image by 1.0066555682883527 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.17 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 5.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 697 972 and amp range 0 2005 and image y 2188 2467 and amp range 2040 4078 Range in image: x 0 276 , y 0 280 (with image size 276 x 280) Found overlap: image x 3386 3656 and amp range 2006 4053 and image y 3878 4072 and amp range 2040 4078 dzp 0.01523814 -> scaling image by 1.014133796220052 Range in image: x 0 271 , y 0 195 (with image size 271 x 195) dzp -0.006092005 -> scaling image by 0.9944047680378836 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79280096 Faked up EXPNUM 79280096 Faked up EXPNUM 79280096 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3307 3465 and amp range 2016 4031 and image y 504 665 and amp range 0 2047 Range in image: x 0 159 , y 0 162 (with image size 159 x 162) dzp 0.032776505 -> scaling image by 1.0306485625912574 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75740145 Faked up EXPNUM 75740145 Faked up EXPNUM 75740145 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3317 3476 and amp range 2016 4031 and image y 492 653 and amp range 0 2047 Range in image: x 0 160 , y 0 162 (with image size 160 x 162) dzp -0.008960029 -> scaling image by 0.9917814665476246 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1759 2032 and amp range 0 2047 and image y 1197 1472 and amp range 0 2039 Range in image: x 0 274 , y 0 276 (with image size 274 x 276) dzp 0.007023884 -> scaling image by 1.0064902069278665 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75730157 Faked up EXPNUM 75730157 Faked up EXPNUM 75730157 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3578 3734 and amp range 2016 4031 and image y 1615 1771 and amp range 0 2047 Range in image: x 0 157 , y 0 157 (with image size 157 x 157) dzp -0.0022715968 -> scaling image by 0.9979099691834846 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 15.52 s, CPU: 0.98 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.178712 MB Stage tims finished: 2020-08-05T21:06:14.538659 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 4.285 s worker CPU, 26.766 s worker Wall, Wall: 15.519 s, Cores in use: 0.34, Total efficiency (on 32 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:06:14.644478 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01488.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01489.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01381.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/reference-custom-283008p50309.fits Stage refs : Wall: 10.69 s, CPU: 7.06 s, VmPeak: 1049 MB, VmSize: 1044 MB, VmRSS: 264 MB, VmData: 294 MB, maxrss: 0.27044 MB Stage refs finished: 2020-08-05T21:06:25.338065 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.696 s, Cores in use: 0.66, Total efficiency (on 32 cores): 2.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:06:25.358286 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outlier-mask-custom-283008p50309.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outliers-pre-custom-283008p50309.jpg Image ksb_160704_092654_ooi_g_ls9-CCD3 g : masking 190 positive outlier pixels and 0 negative outlier pixels Image ksb_160712_071915_ooi_r_ls9-CCD3 r : masking 90 positive outlier pixels and 0 negative outlier pixels Image ksb_170624_071328_ooi_r_ls9-CCD2 r : masking 335 positive outlier pixels and 0 negative outlier pixels Image k4m_170910_065838_ooi_zd_ls9-CCD3 z : masking 536 positive outlier pixels and 0 negative outlier pixels Image k4m_160523_103139_ooi_zd_ls9-CCD2 z : masking 213 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outlier-mask-custom-283008p50309.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outliers-post-custom-283008p50309.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outliers-masked-pos-custom-283008p50309.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/outliers-masked-neg-custom-283008p50309.jpg Stage outliers : Wall: 1.13 s, CPU: 0.68 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 279 MB, VmData: 306 MB, maxrss: 0.286044 MB Stage outliers finished: 2020-08-05T21:06:26.486173 Resources for stage outliers : 0.878 s worker CPU, 1.212 s worker Wall, Wall: 1.130 s, Cores in use: 1.38, Total efficiency (on 32 cores): 4.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-outliers.p Running stage halos WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage halos at 2020-08-05T21:06:26.513238 Stage halos : Wall: 0.44 s, CPU: 0.43 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 280 MB, VmData: 306 MB, maxrss: 0.286244 MB Stage halos finished: 2020-08-05T21:06:26.956583 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.445 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T21:06:26.979256 PSF sigmas in coadd pixels: ['2.07', '1.94'] Using average PSF sigma 2.0014014779100817 Gaussian PSF norm 0.14094862769285516 vs pixelized 0.10572119 average tim pixel scale / coadd scale: 1.7291476340424126 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.91', '2.96'] Using average PSF sigma 2.4352003159392273 Gaussian PSF norm 0.11584048750629274 vs pixelized 0.10768687 average tim pixel scale / coadd scale: 1.728963180185644 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.13', '1.81', '1.13', '1.76'] Using average PSF sigma 1.7056998367428782 Gaussian PSF norm 0.16538360718410616 vs pixelized 0.13598165 average tim pixel scale / coadd scale: 0.9909482280242093 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.14 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 281 MB, VmData: 306 MB, maxrss: 0.287832 MB Stage fit_on_coadds finished: 2020-08-05T21:06:27.135641 Resources for stage fit_on_coadds : 0.152 s worker CPU, 0.153 s worker Wall, Wall: 0.158 s, Cores in use: 1.87, Total efficiency (on 32 cores): 5.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-05T21:06:27.147944 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 27 potential peaks Of 27 potential peaks: 8 in veto map, 3 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 49 potential peaks Of 49 potential peaks: 45 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 85 potential peaks Of 85 potential peaks: 81 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 52 potential peaks Of 52 potential peaks: 44 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 47 potential peaks Of 47 potential peaks: 39 in veto map, 3 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 25 new sources Median coadd sky for g : 0.00046481143 Median coadd sky for r : 0.00086174655 Median coadd sky for z : -9.2672935e-06 Stage srcs : Wall: 0.55 s, CPU: 0.51 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 282 MB, VmData: 306 MB, maxrss: 0.288332 MB Stage srcs finished: 2020-08-05T21:06:27.696389 Resources for stage srcs : 0.095 s worker CPU, 0.095 s worker Wall, Wall: 0.550 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:06:27.711020 Blob 1 of 16, id: 5, sources: 10, size: 186x173, npix 18041, brick X: 44,230, Y: 69,242, one pixel: 140 69 Blob 2 of 16, id: 1, sources: 4, size: 73x77, npix 3251, brick X: 158,231, Y: 0,77, one pixel: 172 0 Blob 3 of 16, id: 0, sources: 3, size: 41x50, npix 1380, brick X: 76,117, Y: 0,50, one pixel: 100 0 Blob 4 of 16, id: 4, sources: 2, size: 46x44, npix 1256, brick X: 48,94, Y: 48,92, one pixel: 70 48 Blob 5 of 16, id: 12, sources: 3, size: 45x37, npix 1077, brick X: 224,269, Y: 232,269, one pixel: 251 232 Blob 6 of 16, id: 2, sources: 3, size: 34x44, npix 950, brick X: 235,269, Y: 0,44, one pixel: 250 0 Blob 7 of 16, id: 7, sources: 1, size: 33x40, npix 825, brick X: 0,33, Y: 96,136, one pixel: 3 96 Blob 8 of 16, id: 10, sources: 2, size: 31x40, npix 719, brick X: 165,196, Y: 208,248, one pixel: 180 208 Blob 9 of 16, id: 8, sources: 1, size: 25x28, npix 503, brick X: 244,269, Y: 105,133, one pixel: 254 105 Blob 10 of 16, id: 9, sources: 1, size: 23x26, npix 374, brick X: 3,26, Y: 185,211, one pixel: 13 185 Blob 11 of 16, id: 3, sources: 1, size: 20x19, npix 209, brick X: 230,250, Y: 42,61, one pixel: 239 42 Blob 12 of 16, id: 6, sources: 1, size: 19x20, npix 199, brick X: 5,24, Y: 79,99, one pixel: 14 79 Blob 13 of 16, id: 11, sources: 1, size: 19x19, npix 199, brick X: 41,60, Y: 225,244, one pixel: 50 225 Blob 14 of 16, id: 13, sources: 1, size: 18x18, npix 180, brick X: 147,165, Y: 236,254, one pixel: 155 236 Blob 15 of 16, id: 15, sources: 1, size: 17x18, npix 162, brick X: 205,222, Y: 251,269, one pixel: 213 251 Blob 16 of 16, id: 14, sources: 1, size: 17x17, npix 145, brick X: 157,174, Y: 251,268, one pixel: 165 251 Blob 11 finished, total: Wall: 0.07 s, CPU: 0.06 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.086916 MB Blob 16 finished, total: Wall: 0.09 s, CPU: 0.08 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.08694 MB Blob 7 finished, total: Wall: 0.12 s, CPU: 0.11 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 87 MB, VmData: 139 MB, maxrss: 0.089072 MB Blob 10 finished, total: Wall: 0.15 s, CPU: 0.14 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.095764 MB Blob 13 finished, total: Wall: 0.17 s, CPU: 0.16 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.0936 MB Blob 12 finished, total: Wall: 0.20 s, CPU: 0.19 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091832 MB Blob 15 finished, total: Wall: 0.22 s, CPU: 0.21 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09426 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 14 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.09676 MB Blob 8 finished, total: Wall: 0.55 s, CPU: 0.54 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093984 MB Blob 9 finished, total: Wall: 0.64 s, CPU: 0.63 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150864 MB Blob 4 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093068 MB Blob 2 finished, total: Wall: 0.92 s, CPU: 0.91 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151048 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.96286, 50.29308), pm (1.3, -16.8), parallax 1.415 with NanoMaggies: g=13.4, r=13.1, z=13 Reset brightness to NanoMaggies: g=13.4, r=13.1, z=13 Measuring 2 iterative sources Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.49 s, CPU: 1.49 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097344 MB Blob 5 finished, total: Wall: 1.73 s, CPU: 1.72 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15008 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.61 s, CPU: 2.61 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150916 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.23844, ee1=0.0749299, ee2=0.0379398 Measuring 1 iterative sources Blob 1 finished, total: Wall: 7.95 s, CPU: 7.93 s, VmPeak: 693 MB, VmSize: 686 MB, VmRSS: 118 MB, VmData: 157 MB, maxrss: 0.12466 MB Old catalog: 42 New catalog: 32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/blobs-custom-283008p50309.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/metrics/cus/all-models-custom-283008p50309.fits Stage fitblobs : Wall: 8.57 s, CPU: 0.59 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 282 MB, VmData: 306 MB, maxrss: 0.288688 MB Stage fitblobs finished: 2020-08-05T21:06:36.279215 Resources for stage fitblobs : 18.286 s worker CPU, 18.695 s worker Wall, Wall: 8.570 s, Cores in use: 2.20, Total efficiency (on 32 cores): 6.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:06:36.315299 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-resid.jpg Stage coadds : Wall: 3.92 s, CPU: 1.16 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 282 MB, VmData: 306 MB, maxrss: 0.289012 MB Stage coadds finished: 2020-08-05T21:06:40.238811 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 26.508 s worker CPU, 51.182 s worker Wall, Wall: 3.926 s, Cores in use: 7.05, Total efficiency (on 32 cores): 22.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:06:40.265859 Cut to 1 unWISE tiles Reading WISE tile 2833p499 band 1 Reading WISE tile 2833p499 band 2 Reading WISE tile 2833p499 band 4 Reading WISE tile 2833p499 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 807 MB, VmSize: 804 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.186708 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 813 MB, VmSize: 804 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.2081 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 180 MB, maxrss: 0.2072 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 805 MB, VmSize: 802 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.20598 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.84 s, CPU: 1.24 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 283 MB, VmData: 306 MB, maxrss: 0.289524 MB Stage wise_forced finished: 2020-08-05T21:06:43.109674 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.186 s worker CPU, 4.761 s worker Wall, Wall: 2.846 s, Cores in use: 1.55, Total efficiency (on 32 cores): 4.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:06:43.127084 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/tractor-i/cus/tractor-custom-283008p50309.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/tractor/cus/tractor-custom-283008p50309.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/tractor/cus/brick-custom-283008p50309.sha256sum Stage writecat : Wall: 0.79 s, CPU: 0.59 s, VmPeak: 1186 MB, VmSize: 1058 MB, VmRSS: 284 MB, VmData: 306 MB, maxrss: 0.422404 MB Stage writecat finished: 2020-08-05T21:06:43.916376 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.792 s, Cores in use: 0.75, Total efficiency (on 32 cores): 2.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2369175/PGC2369175-largegalaxy-writecat.p All done: 53.398 s worker CPU, 102.871 s worker Wall, Wall: 44.917 s, Cores in use: 1.49, Total efficiency (on 32 cores): 4.7 % Finished galaxy PGC2369175 in 0.847 minutes. Started working on galaxy PGC2369175 at Fri Aug 7 09:37:28 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.00829908321344 50.30907366487196 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:37:28.949232 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '283.00829908321344', '50.30907366487196', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.00829908321344 50.30907366487196 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 283.00829908321344 50.30907366487196 Starting process 19001 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 19002 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 19003 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 19004 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 19005 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05932 MB Starting process 19006 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB Starting process 19007 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB Starting process 19008 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 19009 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 19010 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19011 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19012 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19013 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19014 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19015 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19016 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:37:29.363092 Keeping 8 CCDs: k4m_160525_101745_ooi_zd_ls9-CCD1 z expnum 91490 exptime 103.103 propid 2016A-0453 seeing 1.31 MJD 57533.429 object MzLS_651138_z mosaic/CP/V4.3/CP20160524/k4m_160525_101745_ooi_zd_ls9.fits.fz k4m_160523_103139_ooi_zd_ls9-CCD2 z expnum 90960 exptime 80.103 propid 2016A-0453 seeing 1.11 MJD 57531.439 object MzLS_650335_z mosaic/CP/V4.3/CP20160522/k4m_160523_103139_ooi_zd_ls9.fits.fz k4m_171126_012201_ooi_zd_ls9-CCD2 z expnum 149123 exptime 100.105 propid 2016A-0453 seeing 0.69 MJD 58083.057 object MzLS_650335_z mosaic/CP/V4.3/CP20171125/k4m_171126_012201_ooi_zd_ls9.fits.fz k4m_170910_065838_ooi_zd_ls9-CCD3 z expnum 139002 exptime 183.103 propid 2016A-0453 seeing 1.08 MJD 58006.291 object MzLS_651938_z mosaic/CP/V4.3/CP20170909/k4m_170910_065838_ooi_zd_ls9.fits.fz ksb_160705_094252_ooi_g_ls9-CCD2 g expnum 75740145 exptime 79.9 propid BASS seeing 1.27 MJD 57574.405 object 28393 90prime/CP/V2.3/CP20160704/ksb_160705_094252_ooi_g_ls9.fits.fz ksb_170624_071328_ooi_r_ls9-CCD2 r expnum 79280096 exptime 75.459 propid BASS seeing 1.17 MJD 57928.301 object 28393 90prime/CP/V2.3/CP20170623/ksb_170624_071328_ooi_r_ls9.fits.fz ksb_160704_092654_ooi_g_ls9-CCD3 g expnum 75730157 exptime 103.4 propid BASS seeing 1.19 MJD 57573.394 object 27252 90prime/CP/V2.3/CP20160703/ksb_160704_092654_ooi_g_ls9.fits.fz ksb_160712_071915_ooi_r_ls9-CCD3 r expnum 75810094 exptime 99.8 propid BASS seeing 1.83 MJD 57581.305 object 27252 90prime/CP/V2.3/CP20160711/ksb_160712_071915_ooi_r_ls9.fits.fz Faked up EXPNUM 75740145 Faked up EXPNUM 75740145 Faked up EXPNUM 75740145 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3316 3475 and amp range 2016 4031 and image y 494 655 and amp range 0 2047 Range in image: x 0 160 , y 0 162 (with image size 160 x 162) dzp -0.008960029 -> scaling image by 0.9917814665476246 Faked up EXPNUM 75730157 Faked up EXPNUM 75730157 Faked up EXPNUM 75730157 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3578 3734 and amp range 2016 4031 and image y 1617 1773 and amp range 0 2047 Range in image: x 0 157 , y 0 157 (with image size 157 x 157) dzp -0.0022715968 -> scaling image by 0.9979099691834846 mosaic get_fwhm: self.fwhm = 4.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1820 2094 and amp range 0 2047 and image y 1211 1486 and amp range 0 2039 Range in image: x 0 228 , y 0 276 (with image size 275 x 276) dzp -0.006320339 -> scaling image by 0.9941956631368829 Found overlap: image x 1820 2094 and amp range 2048 4095 and image y 1211 1486 and amp range 0 2039 Range in image: x 228 275 , y 0 276 (with image size 275 x 276) dzp 0.0072022504 -> scaling image by 1.0066555682883527 mosaic get_fwhm: self.fwhm = 5.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3387 3657 and amp range 2006 4053 and image y 3874 4072 and amp range 2040 4078 Range in image: x 0 271 , y 0 199 (with image size 271 x 199) dzp -0.006092005 -> scaling image by 0.9944047680378836 mosaic get_fwhm: self.fwhm = 4.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 697 973 and amp range 0 2005 and image y 2185 2463 and amp range 2040 4078 Range in image: x 0 277 , y 0 279 (with image size 277 x 279) dzp 0.01523814 -> scaling image by 1.014133796220052 Faked up EXPNUM 75810094 Faked up EXPNUM 75810094 Faked up EXPNUM 75810094 90prime get_fwhm: self.fwhm = 4.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3581 3737 and amp range 2016 4031 and image y 1631 1787 and amp range 0 2047 Range in image: x 0 157 , y 0 157 (with image size 157 x 157) dzp 0.004245165 -> scaling image by 1.0039175950705865 Faked up EXPNUM 79280096 Faked up EXPNUM 79280096 Faked up EXPNUM 79280096 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3306 3465 and amp range 2016 4031 and image y 506 667 and amp range 0 2047 Range in image: x 0 160 , y 0 162 (with image size 160 x 162) dzp 0.032776505 -> scaling image by 1.0306485625912574 mosaic get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1760 2033 and amp range 0 2047 and image y 1193 1468 and amp range 0 2039 Range in image: x 0 274 , y 0 276 (with image size 274 x 276) dzp 0.007023884 -> scaling image by 1.0064902069278665 Stage tims : Wall: 214.84 s, CPU: 1.02 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.177196 MB Stage tims finished: 2020-08-07T09:41:04.205177 Resources for stage tims : 3.791 s worker CPU, 761.626 s worker Wall, Wall: 214.844 s, Cores in use: 0.02, Total efficiency (on 16 cores): 0.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:41:04.259964 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01488.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01489.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01381.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/metrics/cus/reference-custom-283008p50309.fits Stage refs : Wall: 9.11 s, CPU: 6.11 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 262 MB, VmData: 294 MB, maxrss: 0.268616 MB Stage refs finished: 2020-08-07T09:41:13.372790 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.114 s, Cores in use: 0.67, Total efficiency (on 16 cores): 4.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:41:13.469991 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/metrics/cus/outlier-mask-custom-283008p50309.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/metrics/cus/outliers-pre-custom-283008p50309.jpg Image ksb_160704_092654_ooi_g_ls9-CCD3 g : masking 193 positive outlier pixels and 0 negative outlier pixels Image ksb_160712_071915_ooi_r_ls9-CCD3 r : masking 92 positive outlier pixels and 0 negative outlier pixels Image ksb_170624_071328_ooi_r_ls9-CCD2 r : masking 299 positive outlier pixels and 0 negative outlier pixels Image k4m_171126_012201_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 87 negative outlier pixels Image k4m_170910_065838_ooi_zd_ls9-CCD3 z : masking 563 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/metrics/cus/outlier-mask-custom-283008p50309.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/metrics/cus/outliers-post-custom-283008p50309.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/metrics/cus/outliers-masked-pos-custom-283008p50309.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/metrics/cus/outliers-masked-neg-custom-283008p50309.jpg Stage outliers : Wall: 1.87 s, CPU: 0.59 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 276 MB, VmData: 305 MB, maxrss: 0.283132 MB Stage outliers finished: 2020-08-07T09:41:15.339131 Resources for stage outliers : 0.852 s worker CPU, 1.014 s worker Wall, Wall: 1.871 s, Cores in use: 0.77, Total efficiency (on 16 cores): 4.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:41:15.437777 Stage halos : Wall: 0.30 s, CPU: 0.29 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 277 MB, VmData: 305 MB, maxrss: 0.283424 MB Stage halos finished: 2020-08-07T09:41:15.734473 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.298 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-07T09:41:15.755106 PSF sigmas in coadd pixels: ['2.07', '1.94'] Using average PSF sigma 2.0014014779100817 Gaussian PSF norm 0.14094862769285516 vs pixelized 0.1057201 average tim pixel scale / coadd scale: 1.7291476340424126 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.91', '2.96'] Using average PSF sigma 2.4352003159392273 Gaussian PSF norm 0.11584048750629274 vs pixelized 0.10769055 average tim pixel scale / coadd scale: 1.728963180185644 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.13', '1.81', '1.13', '1.76'] Using average PSF sigma 1.7056998367428782 Gaussian PSF norm 0.16538360718410616 vs pixelized 0.13597888 average tim pixel scale / coadd scale: 0.9909482280242093 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.14 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 279 MB, VmData: 306 MB, maxrss: 0.285764 MB Stage fit_on_coadds finished: 2020-08-07T09:41:15.930079 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.160 s worker CPU, 0.160 s worker Wall, Wall: 0.176 s, Cores in use: 1.69, Total efficiency (on 16 cores): 10.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:41:15.941736 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 27 potential peaks Of 27 potential peaks: 8 in veto map, 3 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 51 potential peaks Of 51 potential peaks: 48 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 85 potential peaks Of 85 potential peaks: 81 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 58 potential peaks Of 58 potential peaks: 50 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 48 potential peaks Of 48 potential peaks: 40 in veto map, 3 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 25 new sources Median coadd sky for g : 0.00047221643 Median coadd sky for r : 0.0008567846 Median coadd sky for z : 2.9169803e-05 Stage srcs : Wall: 0.53 s, CPU: 0.49 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 280 MB, VmData: 306 MB, maxrss: 0.28644 MB Stage srcs finished: 2020-08-07T09:41:16.474387 Resources for stage srcs : 0.093 s worker CPU, 0.093 s worker Wall, Wall: 0.534 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:41:16.485984 Blob 1 of 16, id: 5, sources: 9, size: 186x172, npix 18043, brick X: 41,227, Y: 68,240, one pixel: 136 68 Blob 2 of 16, id: 1, sources: 4, size: 73x77, npix 3212, brick X: 154,227, Y: 0,77, one pixel: 168 0 Blob 3 of 16, id: 0, sources: 3, size: 42x49, npix 1363, brick X: 72,114, Y: 0,49, one pixel: 96 0 Blob 4 of 16, id: 4, sources: 2, size: 47x44, npix 1245, brick X: 44,91, Y: 47,91, one pixel: 67 47 Blob 5 of 16, id: 12, sources: 3, size: 49x38, npix 1182, brick X: 220,269, Y: 231,269, one pixel: 248 231 Blob 6 of 16, id: 2, sources: 3, size: 38x43, npix 1008, brick X: 231,269, Y: 0,43, one pixel: 246 0 Blob 7 of 16, id: 10, sources: 2, size: 31x40, npix 720, brick X: 161,192, Y: 207,247, one pixel: 177 207 Blob 8 of 16, id: 7, sources: 2, size: 29x36, npix 659, brick X: 0,29, Y: 97,133, one pixel: 1 97 Blob 9 of 16, id: 8, sources: 1, size: 28x28, npix 536, brick X: 241,269, Y: 104,132, one pixel: 251 104 Blob 10 of 16, id: 9, sources: 1, size: 22x26, npix 369, brick X: 0,22, Y: 184,210, one pixel: 9 184 Blob 11 of 16, id: 11, sources: 1, size: 19x19, npix 207, brick X: 37,56, Y: 224,243, one pixel: 46 224 Blob 12 of 16, id: 6, sources: 1, size: 19x20, npix 200, brick X: 1,20, Y: 78,98, one pixel: 10 78 Blob 13 of 16, id: 3, sources: 1, size: 19x19, npix 199, brick X: 227,246, Y: 41,60, one pixel: 236 41 Blob 14 of 16, id: 13, sources: 1, size: 19x19, npix 190, brick X: 143,162, Y: 235,254, one pixel: 151 235 Blob 15 of 16, id: 14, sources: 1, size: 18x17, npix 162, brick X: 153,171, Y: 250,267, one pixel: 161 250 Blob 16 of 16, id: 15, sources: 1, size: 17x17, npix 145, brick X: 201,218, Y: 251,268, one pixel: 209 251 Blob 13 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147212 MB Blob 15 finished, total: Wall: 0.10 s, CPU: 0.07 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 87 MB, VmData: 138 MB, maxrss: 0.089156 MB Blob 11 finished, total: Wall: 0.13 s, CPU: 0.13 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.0947 MB Blob 8 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147484 MB Blob 16 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14692 MB Blob 10 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.094728 MB Blob 12 finished, total: Wall: 0.28 s, CPU: 0.27 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145872 MB Blob 14 finished, total: Wall: 0.49 s, CPU: 0.43 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095368 MB Blob 9 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146532 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095612 MB Blob 4 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097396 MB Measuring 3 iterative sources Blob 2 finished, total: Wall: 1.04 s, CPU: 1.03 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.1477 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.96286, 50.29308), pm (1.3, -16.8), parallax 1.415 with NanoMaggies: g=13.4, r=13.1, z=13 Reset brightness to NanoMaggies: g=13.4, r=13.1, z=13 Measuring 2 iterative sources Blob 6 finished, total: Wall: 1.79 s, CPU: 1.79 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147196 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 2.51 s, CPU: 2.49 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147524 MB Blob 3 finished, total: Wall: 2.83 s, CPU: 2.83 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096724 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.732452, ee1=0.141155, ee2=0.0647667 Measuring 1 iterative sources Blob 1 finished, total: Wall: 8.67 s, CPU: 8.67 s, VmPeak: 693 MB, VmSize: 691 MB, VmRSS: 117 MB, VmData: 159 MB, maxrss: 0.121128 MB Old catalog: 43 New catalog: 31 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/metrics/cus/blobs-custom-283008p50309.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/metrics/cus/all-models-custom-283008p50309.fits Stage fitblobs : Wall: 10.45 s, CPU: 0.40 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 280 MB, VmData: 306 MB, maxrss: 0.286796 MB Stage fitblobs finished: 2020-08-07T09:41:26.940909 Resources for stage fitblobs : 20.643 s worker CPU, 21.509 s worker Wall, Wall: 10.456 s, Cores in use: 2.01, Total efficiency (on 16 cores): 12.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:41:30.484685 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-resid.jpg Stage coadds : Wall: 11.07 s, CPU: 0.65 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 280 MB, VmData: 306 MB, maxrss: 0.28712 MB Stage coadds finished: 2020-08-07T09:41:41.551549 Resources for stage coadds : 9.952 s worker CPU, 10.667 s worker Wall, Wall: 11.068 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:41:41.607254 Cut to 1 unWISE tiles Reading WISE tile 2833p499 band 1 Reading WISE tile 2833p499 band 4 Reading WISE tile 2833p499 band 3 Reading WISE tile 2833p499 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 802 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.189776 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 805 MB, VmSize: 800 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.20684 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 807 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203824 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.204328 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/tmp-legacysurvey-custom-283008p50309-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 6.43 s, CPU: 0.46 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 281 MB, VmData: 306 MB, maxrss: 0.287632 MB Stage wise_forced finished: 2020-08-07T09:41:48.034625 Resources for stage wise_forced : 3.010 s worker CPU, 17.681 s worker Wall, Wall: 6.429 s, Cores in use: 0.54, Total efficiency (on 16 cores): 3.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:41:48.048581 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/coadd/cus/custom-283008p50309/legacysurvey-custom-283008p50309-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/tractor-i/cus/tractor-custom-283008p50309.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/tractor/cus/tractor-custom-283008p50309.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/tractor/cus/brick-custom-283008p50309.sha256sum Stage writecat : Wall: 0.66 s, CPU: 0.51 s, VmPeak: 1179 MB, VmSize: 1051 MB, VmRSS: 283 MB, VmData: 306 MB, maxrss: 0.420516 MB Stage writecat finished: 2020-08-07T09:41:48.710212 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.663 s, Cores in use: 0.77, Total efficiency (on 16 cores): 4.8 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2369175/PGC2369175-largegalaxy-writecat.p All done: 38.505 s worker CPU, 812.754 s worker Wall, Wall: 259.398 s, Cores in use: 0.19, Total efficiency (on 16 cores): 1.2 % Finished galaxy PGC2369175 in 4.353 minutes.