Started working on galaxy PGC2091973 at Wed Aug 5 19:46:05 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.175 37.0478 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:46:06.714813 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.175', '37.0478', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.175 37.0478 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.175 37.0478 Starting process 55915 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 55916 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 55917 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 55918 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 55919 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059468 MB Starting process 55920 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 55921 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 55922 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 55923 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 55924 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 55925 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 55926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:46:07.686077 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 9 CCDs: k4m_160415_113533_ooi_zd_ls9-CCD2 z expnum 82527 exptime 148.106 propid 2016A-0453 seeing 1.18 MJD 57493.483 object MzLS_588542_z mosaic/CP/V4.3/CP20160414/k4m_160415_113533_ooi_zd_ls9.fits.fz k4m_160404_121348_ooi_zd_ls9-CCD1 z expnum 81147 exptime 80.103 propid 2016A-0453 seeing 1.02 MJD 57482.510 object MzLS_590544_z mosaic/CP/V4.3/CP20160403/k4m_160404_121348_ooi_zd_ls9.fits.fz k4m_160427_105941_ooi_zd_ls9-CCD3 z expnum 85280 exptime 80.104 propid 2016A-0453 seeing 0.79 MJD 57505.458 object MzLS_589544_z mosaic/CP/V4.3/CP20160426/k4m_160427_105941_ooi_zd_ls9.fits.fz ksb_160606_105628_ooi_g_ls9-CCD4 g expnum 75450151 exptime 250.0 propid BASS seeing 1.27 MJD 57545.456 object 10932 90prime/CP/V2.3/CP20160605/ksb_160606_105628_ooi_g_ls9.fits.fz ksb_160703_072209_ooi_g_ls9-CCD4 g expnum 75720042 exptime 70.5 propid BASS seeing 1.07 MJD 57572.307 object 10932 90prime/CP/V2.3/CP20160702/ksb_160703_072209_ooi_g_ls9.fits.fz ksb_160513_103142_ooi_r_ls9-CCD4 r expnum 75210208 exptime 61.8 propid BASS seeing 1.21 MJD 57521.439 object 10932 90prime/CP/V2.3/CP20160512/ksb_160513_103142_ooi_r_ls9.fits.fz ksb_160628_080048_ooi_r_ls9-CCD1 r expnum 75670115 exptime 155.9 propid BASS seeing 1.41 MJD 57567.334 object 10933 90prime/CP/V2.3/CP20160627/ksb_160628_080048_ooi_r_ls9.fits.fz ksb_160705_065914_ooi_g_ls9-CCD1 g expnum 75740094 exptime 108.3 propid BASS seeing 2.08 MJD 57574.291 object 10933 90prime/CP/V2.3/CP20160704/ksb_160705_065914_ooi_g_ls9.fits.fz ksb_160503_105424_ooi_g_ls9-CCD3 g expnum 75110180 exptime 80.0 propid BASS seeing 1.36 MJD 57511.454 object 10931 90prime/CP/V2.3/CP20160502/ksb_160503_105424_ooi_g_ls9.fits.fz Faked up EXPNUM 75670115 Faked up EXPNUM 75670115 Faked up EXPNUM 75670115 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1643 1788 and amp range 0 2015 and image y 2266 2410 and amp range 2048 4095 Range in image: x 0 146 , y 0 145 (with image size 146 x 145) dzp -0.00015519658 -> scaling image by 0.9998570688798908 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75740094 Faked up EXPNUM 75740094 Faked up EXPNUM 75740094 90prime get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1646 1790 and amp range 0 2015 and image y 2321 2464 and amp range 2048 4095 Range in image: x 0 145 , y 0 144 (with image size 145 x 144) dzp -0.0051191514 -> scaling image by 0.9952961850385206 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75450151 Faked up EXPNUM 75450151 Faked up EXPNUM 75450151 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1485 1628 and amp range 0 2015 and image y 1824 1966 and amp range 0 2047 Range in image: x 0 144 , y 0 143 (with image size 144 x 143) dzp 0.009539392 -> scaling image by 1.0088248156909383 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2263 2511 and amp range 2048 4095 and image y 3901 4072 and amp range 2040 4078 Range in image: x 0 249 , y 0 172 (with image size 249 x 172) dzp -0.009154885 -> scaling image by 0.9916034885139223 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1133 1383 and amp range 0 2005 and image y 3260 3507 and amp range 2040 4078 Range in image: x 0 251 , y 0 248 (with image size 251 x 248) dzp -0.005990375 -> scaling image by 0.994497853444703 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75210208 Faked up EXPNUM 75210208 Faked up EXPNUM 75210208 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1502 1645 and amp range 0 2015 and image y 1880 2023 and amp range 0 2047 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.009781551 -> scaling image by 1.0090498455107675 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75720042 Faked up EXPNUM 75720042 Faked up EXPNUM 75720042 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1485 1628 and amp range 0 2015 and image y 1828 1971 and amp range 0 2047 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.009539392 -> scaling image by 1.0088248156909383 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3848 4046 and amp range 2006 4053 and image y 2068 2316 and amp range 2040 4078 Range in image: x 0 199 , y 0 249 (with image size 199 x 249) dzp -0.0026360443 -> scaling image by 0.99757505842151 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 19.17 s, CPU: 1.37 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.177388 MB Stage tims finished: 2020-08-05T19:46:26.860293 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Faked up EXPNUM 75110180 Faked up EXPNUM 75110180 Faked up EXPNUM 75110180 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 4.904 s worker CPU, 47.909 s worker Wall, Wall: 19.176 s, Cores in use: 0.33, Total efficiency (on 16 cores): 2.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-05T19:46:27.001929 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02336.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/reference-custom-272175p37047.fits Stage refs : Wall: 30.91 s, CPU: 9.40 s, VmPeak: 1041 MB, VmSize: 1035 MB, VmRSS: 254 MB, VmData: 284 MB, maxrss: 0.25978 MB Stage refs finished: 2020-08-05T19:46:57.907923 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 30.908 s, Cores in use: 0.30, Total efficiency (on 16 cores): 1.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:46:57.970580 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outlier-mask-custom-272175p37047.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outliers-pre-custom-272175p37047.jpg Image ksb_160513_103142_ooi_r_ls9-CCD4 r : masking 176 positive outlier pixels and 0 negative outlier pixels Image k4m_160415_113533_ooi_zd_ls9-CCD2 z : masking 1198 positive outlier pixels and 0 negative outlier pixels Image k4m_160427_105941_ooi_zd_ls9-CCD3 z : masking 1673 positive outlier pixels and 0 negative outlier pixels Image k4m_160404_121348_ooi_zd_ls9-CCD1 z : masking 1669 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outlier-mask-custom-272175p37047.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outliers-post-custom-272175p37047.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outliers-masked-pos-custom-272175p37047.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outliers-masked-neg-custom-272175p37047.jpg Stage outliers : Wall: 0.97 s, CPU: 0.73 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 267 MB, VmData: 294 MB, maxrss: 0.27306 MB Stage outliers finished: 2020-08-05T19:46:58.939905 Resources for stage outliers : 0.601 s worker CPU, 0.678 s worker Wall, Wall: 0.971 s, Cores in use: 1.37, Total efficiency (on 16 cores): 8.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:46:59.005554 Stage halos : Wall: 0.36 s, CPU: 0.35 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 267 MB, VmData: 294 MB, maxrss: 0.273264 MB Stage halos finished: 2020-08-05T19:46:59.367255 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.363 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T19:46:59.447677 PSF sigmas in coadd pixels: ['2.07', '1.73', '3.38'] Using average PSF sigma 2.3913090920392968 Gaussian PSF norm 0.11796667888437169 vs pixelized 0.103432395 average tim pixel scale / coadd scale: 1.7292761352297117 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.97', '2.29'] Using average PSF sigma 2.1263829646499866 Gaussian PSF norm 0.13266415150213187 vs pixelized 0.12054186 average tim pixel scale / coadd scale: 1.7291282388943296 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.92', '1.66', '1.28'] Using average PSF sigma 1.6178720420860666 Gaussian PSF norm 0.17436162096611066 vs pixelized 0.14260696 average tim pixel scale / coadd scale: 0.9909597668043189 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.13 s, CPU: 0.12 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 268 MB, VmData: 294 MB, maxrss: 0.274728 MB Stage fit_on_coadds finished: 2020-08-05T19:46:59.581932 Resources for stage fit_on_coadds : 0.133 s worker CPU, 0.133 s worker Wall, Wall: 0.136 s, Cores in use: 1.88, Total efficiency (on 16 cores): 11.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:46:59.592271 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 36 potential peaks Of 36 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 37 potential peaks Of 37 potential peaks: 29 in veto map, 5 cut by saddle test, 3 cut by aper test, 0 kept SED r : 0 new peaks Found 30 potential peaks Of 30 potential peaks: 24 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 54 potential peaks Of 54 potential peaks: 45 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 44 potential peaks Of 44 potential peaks: 41 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 23 new sources Median coadd sky for g : 0.0004130119 Median coadd sky for r : 0.0007930689 Median coadd sky for z : -9.880061e-05 Stage srcs : Wall: 0.61 s, CPU: 0.57 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 269 MB, VmData: 294 MB, maxrss: 0.275232 MB Stage srcs finished: 2020-08-05T19:47:00.205405 Resources for stage srcs : 0.084 s worker CPU, 0.084 s worker Wall, Wall: 0.614 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:47:00.216968 Blob 1 of 16, id: 4, sources: 13, size: 166x124, npix 12753, brick X: 24,190, Y: 58,182, one pixel: 85 58 Blob 2 of 16, id: 1, sources: 4, size: 56x78, npix 2627, brick X: 189,245, Y: 0,78, one pixel: 214 0 Blob 3 of 16, id: 12, sources: 4, size: 53x41, npix 1696, brick X: 0,53, Y: 204,245, one pixel: 7 204 Blob 4 of 16, id: 8, sources: 2, size: 63x43, npix 1414, brick X: 172,235, Y: 147,190, one pixel: 180 147 Blob 5 of 16, id: 15, sources: 3, size: 64x31, npix 1394, brick X: 154,218, Y: 214,245, one pixel: 187 214 Blob 6 of 16, id: 0, sources: 2, size: 37x62, npix 1361, brick X: 110,147, Y: 0,62, one pixel: 119 0 Blob 7 of 16, id: 7, sources: 1, size: 32x32, npix 659, brick X: 4,36, Y: 137,169, one pixel: 19 137 Blob 8 of 16, id: 14, sources: 1, size: 25x30, npix 553, brick X: 220,245, Y: 210,240, one pixel: 229 210 Blob 9 of 16, id: 2, sources: 1, size: 28x26, npix 470, brick X: 63,91, Y: 3,29, one pixel: 74 3 Blob 10 of 16, id: 5, sources: 1, size: 26x26, npix 419, brick X: 212,238, Y: 100,126, one pixel: 226 100 Blob 11 of 16, id: 9, sources: 1, size: 24x25, npix 384, brick X: 164,188, Y: 168,193, one pixel: 175 168 Blob 12 of 16, id: 3, sources: 1, size: 23x23, npix 316, brick X: 166,189, Y: 16,39, one pixel: 178 16 Blob 13 of 16, id: 10, sources: 1, size: 21x21, npix 269, brick X: 97,118, Y: 180,201, one pixel: 106 180 Blob 14 of 16, id: 6, sources: 1, size: 14x23, npix 229, brick X: 0,14, Y: 119,142, one pixel: 1 119 Blob 15 of 16, id: 13, sources: 1, size: 19x19, npix 208, brick X: 51,70, Y: 204,223, one pixel: 59 204 Blob 16 of 16, id: 11, sources: 1, size: 18x18, npix 180, brick X: 119,137, Y: 199,217, one pixel: 127 199 Blob 16 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149144 MB Blob 15 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149372 MB Blob 10 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149476 MB Blob 13 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.095368 MB Blob 12 finished, total: Wall: 0.26 s, CPU: 0.25 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092272 MB Blob 9 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 813 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149808 MB Blob 11 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150036 MB Blob 14 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 814 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1498 MB Blob 8 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 182 MB, maxrss: 0.143444 MB Blob 7 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.09372 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.21033, 37.07319), pm (-10.3, 2.9), parallax 5.362 with NanoMaggies: g=11.3, r=10.9, z=10.8 Reset brightness to NanoMaggies: g=11.3, r=10.9, z=10.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.18867, 37.05471), pm (7.5, 1.5), parallax 0.923 with NanoMaggies: g=17.2, r=16.4, z=(flux -588) Reset brightness to NanoMaggies: g=17.2, r=16.4, z=16 Blob 3 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 794 MB, VmSize: 719 MB, VmRSS: 134 MB, VmData: 171 MB, maxrss: 0.137512 MB Blob 5 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094064 MB Blob 4 finished, total: Wall: 0.95 s, CPU: 0.94 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149316 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.16014, 37.03743), pm (5.2, 10.5), parallax 1.747 with NanoMaggies: g=11.6, r=10.9, z=10.5 Reset brightness to NanoMaggies: g=11.6, r=10.9, z=10.5 Blob 2 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 669 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.0951 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.15 s, CPU: 1.15 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093156 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.2779, ee1=-0.0137005, ee2=0.0749855 Measuring 3 iterative sources Blob 1 finished, total: Wall: 9.72 s, CPU: 9.72 s, VmPeak: 683 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.109152 MB Old catalog: 40 New catalog: 36 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/blobs-custom-272175p37047.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/all-models-custom-272175p37047.fits Stage fitblobs : Wall: 10.29 s, CPU: 0.53 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 269 MB, VmData: 294 MB, maxrss: 0.275492 MB Stage fitblobs finished: 2020-08-05T19:47:10.511660 Resources for stage fitblobs : 18.564 s worker CPU, 18.736 s worker Wall, Wall: 10.296 s, Cores in use: 1.86, Total efficiency (on 16 cores): 11.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:47:10.533967 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-resid.jpg Stage coadds : Wall: 4.34 s, CPU: 2.01 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 269 MB, VmData: 294 MB, maxrss: 0.275828 MB Stage coadds finished: 2020-08-05T19:47:14.871776 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 9.240 s worker CPU, 17.790 s worker Wall, Wall: 4.339 s, Cores in use: 2.59, Total efficiency (on 16 cores): 16.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:47:14.894997 Cut to 1 unWISE tiles Reading WISE tile 2723p363 band 2 Reading WISE tile 2723p363 band 1 Reading WISE tile 2723p363 band 3 Reading WISE tile 2723p363 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 812 MB, VmSize: 810 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.190792 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.209984 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210056 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 805 MB, VmRSS: 146 MB, VmData: 173 MB, maxrss: 0.209424 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.68 s, CPU: 1.96 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 270 MB, VmData: 294 MB, maxrss: 0.276468 MB Stage wise_forced finished: 2020-08-05T19:47:20.570159 Resources for stage wise_forced : 3.157 s worker CPU, 7.099 s worker Wall, Wall: 5.677 s, Cores in use: 0.90, Total efficiency (on 16 cores): 5.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:47:20.594465 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/tractor-i/cus/tractor-custom-272175p37047.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/tractor/cus/tractor-custom-272175p37047.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/tractor/cus/brick-custom-272175p37047.sha256sum Stage writecat : Wall: 1.08 s, CPU: 0.62 s, VmPeak: 1177 MB, VmSize: 1049 MB, VmRSS: 272 MB, VmData: 294 MB, maxrss: 0.409348 MB Stage writecat finished: 2020-08-05T19:47:21.677960 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.085 s, Cores in use: 0.57, Total efficiency (on 16 cores): 3.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-writecat.p All done: 36.687 s worker CPU, 92.432 s worker Wall, Wall: 74.017 s, Cores in use: 0.74, Total efficiency (on 16 cores): 4.6 % Finished galaxy PGC2091973 in 1.285 minutes. Started working on galaxy PGC2091973 at Wed Aug 5 20:35:41 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.175 37.0478 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:35:44.912282 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.175', '37.0478', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.175 37.0478 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.175 37.0478 Starting process 1116 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 1117 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 1118 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 1119 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 1120 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 1121 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 1122 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 1123 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 1124 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 1125 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 1126 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 1127 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 1128 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 1129 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 1130 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 1131 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 1132 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 1133 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 1134 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 1135 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 1136 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 1137 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 1138 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 1139 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 1140 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 1141 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 1142 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 1143 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 1144 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 1145 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 1146 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 1147 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:35:46.027433 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 9 CCDs: k4m_160415_113533_ooi_zd_ls9-CCD2 z expnum 82527 exptime 148.106 propid 2016A-0453 seeing 1.18 MJD 57493.483 object MzLS_588542_z mosaic/CP/V4.3/CP20160414/k4m_160415_113533_ooi_zd_ls9.fits.fz k4m_160404_121348_ooi_zd_ls9-CCD1 z expnum 81147 exptime 80.103 propid 2016A-0453 seeing 1.02 MJD 57482.510 object MzLS_590544_z mosaic/CP/V4.3/CP20160403/k4m_160404_121348_ooi_zd_ls9.fits.fz k4m_160427_105941_ooi_zd_ls9-CCD3 z expnum 85280 exptime 80.104 propid 2016A-0453 seeing 0.79 MJD 57505.458 object MzLS_589544_z mosaic/CP/V4.3/CP20160426/k4m_160427_105941_ooi_zd_ls9.fits.fz ksb_160606_105628_ooi_g_ls9-CCD4 g expnum 75450151 exptime 250.0 propid BASS seeing 1.27 MJD 57545.456 object 10932 90prime/CP/V2.3/CP20160605/ksb_160606_105628_ooi_g_ls9.fits.fz ksb_160703_072209_ooi_g_ls9-CCD4 g expnum 75720042 exptime 70.5 propid BASS seeing 1.07 MJD 57572.307 object 10932 90prime/CP/V2.3/CP20160702/ksb_160703_072209_ooi_g_ls9.fits.fz ksb_160513_103142_ooi_r_ls9-CCD4 r expnum 75210208 exptime 61.8 propid BASS seeing 1.21 MJD 57521.439 object 10932 90prime/CP/V2.3/CP20160512/ksb_160513_103142_ooi_r_ls9.fits.fz ksb_160628_080048_ooi_r_ls9-CCD1 r expnum 75670115 exptime 155.9 propid BASS seeing 1.41 MJD 57567.334 object 10933 90prime/CP/V2.3/CP20160627/ksb_160628_080048_ooi_r_ls9.fits.fz ksb_160705_065914_ooi_g_ls9-CCD1 g expnum 75740094 exptime 108.3 propid BASS seeing 2.08 MJD 57574.291 object 10933 90prime/CP/V2.3/CP20160704/ksb_160705_065914_ooi_g_ls9.fits.fz ksb_160503_105424_ooi_g_ls9-CCD3 g expnum 75110180 exptime 80.0 propid BASS seeing 1.36 MJD 57511.454 object 10931 90prime/CP/V2.3/CP20160502/ksb_160503_105424_ooi_g_ls9.fits.fz Faked up EXPNUM 75450151 Faked up EXPNUM 75450151 Faked up EXPNUM 75450151 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1485 1628 and amp range 0 2015 and image y 1824 1966 and amp range 0 2047 Range in image: x 0 144 , y 0 143 (with image size 144 x 143) dzp 0.009539392 -> scaling image by 1.0088248156909383 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75740094 Faked up EXPNUM 75740094 Faked up EXPNUM 75740094 90prime get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1646 1790 and amp range 0 2015 and image y 2321 2464 and amp range 2048 4095 Range in image: x 0 145 , y 0 144 (with image size 145 x 144) dzp -0.0051191514 -> scaling image by 0.9952961850385206 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75720042 Faked up EXPNUM 75720042 Faked up EXPNUM 75720042 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1485 1628 and amp range 0 2015 and image y 1828 1971 and amp range 0 2047 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.009539392 -> scaling image by 1.0088248156909383 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2263 2511 and amp range 2048 4095 and image y 3901 4072 and amp range 2040 4078 mosaic get_fwhm: self.fwhm = 3.93 Found 4 relevant rows in amp-corrections file. Range in image: x 0 249 , y 0 172 (with image size 249 x 172) dzp -0.009154885 -> scaling image by 0.9916034885139223 Found overlap: image x 1133 1383 and amp range 0 2005 and image y 3260 3507 and amp range 2040 4078 Range in image: x 0 251 , y 0 248 (with image size 251 x 248) dzp -0.005990375 -> scaling image by 0.994497853444703 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75210208 Faked up EXPNUM 75210208 Faked up EXPNUM 75210208 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1502 1645 and amp range 0 2015 and image y 1880 2023 and amp range 0 2047 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.009781551 -> scaling image by 1.0090498455107675 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75670115 Faked up EXPNUM 75670115 Faked up EXPNUM 75670115 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1643 1788 and amp range 0 2015 and image y 2266 2410 and amp range 2048 4095 Range in image: x 0 146 , y 0 145 (with image size 146 x 145) dzp -0.00015519658 -> scaling image by 0.9998570688798908 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3848 4046 and amp range 2006 4053 and image y 2068 2316 and amp range 2040 4078 Range in image: x 0 199 , y 0 249 (with image size 199 x 249) dzp -0.0026360443 -> scaling image by 0.99757505842151 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 30.94 s, CPU: 1.31 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 174 MB, VmData: 206 MB, maxrss: 0.177872 MB Stage tims finished: 2020-08-05T20:36:16.968458 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 4.580 s worker CPU, 48.024 s worker Wall, Wall: 30.944 s, Cores in use: 0.19, Total efficiency (on 32 cores): 0.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-tims.p Running stage refs Faked up EXPNUM 75110180 Faked up EXPNUM 75110180 Faked up EXPNUM 75110180 Running stage refs at 2020-08-05T20:36:17.041740 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02336.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/reference-custom-272175p37047.fits Stage refs : Wall: 22.91 s, CPU: 6.16 s, VmPeak: 1041 MB, VmSize: 1035 MB, VmRSS: 254 MB, VmData: 284 MB, maxrss: 0.260232 MB Stage refs finished: 2020-08-05T20:36:39.950640 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 22.911 s, Cores in use: 0.27, Total efficiency (on 32 cores): 0.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-refs.p Running stage outliers WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage outliers at 2020-08-05T20:36:39.970020 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outlier-mask-custom-272175p37047.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outliers-pre-custom-272175p37047.jpg Image ksb_160513_103142_ooi_r_ls9-CCD4 r : masking 176 positive outlier pixels and 0 negative outlier pixels Image k4m_160415_113533_ooi_zd_ls9-CCD2 z : masking 1198 positive outlier pixels and 0 negative outlier pixels Image k4m_160427_105941_ooi_zd_ls9-CCD3 z : masking 1673 positive outlier pixels and 0 negative outlier pixels Image k4m_160404_121348_ooi_zd_ls9-CCD1 z : masking 1669 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outlier-mask-custom-272175p37047.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outliers-post-custom-272175p37047.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outliers-masked-pos-custom-272175p37047.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/outliers-masked-neg-custom-272175p37047.jpg Stage outliers : Wall: 1.16 s, CPU: 0.85 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 267 MB, VmData: 294 MB, maxrss: 0.273016 MB Stage outliers finished: 2020-08-05T20:36:41.131654 Resources for stage outliers : 0.694 s worker CPU, 0.889 s worker Wall, Wall: 1.164 s, Cores in use: 1.33, Total efficiency (on 32 cores): 4.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:36:41.214191 Stage halos : Wall: 1.71 s, CPU: 1.67 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 267 MB, VmData: 294 MB, maxrss: 0.273144 MB Stage halos finished: 2020-08-05T20:36:42.923462 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.711 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T20:36:42.949717 PSF sigmas in coadd pixels: ['2.07', '1.73', '3.38'] Using average PSF sigma 2.3913090920392968 Gaussian PSF norm 0.11796667888437169 vs pixelized 0.103432395 average tim pixel scale / coadd scale: 1.7292761352297117 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.97', '2.29'] Using average PSF sigma 2.1263829646499866 Gaussian PSF norm 0.13266415150213187 vs pixelized 0.12054186 average tim pixel scale / coadd scale: 1.7291282388943296 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.92', '1.66', '1.28'] Using average PSF sigma 1.6178720420860666 Gaussian PSF norm 0.17436162096611066 vs pixelized 0.14260696 average tim pixel scale / coadd scale: 0.9909597668043189 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.12 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 268 MB, VmData: 294 MB, maxrss: 0.274656 MB Stage fit_on_coadds finished: 2020-08-05T20:36:43.118397 Resources for stage fit_on_coadds : 0.127 s worker CPU, 0.127 s worker Wall, Wall: 0.171 s, Cores in use: 1.49, Total efficiency (on 32 cores): 4.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-05T20:36:43.135768 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 36 potential peaks Of 36 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 37 potential peaks Of 37 potential peaks: 29 in veto map, 5 cut by saddle test, 3 cut by aper test, 0 kept SED r : 0 new peaks Found 30 potential peaks Of 30 potential peaks: 24 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 54 potential peaks Of 54 potential peaks: 45 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 44 potential peaks Of 44 potential peaks: 41 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 23 new sources Median coadd sky for g : 0.0004130119 Median coadd sky for r : 0.0007930689 Median coadd sky for z : -9.880061e-05 Stage srcs : Wall: 1.56 s, CPU: 1.40 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 269 MB, VmData: 294 MB, maxrss: 0.27516 MB Stage srcs finished: 2020-08-05T20:36:44.691679 Resources for stage srcs : 0.068 s worker CPU, 0.068 s worker Wall, Wall: 1.558 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:36:44.710470 Blob 1 of 16, id: 4, sources: 13, size: 166x124, npix 12753, brick X: 24,190, Y: 58,182, one pixel: 85 58 Blob 2 of 16, id: 1, sources: 4, size: 56x78, npix 2627, brick X: 189,245, Y: 0,78, one pixel: 214 0 Blob 3 of 16, id: 12, sources: 4, size: 53x41, npix 1696, brick X: 0,53, Y: 204,245, one pixel: 7 204 Blob 4 of 16, id: 8, sources: 2, size: 63x43, npix 1414, brick X: 172,235, Y: 147,190, one pixel: 180 147 Blob 5 of 16, id: 15, sources: 3, size: 64x31, npix 1394, brick X: 154,218, Y: 214,245, one pixel: 187 214 Blob 6 of 16, id: 0, sources: 2, size: 37x62, npix 1361, brick X: 110,147, Y: 0,62, one pixel: 119 0 Blob 7 of 16, id: 7, sources: 1, size: 32x32, npix 659, brick X: 4,36, Y: 137,169, one pixel: 19 137 Blob 8 of 16, id: 14, sources: 1, size: 25x30, npix 553, brick X: 220,245, Y: 210,240, one pixel: 229 210 Blob 9 of 16, id: 2, sources: 1, size: 28x26, npix 470, brick X: 63,91, Y: 3,29, one pixel: 74 3 Blob 10 of 16, id: 5, sources: 1, size: 26x26, npix 419, brick X: 212,238, Y: 100,126, one pixel: 226 100 Blob 11 of 16, id: 9, sources: 1, size: 24x25, npix 384, brick X: 164,188, Y: 168,193, one pixel: 175 168 Blob 12 of 16, id: 3, sources: 1, size: 23x23, npix 316, brick X: 166,189, Y: 16,39, one pixel: 178 16 Blob 13 of 16, id: 10, sources: 1, size: 21x21, npix 269, brick X: 97,118, Y: 180,201, one pixel: 106 180 Blob 14 of 16, id: 6, sources: 1, size: 14x23, npix 229, brick X: 0,14, Y: 119,142, one pixel: 1 119 Blob 15 of 16, id: 13, sources: 1, size: 19x19, npix 208, brick X: 51,70, Y: 204,223, one pixel: 59 204 Blob 16 of 16, id: 11, sources: 1, size: 18x18, npix 180, brick X: 119,137, Y: 199,217, one pixel: 127 199 Blob 16 finished, total: Wall: 0.06 s, CPU: 0.05 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 138 MB, maxrss: 0.088 MB Blob 15 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 85 MB, VmData: 137 MB, maxrss: 0.08662 MB Blob 13 finished, total: Wall: 0.17 s, CPU: 0.16 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092232 MB Blob 10 finished, total: Wall: 0.21 s, CPU: 0.20 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149684 MB Blob 12 finished, total: Wall: 0.27 s, CPU: 0.26 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093312 MB Blob 14 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092016 MB Blob 11 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 814 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149312 MB Blob 8 finished, total: Wall: 0.46 s, CPU: 0.45 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092364 MB Blob 9 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.092932 MB Blob 7 finished, total: Wall: 0.54 s, CPU: 0.53 s, VmPeak: 813 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149592 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.21033, 37.07319), pm (-10.3, 2.9), parallax 5.362 with NanoMaggies: g=11.3, r=10.9, z=10.8 Reset brightness to NanoMaggies: g=11.3, r=10.9, z=10.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.18867, 37.05471), pm (7.5, 1.5), parallax 0.923 with NanoMaggies: g=17.2, r=16.4, z=(flux -588) Reset brightness to NanoMaggies: g=17.2, r=16.4, z=16 Blob 3 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092608 MB Blob 4 finished, total: Wall: 0.79 s, CPU: 0.78 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.0929 MB Blob 5 finished, total: Wall: 0.87 s, CPU: 0.86 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093856 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.16014, 37.03743), pm (5.2, 10.5), parallax 1.747 with NanoMaggies: g=11.6, r=10.9, z=10.5 Reset brightness to NanoMaggies: g=11.6, r=10.9, z=10.5 Blob 2 finished, total: Wall: 0.96 s, CPU: 0.95 s, VmPeak: 794 MB, VmSize: 719 MB, VmRSS: 134 MB, VmData: 171 MB, maxrss: 0.137368 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093116 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.2779, ee1=-0.0137005, ee2=0.0749855 Measuring 3 iterative sources Blob 1 finished, total: Wall: 9.86 s, CPU: 9.86 s, VmPeak: 682 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.109376 MB Old catalog: 40 New catalog: 36 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/blobs-custom-272175p37047.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/metrics/cus/all-models-custom-272175p37047.fits Stage fitblobs : Wall: 10.86 s, CPU: 0.95 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 269 MB, VmData: 294 MB, maxrss: 0.275324 MB Stage fitblobs finished: 2020-08-05T20:36:55.567889 Resources for stage fitblobs : 17.399 s worker CPU, 17.867 s worker Wall, Wall: 10.860 s, Cores in use: 1.69, Total efficiency (on 32 cores): 5.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:36:55.583228 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-resid.jpg Stage coadds : Wall: 3.83 s, CPU: 1.03 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 269 MB, VmData: 294 MB, maxrss: 0.275648 MB Stage coadds finished: 2020-08-05T20:36:59.415091 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 25.953 s worker CPU, 55.162 s worker Wall, Wall: 3.834 s, Cores in use: 7.04, Total efficiency (on 32 cores): 22.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:36:59.433483 Cut to 1 unWISE tiles Reading WISE tile 2723p363 band 1 Reading WISE tile 2723p363 band 2 Reading WISE tile 2723p363 band 3 Reading WISE tile 2723p363 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 814 MB, VmSize: 809 MB, VmRSS: 150 MB, VmData: 177 MB, maxrss: 0.191364 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 813 MB, VmSize: 812 MB, VmRSS: 152 MB, VmData: 180 MB, maxrss: 0.209188 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.209944 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 800 MB, VmSize: 800 MB, VmRSS: 138 MB, VmData: 172 MB, maxrss: 0.1989 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.10 s, CPU: 0.92 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 270 MB, VmData: 294 MB, maxrss: 0.276288 MB Stage wise_forced finished: 2020-08-05T20:37:03.535196 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.059 s worker CPU, 6.010 s worker Wall, Wall: 4.104 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:37:03.554089 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/tractor-i/cus/tractor-custom-272175p37047.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/tractor/cus/tractor-custom-272175p37047.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/tractor/cus/brick-custom-272175p37047.sha256sum Stage writecat : Wall: 1.13 s, CPU: 0.83 s, VmPeak: 1177 MB, VmSize: 1049 MB, VmRSS: 272 MB, VmData: 294 MB, maxrss: 0.409168 MB Stage writecat finished: 2020-08-05T20:37:04.687895 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.136 s, Cores in use: 0.73, Total efficiency (on 32 cores): 2.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2091973/PGC2091973-largegalaxy-writecat.p All done: 51.887 s worker CPU, 128.155 s worker Wall, Wall: 78.688 s, Cores in use: 0.85, Total efficiency (on 32 cores): 2.7 % Finished galaxy PGC2091973 in 1.392 minutes. Started working on galaxy PGC2091973 at Fri Aug 7 09:20:51 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.17555601872607 37.04778560685203 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:20:52.402854 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.17555601872607', '37.04778560685203', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.17555601872607 37.04778560685203 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.17555601872607 37.04778560685203 Starting process 62539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 62541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 62543 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 62545 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 62547 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 62549 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 62551 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 62553 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 62555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 62556 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 62558 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 62561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 62563 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 62565 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 62567 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 62570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:20:52.900995 Keeping 9 CCDs: k4m_160415_113533_ooi_zd_ls9-CCD2 z expnum 82527 exptime 148.106 propid 2016A-0453 seeing 1.18 MJD 57493.483 object MzLS_588542_z mosaic/CP/V4.3/CP20160414/k4m_160415_113533_ooi_zd_ls9.fits.fz k4m_160404_121348_ooi_zd_ls9-CCD1 z expnum 81147 exptime 80.103 propid 2016A-0453 seeing 1.02 MJD 57482.510 object MzLS_590544_z mosaic/CP/V4.3/CP20160403/k4m_160404_121348_ooi_zd_ls9.fits.fz k4m_160427_105941_ooi_zd_ls9-CCD3 z expnum 85280 exptime 80.104 propid 2016A-0453 seeing 0.79 MJD 57505.458 object MzLS_589544_z mosaic/CP/V4.3/CP20160426/k4m_160427_105941_ooi_zd_ls9.fits.fz ksb_160606_105628_ooi_g_ls9-CCD4 g expnum 75450151 exptime 250.0 propid BASS seeing 1.27 MJD 57545.456 object 10932 90prime/CP/V2.3/CP20160605/ksb_160606_105628_ooi_g_ls9.fits.fz ksb_160703_072209_ooi_g_ls9-CCD4 g expnum 75720042 exptime 70.5 propid BASS seeing 1.07 MJD 57572.307 object 10932 90prime/CP/V2.3/CP20160702/ksb_160703_072209_ooi_g_ls9.fits.fz ksb_160513_103142_ooi_r_ls9-CCD4 r expnum 75210208 exptime 61.8 propid BASS seeing 1.21 MJD 57521.439 object 10932 90prime/CP/V2.3/CP20160512/ksb_160513_103142_ooi_r_ls9.fits.fz ksb_160628_080048_ooi_r_ls9-CCD1 r expnum 75670115 exptime 155.9 propid BASS seeing 1.41 MJD 57567.334 object 10933 90prime/CP/V2.3/CP20160627/ksb_160628_080048_ooi_r_ls9.fits.fz ksb_160705_065914_ooi_g_ls9-CCD1 g expnum 75740094 exptime 108.3 propid BASS seeing 2.08 MJD 57574.291 object 10933 90prime/CP/V2.3/CP20160704/ksb_160705_065914_ooi_g_ls9.fits.fz ksb_160503_105424_ooi_g_ls9-CCD3 g expnum 75110180 exptime 80.0 propid BASS seeing 1.36 MJD 57511.454 object 10931 90prime/CP/V2.3/CP20160502/ksb_160503_105424_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 4.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2262 2510 and amp range 2048 4095 and image y 3907 4072 and amp range 2040 4078 Range in image: x 0 249 , y 0 166 (with image size 249 x 166) dzp -0.009154885 -> scaling image by 0.9916034885139223 mosaic get_fwhm: self.fwhm = 3.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1133 1382 and amp range 0 2005 and image y 3266 3513 and amp range 2040 4078 Range in image: x 0 250 , y 0 248 (with image size 250 x 248) dzp -0.005990375 -> scaling image by 0.994497853444703 mosaic get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3848 4046 and amp range 2006 4053 and image y 2074 2322 and amp range 2040 4078 Range in image: x 0 199 , y 0 249 (with image size 199 x 249) dzp -0.0026360443 -> scaling image by 0.99757505842151 Faked up EXPNUM 75720042 Faked up EXPNUM 75720042 Faked up EXPNUM 75720042 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1485 1628 and amp range 0 2015 and image y 1825 1967 and amp range 0 2047 Range in image: x 0 144 , y 0 143 (with image size 144 x 143) dzp 0.009539392 -> scaling image by 1.0088248156909383 Faked up EXPNUM 75740094 Faked up EXPNUM 75740094 Faked up EXPNUM 75740094 90prime get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1646 1790 and amp range 0 2015 and image y 2317 2460 and amp range 2048 4095 Range in image: x 0 145 , y 0 144 (with image size 145 x 144) dzp -0.0051191514 -> scaling image by 0.9952961850385206 Faked up EXPNUM 75450151 Faked up EXPNUM 75450151 Faked up EXPNUM 75450151 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1486 1628 and amp range 0 2015 and image y 1820 1963 and amp range 0 2047 Range in image: x 0 143 , y 0 144 (with image size 143 x 144) dzp 0.009539392 -> scaling image by 1.0088248156909383 Faked up EXPNUM 75210208 Faked up EXPNUM 75210208 Faked up EXPNUM 75210208 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1503 1646 and amp range 0 2015 and image y 1877 2019 and amp range 0 2047 Range in image: x 0 144 , y 0 143 (with image size 144 x 143) dzp 0.009781551 -> scaling image by 1.0090498455107675 Faked up EXPNUM 75670115 Faked up EXPNUM 75670115 Faked up EXPNUM 75670115 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1643 1788 and amp range 0 2015 and image y 2263 2406 and amp range 2048 4095 Range in image: x 0 146 , y 0 144 (with image size 146 x 144) dzp -0.00015519658 -> scaling image by 0.9998570688798908 Stage tims : Wall: 98.76 s, CPU: 0.95 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.17524 MB Stage tims finished: 2020-08-07T09:22:31.660515 Resources for stage tims : 4.208 s worker CPU, 379.708 s worker Wall, Wall: 98.761 s, Cores in use: 0.05, Total efficiency (on 16 cores): 0.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:22:32.734395 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02336.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/metrics/cus/reference-custom-272175p37047.fits Stage refs : Wall: 6.99 s, CPU: 5.95 s, VmPeak: 1034 MB, VmSize: 1028 MB, VmRSS: 251 MB, VmData: 282 MB, maxrss: 0.257052 MB Stage refs finished: 2020-08-07T09:22:39.724144 Faked up EXPNUM 75110180 Faked up EXPNUM 75110180 Faked up EXPNUM 75110180 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.991 s, Cores in use: 0.85, Total efficiency (on 16 cores): 5.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:22:39.740792 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/metrics/cus/outlier-mask-custom-272175p37047.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/metrics/cus/outliers-pre-custom-272175p37047.jpg Image ksb_160513_103142_ooi_r_ls9-CCD4 r : masking 210 positive outlier pixels and 0 negative outlier pixels Image k4m_160415_113533_ooi_zd_ls9-CCD2 z : masking 1177 positive outlier pixels and 0 negative outlier pixels Image k4m_160427_105941_ooi_zd_ls9-CCD3 z : masking 1663 positive outlier pixels and 0 negative outlier pixels Image k4m_160404_121348_ooi_zd_ls9-CCD1 z : masking 1663 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/metrics/cus/outlier-mask-custom-272175p37047.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/metrics/cus/outliers-post-custom-272175p37047.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/metrics/cus/outliers-masked-pos-custom-272175p37047.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/metrics/cus/outliers-masked-neg-custom-272175p37047.jpg Stage outliers : Wall: 0.85 s, CPU: 0.58 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 264 MB, VmData: 293 MB, maxrss: 0.269856 MB Stage outliers finished: 2020-08-07T09:22:40.591134 Resources for stage outliers : 0.581 s worker CPU, 0.758 s worker Wall, Wall: 0.852 s, Cores in use: 1.37, Total efficiency (on 16 cores): 8.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:22:40.649365 Stage halos : Wall: 0.38 s, CPU: 0.37 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 264 MB, VmData: 293 MB, maxrss: 0.270004 MB Stage halos finished: 2020-08-07T09:22:41.029061 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.381 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:22:41.056911 PSF sigmas in coadd pixels: ['2.07', '1.73', '3.38'] Using average PSF sigma 2.3913090920392968 Gaussian PSF norm 0.11796667888437169 vs pixelized 0.103438124 average tim pixel scale / coadd scale: 1.7292761352297117 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.97', '2.29'] Using average PSF sigma 2.1263829646499866 Gaussian PSF norm 0.13266415150213187 vs pixelized 0.12054396 average tim pixel scale / coadd scale: 1.7291282388943296 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.92', '1.66', '1.28'] Using average PSF sigma 1.6178720420860666 Gaussian PSF norm 0.17436162096611066 vs pixelized 0.14260188 average tim pixel scale / coadd scale: 0.9909597668043189 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.13 s, CPU: 0.11 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 265 MB, VmData: 293 MB, maxrss: 0.27148 MB Stage fit_on_coadds finished: 2020-08-07T09:22:41.182720 Resources for stage fit_on_coadds : 0.139 s worker CPU, 0.139 s worker Wall, Wall: 0.127 s, Cores in use: 2.00, Total efficiency (on 16 cores): 12.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:22:41.192490 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 36 potential peaks Of 36 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 34 potential peaks Of 34 potential peaks: 30 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 28 potential peaks Of 28 potential peaks: 25 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 54 potential peaks Of 54 potential peaks: 46 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 43 potential peaks Of 43 potential peaks: 40 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 23 new sources Median coadd sky for g : 0.0004008899 Median coadd sky for r : 0.0007672346 Median coadd sky for z : -0.00018894786 Stage srcs : Wall: 0.44 s, CPU: 0.42 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 266 MB, VmData: 293 MB, maxrss: 0.271972 MB Stage srcs finished: 2020-08-07T09:22:41.637261 Resources for stage srcs : 0.066 s worker CPU, 0.066 s worker Wall, Wall: 0.446 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:22:41.656309 Blob 1 of 18, id: 4, sources: 11, size: 150x124, npix 12614, brick X: 46,196, Y: 58,182, one pixel: 92 58 Blob 2 of 18, id: 1, sources: 4, size: 50x79, npix 2313, brick X: 195,245, Y: 0,79, one pixel: 220 0 Blob 3 of 18, id: 14, sources: 4, size: 59x41, npix 1950, brick X: 0,59, Y: 204,245, one pixel: 6 204 Blob 4 of 18, id: 9, sources: 2, size: 63x43, npix 1420, brick X: 178,241, Y: 147,190, one pixel: 186 147 Blob 5 of 18, id: 17, sources: 3, size: 64x31, npix 1378, brick X: 160,224, Y: 214,245, one pixel: 194 214 Blob 6 of 18, id: 0, sources: 2, size: 37x63, npix 1355, brick X: 116,153, Y: 0,63, one pixel: 126 0 Blob 7 of 18, id: 8, sources: 1, size: 31x32, npix 659, brick X: 11,42, Y: 137,169, one pixel: 25 137 Blob 8 of 18, id: 2, sources: 1, size: 28x26, npix 470, brick X: 69,97, Y: 3,29, one pixel: 80 3 Blob 9 of 18, id: 7, sources: 1, size: 20x29, npix 420, brick X: 0,20, Y: 116,145, one pixel: 7 116 Blob 10 of 18, id: 16, sources: 1, size: 19x29, npix 419, brick X: 226,245, Y: 210,239, one pixel: 236 210 Blob 11 of 18, id: 6, sources: 1, size: 26x26, npix 410, brick X: 218,244, Y: 100,126, one pixel: 232 100 Blob 12 of 18, id: 10, sources: 1, size: 24x25, npix 366, brick X: 170,194, Y: 168,193, one pixel: 182 168 Blob 13 of 18, id: 3, sources: 1, size: 23x23, npix 316, brick X: 172,195, Y: 17,40, one pixel: 182 17 Blob 14 of 18, id: 12, sources: 1, size: 21x22, npix 271, brick X: 103,124, Y: 180,202, one pixel: 112 180 Blob 15 of 18, id: 5, sources: 1, size: 17x20, npix 223, brick X: 0,17, Y: 73,93, one pixel: 6 73 Blob 16 of 18, id: 11, sources: 1, size: 17x20, npix 210, brick X: 0,17, Y: 178,198, one pixel: 5 178 Blob 17 of 18, id: 15, sources: 1, size: 19x19, npix 208, brick X: 57,76, Y: 204,223, one pixel: 65 204 Blob 18 of 18, id: 13, sources: 1, size: 18x18, npix 180, brick X: 125,143, Y: 199,217, one pixel: 133 199 Blob 11 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 794 MB, VmSize: 712 MB, VmRSS: 129 MB, VmData: 170 MB, maxrss: 0.131848 MB Blob 14 finished, total: Wall: 0.24 s, CPU: 0.23 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.1459 MB Blob 15 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.145972 MB Blob 16 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092656 MB Blob 17 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 794 MB, VmSize: 712 MB, VmRSS: 129 MB, VmData: 170 MB, maxrss: 0.131848 MB Blob 18 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.1459 MB Blob 13 finished, total: Wall: 0.40 s, CPU: 0.39 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095084 MB Blob 10 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145572 MB Blob 12 finished, total: Wall: 0.56 s, CPU: 0.55 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 116 MB, VmData: 161 MB, maxrss: 0.11926 MB Blob 9 finished, total: Wall: 0.57 s, CPU: 0.56 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.095548 MB Blob 8 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092544 MB Blob 7 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14574 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.21033, 37.07319), pm (-10.3, 2.9), parallax 5.362 with NanoMaggies: g=11.3, r=10.9, z=10.8 Reset brightness to NanoMaggies: g=11.3, r=10.9, z=10.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.18867, 37.05471), pm (7.5, 1.5), parallax 0.923 with NanoMaggies: g=15.5, r=15.3, z=(flux -316) Reset brightness to NanoMaggies: g=17.2, r=16.4, z=16 Measuring 1 iterative sources Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.16014, 37.03743), pm (5.2, 10.5), parallax 1.747 with NanoMaggies: g=11.6, r=10.9, z=10.5 Reset brightness to NanoMaggies: g=11.6, r=10.9, z=10.5 Blob 2 finished, total: Wall: 1.00 s, CPU: 0.99 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095668 MB Blob 5 finished, total: Wall: 1.04 s, CPU: 1.02 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146572 MB Blob 4 finished, total: Wall: 1.07 s, CPU: 1.05 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093132 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145548 MB Blob 3 finished, total: Wall: 1.36 s, CPU: 1.35 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.094724 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.956269, ee1=-0.0168567, ee2=0.100497 Blob 1 finished, total: Wall: 6.79 s, CPU: 6.79 s, VmPeak: 805 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149636 MB Old catalog: 41 New catalog: 35 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/metrics/cus/blobs-custom-272175p37047.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/metrics/cus/all-models-custom-272175p37047.fits Stage fitblobs : Wall: 7.17 s, CPU: 0.36 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 266 MB, VmData: 293 MB, maxrss: 0.272136 MB Stage fitblobs finished: 2020-08-07T09:22:48.824124 Resources for stage fitblobs : 17.388 s worker CPU, 17.739 s worker Wall, Wall: 7.169 s, Cores in use: 2.48, Total efficiency (on 16 cores): 15.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:22:48.837440 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-resid.jpg Stage coadds : Wall: 1.67 s, CPU: 0.50 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 266 MB, VmData: 293 MB, maxrss: 0.272524 MB Stage coadds finished: 2020-08-07T09:22:50.504706 Resources for stage coadds : 9.852 s worker CPU, 10.371 s worker Wall, Wall: 1.669 s, Cores in use: 6.20, Total efficiency (on 16 cores): 38.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:22:50.518199 Cut to 1 unWISE tiles Reading WISE tile 2723p363 band 1 Reading WISE tile 2723p363 band 2 Reading WISE tile 2723p363 band 3 Reading WISE tile 2723p363 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 806 MB, VmSize: 806 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.194632 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 803 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.211228 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 813 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.205424 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 814 MB, VmSize: 799 MB, VmRSS: 142 MB, VmData: 172 MB, maxrss: 0.205568 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/tmp-legacysurvey-custom-272175p37047-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 16.34 s, CPU: 0.51 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 267 MB, VmData: 293 MB, maxrss: 0.273164 MB Stage wise_forced finished: 2020-08-07T09:23:06.860929 Resources for stage wise_forced : 2.878 s worker CPU, 27.343 s worker Wall, Wall: 16.344 s, Cores in use: 0.21, Total efficiency (on 16 cores): 1.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:23:06.890007 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/coadd/cus/custom-272175p37047/legacysurvey-custom-272175p37047-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/tractor-i/cus/tractor-custom-272175p37047.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/tractor/cus/tractor-custom-272175p37047.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/tractor/cus/brick-custom-272175p37047.sha256sum Stage writecat : Wall: 1.22 s, CPU: 0.57 s, VmPeak: 1170 MB, VmSize: 1042 MB, VmRSS: 269 MB, VmData: 293 MB, maxrss: 0.406048 MB Stage writecat finished: 2020-08-07T09:23:08.113461 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.225 s, Cores in use: 0.47, Total efficiency (on 16 cores): 2.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2091973/PGC2091973-largegalaxy-writecat.p All done: 35.114 s worker CPU, 436.127 s worker Wall, Wall: 135.233 s, Cores in use: 0.34, Total efficiency (on 16 cores): 2.1 % Finished galaxy PGC2091973 in 2.294 minutes.