Started working on galaxy PGC2244359 at Wed Aug 5 19:38:22 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 208.513056 44.437116700000004 --width 247 --height 247 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:38:23.222515 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '208.513056', '44.437116700000004', '--width', '247', '--height', '247', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 208.513056 44.437116700000004 --width 247 --height 247 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 208.513056 44.437116700000004 Starting process 39185 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 39187 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 39189 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 39191 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 39193 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB Starting process 39196 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB Starting process 39199 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB Starting process 39201 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 39203 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 39205 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 39207 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 39209 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 39211 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 39213 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 39215 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 39217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:38:25.308098 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 10 CCDs: k4m_160417_074023_ooi_zd_ls9-CCD3 z expnum 82762 exptime 120.103 propid 2016A-0453 seeing 1.16 MJD 57495.320 object MzLS_625553_z mosaic/CP/V4.3/CP20160416/k4m_160417_074023_ooi_zd_ls9.fits.fz k4m_160404_082829_ooi_zd_ls9-CCD1 z expnum 81039 exptime 80.104 propid 2016A-0453 seeing 1.21 MJD 57482.353 object MzLS_625554_z mosaic/CP/V4.3/CP20160403/k4m_160404_082829_ooi_zd_ls9.fits.fz k4m_160226_105702_ooi_zd_ls9-CCD2 z expnum 71017 exptime 80.105 propid 2016A-0453 seeing 0.89 MJD 57444.456 object MzLS_624657_z mosaic/CP/V4.3/CP20160225/k4m_160226_105702_ooi_zd_ls9.fits.fz k4m_170430_071217_ooi_zd_ls9-CCD1 z expnum 125290 exptime 115.104 propid 2016A-0453 seeing 1.00 MJD 57873.300 object MzLS_626449_z mosaic/CP/V4.3/CP20170429/k4m_170430_071217_ooi_zd_ls9.fits.fz ksb_160213_113826_ooi_g_ls9-CCD1 g expnum 74310233 exptime 66.6 propid 2015A-0801 seeing 1.54 MJD 57431.485 object 19521 90prime/CP/V2.3/CP20160212/ksb_160213_113826_ooi_g_ls9.fits.fz ksb_160413_083901_ooi_r_ls9-CCD1 r expnum 74910141 exptime 50.0 propid BASS seeing 1.46 MJD 57491.360 object 19521 90prime/CP/V2.3/CP20160412/ksb_160413_083901_ooi_r_ls9.fits.fz ksb_160513_053456_ooi_r_ls9-CCD3 r expnum 75210079 exptime 130.5 propid BASS seeing 1.45 MJD 57521.233 object 19522 90prime/CP/V2.3/CP20160512/ksb_160513_053456_ooi_r_ls9.fits.fz ksb_170517_063120_ooi_g_ls9-CCD3 g expnum 78900095 exptime 115.92 propid BASS seeing 1.97 MJD 57890.272 object 19522 90prime/CP/V2.3/CP20170516/ksb_170517_063120_ooi_g_ls9.fits.fz ksb_170324_094526_ooi_r_ls9-CCD4 r expnum 78360192 exptime 89.18 propid BASS seeing 2.03 MJD 57836.407 object 20773 90prime/CP/V2.3/CP20170323/ksb_170324_094526_ooi_r_ls9.fits.fz ksb_170327_083421_ooi_g_ls9-CCD4 g expnum 78390180 exptime 83.045 propid BASS seeing 1.46 MJD 57839.357 object 20773 90prime/CP/V2.3/CP20170326/ksb_170327_083421_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 4.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3304 3554 and amp range 2006 4053 and image y 371 625 and amp range 0 2039 Range in image: x 0 251 , y 0 255 (with image size 251 x 255) dzp 0.001388291 -> scaling image by 1.0012794811153327 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 74910141 Faked up EXPNUM 74910141 Faked up EXPNUM 74910141 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 545 691 and amp range 0 2015 and image y 2774 2918 and amp range 2048 4095 Range in image: x 0 147 , y 0 145 (with image size 147 x 145) dzp -0.00015519658 -> scaling image by 0.9998570688798908 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3321 3571 and amp range 2006 4053 and image y 4030 4072 and amp range 2040 4078 Range in image: x 0 251 , y 0 43 (with image size 251 x 43) dzp -0.0026360443 -> scaling image by 0.99757505842151 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75210079 Faked up EXPNUM 75210079 Faked up EXPNUM 75210079 90prime get_fwhm: self.fwhm = 3.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2548 2692 and amp range 2016 4031 and image y 264 408 and amp range 0 2047 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp 0.004245165 -> scaling image by 1.0039175950705865 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1714 1966 and amp range 0 2047 and image y 888 1141 and amp range 0 2039 Range in image: x 0 253 , y 0 254 (with image size 253 x 254) dzp -0.006320339 -> scaling image by 0.9941956631368829 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78900095 Faked up EXPNUM 78900095 Faked up EXPNUM 78900095 90prime get_fwhm: self.fwhm = 4.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2607 2750 and amp range 2016 4031 and image y 288 431 and amp range 0 2047 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 74310233 Faked up EXPNUM 74310233 Faked up EXPNUM 74310233 90prime get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 546 692 and amp range 0 2015 and image y 2772 2916 and amp range 2048 4095 Range in image: x 0 147 , y 0 145 (with image size 147 x 145) dzp -0.0051191514 -> scaling image by 0.9952961850385206 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78360192 Faked up EXPNUM 78360192 Faked up EXPNUM 78360192 90prime get_fwhm: self.fwhm = 4.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2371 2515 and amp range 2016 4031 and image y 2275 2419 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp 0.0004463038 -> scaling image by 1.0004111454932232 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78390180 Faked up EXPNUM 78390180 Faked up EXPNUM 78390180 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2371 2515 and amp range 2016 4031 and image y 2295 2438 and amp range 2048 4095 Range in image: x 0 145 , y 0 144 (with image size 145 x 144) dzp -0.0030897402 -> scaling image by 0.9971582894587289 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 578 831 and amp range 0 2005 and image y 2851 3101 and amp range 2040 4078 Range in image: x 0 254 , y 0 251 (with image size 254 x 251) dzp 0.032569118 -> scaling image by 1.0304517167935139 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 17.71 s, CPU: 1.91 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.179216 MB Stage tims finished: 2020-08-05T19:38:43.019510 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.252 s worker CPU, 57.350 s worker Wall, Wall: 17.713 s, Cores in use: 0.40, Total efficiency (on 16 cores): 2.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:38:43.112021 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01809.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01931.fits Matched 9 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/reference-custom-208513p44437.fits Stage refs : Wall: 12.48 s, CPU: 1.50 s, VmPeak: 988 MB, VmSize: 970 MB, VmRSS: 188 MB, VmData: 220 MB, maxrss: 0.19286 MB Stage refs finished: 2020-08-05T19:38:55.588932 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.478 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:38:55.659645 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outlier-mask-custom-208513p44437.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outliers-pre-custom-208513p44437.jpg Image k4m_170430_071217_ooi_zd_ls9-CCD1 z : masking 795 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outlier-mask-custom-208513p44437.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outliers-post-custom-208513p44437.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outliers-masked-pos-custom-208513p44437.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outliers-masked-neg-custom-208513p44437.jpg Stage outliers : Wall: 1.15 s, CPU: 0.94 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.205876 MB Stage outliers finished: 2020-08-05T19:38:56.811318 Resources for stage outliers : 0.595 s worker CPU, 0.714 s worker Wall, Wall: 1.153 s, Cores in use: 1.33, Total efficiency (on 16 cores): 8.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:38:56.896052 Stage halos : Wall: 0.25 s, CPU: 0.25 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.206112 MB Stage halos finished: 2020-08-05T19:38:57.146420 Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.252 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:38:57.244239 PSF sigmas in coadd pixels: ['2.51', '3.20', '2.38'] Using average PSF sigma 2.6963992163211064 Gaussian PSF norm 0.10461907497464734 vs pixelized 0.08805672 average tim pixel scale / coadd scale: 1.7297236232854822 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.38', '2.35', '3.29'] Using average PSF sigma 2.671958111012117 Gaussian PSF norm 0.10557605323648687 vs pixelized 0.0860675 average tim pixel scale / coadd scale: 1.7296678372409962 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.88', '1.96', '1.44', '1.63'] Using average PSF sigma 1.7266841390524306 Gaussian PSF norm 0.16337370882939023 vs pixelized 0.13231957 average tim pixel scale / coadd scale: 0.990897390741734 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.14 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.208412 MB Stage fit_on_coadds finished: 2020-08-05T19:38:57.398895 Resources for stage fit_on_coadds : 0.154 s worker CPU, 0.154 s worker Wall, Wall: 0.156 s, Cores in use: 1.90, Total efficiency (on 16 cores): 11.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:38:57.408723 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 9 potential peaks Of 9 potential peaks: 1 in veto map, 0 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 11 potential peaks Of 11 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 11 potential peaks Of 11 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 17 potential peaks Of 17 potential peaks: 13 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 14 potential peaks Of 14 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 10 new sources Median coadd sky for g : 6.3392945e-05 Median coadd sky for r : 2.4056177e-05 Median coadd sky for z : 0.0001142527 Stage srcs : Wall: 0.74 s, CPU: 0.70 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.208972 MB Stage srcs finished: 2020-08-05T19:38:58.148066 Resources for stage srcs : 0.068 s worker CPU, 0.068 s worker Wall, Wall: 0.741 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:38:58.161670 Blob 1 of 9, id: 2, sources: 3, size: 90x122, npix 6955, brick X: 86,176, Y: 50,172, one pixel: 126 50 Blob 2 of 9, id: 5, sources: 2, size: 51x65, npix 2064, brick X: 166,217, Y: 169,234, one pixel: 184 169 Blob 3 of 9, id: 7, sources: 1, size: 31x40, npix 797, brick X: 216,247, Y: 207,247, one pixel: 239 207 Blob 4 of 9, id: 4, sources: 1, size: 30x29, npix 558, brick X: 160,190, Y: 145,174, one pixel: 173 145 Blob 5 of 9, id: 8, sources: 1, size: 26x26, npix 439, brick X: 12,38, Y: 218,244, one pixel: 23 218 Blob 6 of 9, id: 1, sources: 1, size: 26x24, npix 407, brick X: 190,216, Y: 31,55, one pixel: 201 31 Blob 7 of 9, id: 6, sources: 1, size: 25x26, npix 404, brick X: 10,35, Y: 188,214, one pixel: 23 188 Blob 8 of 9, id: 0, sources: 1, size: 25x25, npix 398, brick X: 124,149, Y: 12,37, one pixel: 133 12 Blob 9 of 9, id: 3, sources: 1, size: 19x19, npix 199, brick X: 45,64, Y: 53,72, one pixel: 53 53 Blob 9 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 786 MB, VmSize: 719 MB, VmRSS: 132 MB, VmData: 170 MB, maxrss: 0.134964 MB Blob 8 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 802 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149272 MB Blob 5 finished, total: Wall: 0.30 s, CPU: 0.29 s, VmPeak: 802 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1493 MB Blob 7 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.094752 MB Blob 6 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 805 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1499 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093268 MB Blob 3 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 802 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149452 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 1.45 s, CPU: 1.40 s, VmPeak: 806 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151228 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.74676, ee1=1.04019, ee2=0.54624 Measuring 2 iterative sources Blob 1 finished, total: Wall: 5.15 s, CPU: 5.14 s, VmPeak: 806 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151832 MB Old catalog: 12 New catalog: 14 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/blobs-custom-208513p44437.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/all-models-custom-208513p44437.fits Stage fitblobs : Wall: 5.58 s, CPU: 0.40 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.209136 MB Stage fitblobs finished: 2020-08-05T19:39:03.737305 Resources for stage fitblobs : 9.434 s worker CPU, 9.590 s worker Wall, Wall: 5.577 s, Cores in use: 1.76, Total efficiency (on 16 cores): 11.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:39:03.749924 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-resid.jpg Stage coadds : Wall: 2.29 s, CPU: 0.61 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 205 MB, VmData: 230 MB, maxrss: 0.209652 MB Stage coadds finished: 2020-08-05T19:39:06.041769 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.388 s worker CPU, 12.396 s worker Wall, Wall: 2.293 s, Cores in use: 3.92, Total efficiency (on 16 cores): 24.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:39:06.056695 Cut to 1 unWISE tiles Reading WISE tile 2080p439 band 1 Reading WISE tile 2080p439 band 3 Reading WISE tile 2080p439 band 4 Reading WISE tile 2080p439 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 804 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.18144 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 808 MB, VmSize: 798 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.202136 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 806 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.20728 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 807 MB, VmSize: 805 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.20954 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.16 s, CPU: 1.18 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 205 MB, VmData: 230 MB, maxrss: 0.21036 MB Stage wise_forced finished: 2020-08-05T19:39:09.213796 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.069 s worker CPU, 5.672 s worker Wall, Wall: 3.158 s, Cores in use: 1.35, Total efficiency (on 16 cores): 8.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-wise_forced.p Running stage writecat WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage writecat at 2020-08-05T19:39:09.238571 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/tractor-i/cus/tractor-custom-208513p44437.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/tractor/cus/tractor-custom-208513p44437.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/tractor/cus/brick-custom-208513p44437.sha256sum Stage writecat : Wall: 3.69 s, CPU: 2.09 s, VmPeak: 1112 MB, VmSize: 984 MB, VmRSS: 207 MB, VmData: 230 MB, maxrss: 0.343224 MB Stage writecat finished: 2020-08-05T19:39:12.930030 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.693 s, Cores in use: 0.57, Total efficiency (on 16 cores): 3.5 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-writecat.p All done: 26.963 s worker CPU, 85.949 s worker Wall, Wall: 47.648 s, Cores in use: 0.77, Total efficiency (on 16 cores): 4.8 % Finished galaxy PGC2244359 in 0.853 minutes. Started working on galaxy PGC2244359 at Wed Aug 5 20:23:09 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 208.513056 44.437116700000004 --width 247 --height 247 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:23:11.075950 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '208.513056', '44.437116700000004', '--width', '247', '--height', '247', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 208.513056 44.437116700000004 --width 247 --height 247 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 208.513056 44.437116700000004 Starting process 48142 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 48143 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 48144 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 48145 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 48146 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059344 MB Starting process 48147 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB Starting process 48148 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB Starting process 48149 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 48150 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 48151 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 48152 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 48153 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 48154 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 48155 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 48156 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 48157 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 48158 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 48159 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 48160 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 48161 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 48162 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 48163 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 48164 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 48166 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 48167 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 48165 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 48169 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 48168 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 48172 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 48170 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 48171 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 48173 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:23:11.976373 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 10 CCDs: k4m_160417_074023_ooi_zd_ls9-CCD3 z expnum 82762 exptime 120.103 propid 2016A-0453 seeing 1.16 MJD 57495.320 object MzLS_625553_z mosaic/CP/V4.3/CP20160416/k4m_160417_074023_ooi_zd_ls9.fits.fz k4m_160404_082829_ooi_zd_ls9-CCD1 z expnum 81039 exptime 80.104 propid 2016A-0453 seeing 1.21 MJD 57482.353 object MzLS_625554_z mosaic/CP/V4.3/CP20160403/k4m_160404_082829_ooi_zd_ls9.fits.fz k4m_160226_105702_ooi_zd_ls9-CCD2 z expnum 71017 exptime 80.105 propid 2016A-0453 seeing 0.89 MJD 57444.456 object MzLS_624657_z mosaic/CP/V4.3/CP20160225/k4m_160226_105702_ooi_zd_ls9.fits.fz k4m_170430_071217_ooi_zd_ls9-CCD1 z expnum 125290 exptime 115.104 propid 2016A-0453 seeing 1.00 MJD 57873.300 object MzLS_626449_z mosaic/CP/V4.3/CP20170429/k4m_170430_071217_ooi_zd_ls9.fits.fz ksb_160213_113826_ooi_g_ls9-CCD1 g expnum 74310233 exptime 66.6 propid 2015A-0801 seeing 1.54 MJD 57431.485 object 19521 90prime/CP/V2.3/CP20160212/ksb_160213_113826_ooi_g_ls9.fits.fz ksb_160413_083901_ooi_r_ls9-CCD1 r expnum 74910141 exptime 50.0 propid BASS seeing 1.46 MJD 57491.360 object 19521 90prime/CP/V2.3/CP20160412/ksb_160413_083901_ooi_r_ls9.fits.fz ksb_160513_053456_ooi_r_ls9-CCD3 r expnum 75210079 exptime 130.5 propid BASS seeing 1.45 MJD 57521.233 object 19522 90prime/CP/V2.3/CP20160512/ksb_160513_053456_ooi_r_ls9.fits.fz ksb_170517_063120_ooi_g_ls9-CCD3 g expnum 78900095 exptime 115.92 propid BASS seeing 1.97 MJD 57890.272 object 19522 90prime/CP/V2.3/CP20170516/ksb_170517_063120_ooi_g_ls9.fits.fz ksb_170324_094526_ooi_r_ls9-CCD4 r expnum 78360192 exptime 89.18 propid BASS seeing 2.03 MJD 57836.407 object 20773 90prime/CP/V2.3/CP20170323/ksb_170324_094526_ooi_r_ls9.fits.fz ksb_170327_083421_ooi_g_ls9-CCD4 g expnum 78390180 exptime 83.045 propid BASS seeing 1.46 MJD 57839.357 object 20773 90prime/CP/V2.3/CP20170326/ksb_170327_083421_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 4.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3321 3571 and amp range 2006 4053 and image y 4030 4072 and amp range 2040 4078 Range in image: x 0 251 , y 0 43 (with image size 251 x 43) dzp -0.0026360443 -> scaling image by 0.99757505842151 Faked up EXPNUM 74310233 Faked up EXPNUM 74310233 Faked up EXPNUM 74310233 90prime get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 546 692 and amp range 0 2015 and image y 2772 2916 and amp range 2048 4095 Range in image: x 0 147 , y 0 145 (with image size 147 x 145) dzp -0.0051191514 -> scaling image by 0.9952961850385206 mosaic get_fwhm: self.fwhm = 4.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3304 3554 and amp range 2006 4053 and image y 371 625 and amp range 0 2039 Range in image: x 0 251 , y 0 255 (with image size 251 x 255) dzp 0.001388291 -> scaling image by 1.0012794811153327 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78360192 Faked up EXPNUM 78360192 Faked up EXPNUM 78360192 90prime get_fwhm: self.fwhm = 4.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2371 2515 and amp range 2016 4031 and image y 2275 2419 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp 0.0004463038 -> scaling image by 1.0004111454932232 Faked up EXPNUM 74910141 Faked up EXPNUM 74910141 Faked up EXPNUM 74910141 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 545 691 and amp range 0 2015 and image y 2774 2918 and amp range 2048 4095 Range in image: x 0 147 , y 0 145 (with image size 147 x 145) dzp -0.00015519658 -> scaling image by 0.9998570688798908 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75210079 Faked up EXPNUM 75210079 Faked up EXPNUM 75210079 90prime get_fwhm: self.fwhm = 3.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2548 2692 and amp range 2016 4031 and image y 264 408 and amp range 0 2047 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp 0.004245165 -> scaling image by 1.0039175950705865 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1714 1966 and amp range 0 2047 and image y 888 1141 and amp range 0 2039 Range in image: x 0 253 , y 0 254 (with image size 253 x 254) dzp -0.006320339 -> scaling image by 0.9941956631368829 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78900095 Faked up EXPNUM 78900095 Faked up EXPNUM 78900095 90prime get_fwhm: self.fwhm = 4.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2607 2750 and amp range 2016 4031 and image y 288 431 and amp range 0 2047 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78390180 Faked up EXPNUM 78390180 Faked up EXPNUM 78390180 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2371 2515 and amp range 2016 4031 and image y 2295 2438 and amp range 2048 4095 Range in image: x 0 145 , y 0 144 (with image size 145 x 144) dzp -0.0030897402 -> scaling image by 0.9971582894587289 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 578 831 and amp range 0 2005 and image y 2851 3101 and amp range 2040 4078 Range in image: x 0 254 , y 0 251 (with image size 254 x 251) dzp 0.032569118 -> scaling image by 1.0304517167935139 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 6.52 s, CPU: 1.15 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.17898 MB Stage tims finished: 2020-08-05T20:23:18.499724 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.438 s worker CPU, 20.558 s worker Wall, Wall: 6.526 s, Cores in use: 1.01, Total efficiency (on 32 cores): 3.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:23:18.668068 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01809.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01931.fits Matched 9 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/reference-custom-208513p44437.fits Stage refs : Wall: 3.85 s, CPU: 2.57 s, VmPeak: 988 MB, VmSize: 970 MB, VmRSS: 188 MB, VmData: 220 MB, maxrss: 0.192824 MB Stage refs finished: 2020-08-05T20:23:22.520624 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 3.855 s, Cores in use: 0.67, Total efficiency (on 32 cores): 2.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:23:22.596553 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outlier-mask-custom-208513p44437.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outliers-pre-custom-208513p44437.jpg Image k4m_170430_071217_ooi_zd_ls9-CCD1 z : masking 795 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outlier-mask-custom-208513p44437.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outliers-post-custom-208513p44437.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outliers-masked-pos-custom-208513p44437.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/outliers-masked-neg-custom-208513p44437.jpg Stage outliers : Wall: 1.76 s, CPU: 1.03 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.206628 MB Stage outliers finished: 2020-08-05T20:23:24.356675 Resources for stage outliers : 0.721 s worker CPU, 1.483 s worker Wall, Wall: 1.762 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:23:24.527483 Stage halos : Wall: 1.63 s, CPU: 1.63 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.206836 MB Stage halos finished: 2020-08-05T20:23:26.157946 Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.633 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:23:26.232949 PSF sigmas in coadd pixels: ['2.51', '3.20', '2.38'] Using average PSF sigma 2.6963992163211064 Gaussian PSF norm 0.10461907497464734 vs pixelized 0.08805672 average tim pixel scale / coadd scale: 1.7297236232854822 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.38', '2.35', '3.29'] Using average PSF sigma 2.671958111012117 Gaussian PSF norm 0.10557605323648687 vs pixelized 0.086067505 average tim pixel scale / coadd scale: 1.7296678372409962 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.88', '1.96', '1.44', '1.63'] Using average PSF sigma 1.7266841390524306 Gaussian PSF norm 0.16337370882939023 vs pixelized 0.13231957 average tim pixel scale / coadd scale: 0.990897390741734 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.28 s, CPU: 0.14 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 204 MB, VmData: 231 MB, maxrss: 0.20938 MB Stage fit_on_coadds finished: 2020-08-05T20:23:26.508385 Resources for stage fit_on_coadds : 0.135 s worker CPU, 0.135 s worker Wall, Wall: 0.278 s, Cores in use: 1.02, Total efficiency (on 32 cores): 3.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:23:26.538305 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 9 potential peaks Of 9 potential peaks: 1 in veto map, 0 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 11 potential peaks Of 11 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 11 potential peaks Of 11 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 17 potential peaks Of 17 potential peaks: 13 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 14 potential peaks Of 14 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 10 new sources Median coadd sky for g : 6.3392945e-05 Median coadd sky for r : 2.4056211e-05 Median coadd sky for z : 0.0001142527 Stage srcs : Wall: 1.65 s, CPU: 1.53 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.2098 MB Stage srcs finished: 2020-08-05T20:23:28.187482 Resources for stage srcs : 0.098 s worker CPU, 0.098 s worker Wall, Wall: 1.651 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:23:28.210068 Blob 1 of 9, id: 2, sources: 3, size: 90x122, npix 6955, brick X: 86,176, Y: 50,172, one pixel: 126 50 Blob 2 of 9, id: 5, sources: 2, size: 51x65, npix 2064, brick X: 166,217, Y: 169,234, one pixel: 184 169 Blob 3 of 9, id: 7, sources: 1, size: 31x40, npix 797, brick X: 216,247, Y: 207,247, one pixel: 239 207 Blob 4 of 9, id: 4, sources: 1, size: 30x29, npix 558, brick X: 160,190, Y: 145,174, one pixel: 173 145 Blob 5 of 9, id: 8, sources: 1, size: 26x26, npix 439, brick X: 12,38, Y: 218,244, one pixel: 23 218 Blob 6 of 9, id: 1, sources: 1, size: 26x24, npix 407, brick X: 190,216, Y: 31,55, one pixel: 201 31 Blob 7 of 9, id: 6, sources: 1, size: 25x26, npix 404, brick X: 10,35, Y: 188,214, one pixel: 23 188 Blob 8 of 9, id: 0, sources: 1, size: 25x25, npix 398, brick X: 124,149, Y: 12,37, one pixel: 133 12 Blob 9 of 9, id: 3, sources: 1, size: 19x19, npix 199, brick X: 45,64, Y: 53,72, one pixel: 53 53 Blob 9 finished, total: Wall: 0.09 s, CPU: 0.07 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149132 MB Blob 8 finished, total: Wall: 0.21 s, CPU: 0.20 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094232 MB Blob 7 finished, total: Wall: 0.31 s, CPU: 0.30 s, VmPeak: 802 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149148 MB Blob 5 finished, total: Wall: 0.34 s, CPU: 0.33 s, VmPeak: 802 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149216 MB Blob 6 finished, total: Wall: 0.45 s, CPU: 0.44 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.093968 MB Blob 4 finished, total: Wall: 0.62 s, CPU: 0.61 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.095928 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 0.85 s, CPU: 0.84 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149804 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 1.37 s, CPU: 1.35 s, VmPeak: 807 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151532 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.74676, ee1=1.04019, ee2=0.54624 Measuring 2 iterative sources Blob 1 finished, total: Wall: 5.72 s, CPU: 5.72 s, VmPeak: 675 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.102968 MB Old catalog: 12 New catalog: 14 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/blobs-custom-208513p44437.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/metrics/cus/all-models-custom-208513p44437.fits Stage fitblobs : Wall: 6.95 s, CPU: 1.12 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.209964 MB Stage fitblobs finished: 2020-08-05T20:23:35.156541 Resources for stage fitblobs : 9.999 s worker CPU, 10.579 s worker Wall, Wall: 6.949 s, Cores in use: 1.60, Total efficiency (on 32 cores): 5.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:23:35.171600 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-resid.jpg Stage coadds : Wall: 3.97 s, CPU: 1.25 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 206 MB, VmData: 231 MB, maxrss: 0.210476 MB Stage coadds finished: 2020-08-05T20:23:39.137749 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 25.039 s worker CPU, 47.930 s worker Wall, Wall: 3.969 s, Cores in use: 6.63, Total efficiency (on 32 cores): 20.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:23:39.179458 Cut to 1 unWISE tiles Reading WISE tile 2080p439 band 1 Reading WISE tile 2080p439 band 2 Reading WISE tile 2080p439 band 3 Reading WISE tile 2080p439 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 809 MB, VmSize: 808 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.194448 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.209924 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 807 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 179 MB, maxrss: 0.199656 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2080p439/unwise-2080p439-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 808 MB, VmSize: 798 MB, VmRSS: 139 MB, VmData: 170 MB, maxrss: 0.201812 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/tmp-legacysurvey-custom-208513p44437-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.94 s, CPU: 0.92 s, VmPeak: 988 MB, VmSize: 980 MB, VmRSS: 206 MB, VmData: 231 MB, maxrss: 0.211188 MB Stage wise_forced finished: 2020-08-05T20:23:42.119698 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.214 s worker CPU, 6.746 s worker Wall, Wall: 2.943 s, Cores in use: 1.41, Total efficiency (on 32 cores): 4.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:23:42.137742 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/coadd/cus/custom-208513p44437/legacysurvey-custom-208513p44437-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/tractor-i/cus/tractor-custom-208513p44437.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/tractor/cus/tractor-custom-208513p44437.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/tractor/cus/brick-custom-208513p44437.sha256sum Stage writecat : Wall: 2.38 s, CPU: 1.31 s, VmPeak: 1112 MB, VmSize: 984 MB, VmRSS: 208 MB, VmData: 231 MB, maxrss: 0.34418 MB Stage writecat finished: 2020-08-05T20:23:44.522544 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.387 s, Cores in use: 0.55, Total efficiency (on 32 cores): 1.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/208/PGC2244359/PGC2244359-largegalaxy-writecat.p All done: 44.649 s worker CPU, 87.536 s worker Wall, Wall: 32.573 s, Cores in use: 1.76, Total efficiency (on 32 cores): 5.5 % Finished galaxy PGC2244359 in 0.595 minutes.