Started working on galaxy PGC050656 at Wed Aug 5 19:13:08 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.8182585 -3.5206413 --width 235 --height 235 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:13:12.866978 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '212.8182585', '-3.5206413', '--width', '235', '--height', '235', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.8182585 -3.5206413 --width 235 --height 235 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 212.8182585 -3.5206413 Starting process 33315 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 33316 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 33317 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 33318 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 33319 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 33320 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 33321 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 33322 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 33323 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 33324 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 33325 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 33326 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 33327 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 33329 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 33330 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 33328 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:13:13.379770 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 9 CCDs: c4d_170303_080732_ooi_g_ls9-N16 g expnum 625451 exptime 85.0 propid 2014B-0404 seeing 0.98 MJD 57815.337 object DECaLS_1304_g decam/CP/V4.8.2/CP20170302/c4d_170303_080732_ooi_g_ls9.fits.fz c4d_150110_075429_ooi_z_ls9-N16 z expnum 396445 exptime 90.0 propid 2014B-0404 seeing 1.10 MJD 57032.328 object DECaLS_1304_z decam/CP/V4.8.2a/CP20150109/c4d_150110_075429_ooi_z_ls9.fits.fz c4d_170303_080536_ooi_r_ls9-N16 r expnum 625450 exptime 47.0 propid 2014B-0404 seeing 0.85 MJD 57815.336 object DECaLS_1304_r decam/CP/V4.8.2/CP20170302/c4d_170303_080536_ooi_r_ls9.fits.fz c4d_160609_000015_ooi_z_ls9-N9 z expnum 548198 exptime 82.0 propid 2014B-0404 seeing 1.02 MJD 57547.999 object DECaLS_17176_z decam/CP/V4.8.2a/CP20160608/c4d_160609_000015_ooi_z_ls9.fits.fz c4d_170401_083751_ooi_r_ls9-N9 r expnum 636062 exptime 88.0 propid 2014B-0404 seeing 1.31 MJD 57844.358 object DECaLS_33048_r decam/CP/V4.8.2/CP20170331/c4d_170401_083751_ooi_r_ls9.fits.fz c4d_170503_053904_ooi_g_ls9-N9 g expnum 646591 exptime 126.0 propid 2014B-0404 seeing 1.10 MJD 57876.233 object DECaLS_33048_g decam/CP/V4.8.2/CP20170502/c4d_170503_053904_ooi_g_ls9.fits.fz c4d_160721_030954_ooi_z_ls9-N9 z expnum 553461 exptime 240.0 propid 2016A-0190 seeing 1.44 MJD 57590.129 object DECaLS_33048_z decam/CP/V4.8.2a/CP20160720/c4d_160721_030954_ooi_z_ls9.fits.fz c4d_160408_060104_ooi_g_ls9-N10 g expnum 535259 exptime 114.0 propid 2014B-0404 seeing 1.36 MJD 57486.249 object DECaLS_17176_g decam/CP/V4.8.2a/CP20160407/c4d_160408_060104_ooi_g_ls9.fits.fz c4d_160410_052010_ooi_r_ls9-N10 r expnum 536024 exptime 70.0 propid 2014B-0404 seeing 1.36 MJD 57488.221 object DECaLS_17176_r decam/CP/V4.8.2a/CP20160409/c4d_160410_052010_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f1c8-r-20170303T080401_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95176d0-r-20170401T083532_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb50-z-20160608T235805_oi[N9,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563f3b-z-20150110T075209_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c7e7-z-20160721T030503_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160408T055819_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ee1d-g-20170303T080517_oi[N16,noinherit][2046,4094][real]: DECaLS_ Clipping 1 pixels with anomalously large oow values: max 0.0461014 vs median 0.0354224 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956cfb1-r-20160410T051801_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518570-g-20170503T053609_oi[N9,noinherit][2046,4094][real]: DECaLS_3 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 27.02 s, CPU: 0.95 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.179524 MB Stage tims finished: 2020-08-05T19:13:40.399028 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563f3b-z-20150110T075209_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956cfb1-r-20160410T051801_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb50-z-20160608T235805_oi[N9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160408T055819_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ee1d-g-20170303T080517_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518570-g-20170503T053609_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.576 s worker CPU, 187.146 s worker Wall, Wall: 27.021 s, Cores in use: 0.24, Total efficiency (on 16 cores): 1.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c7e7-z-20160721T030503_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95176d0-r-20170401T083532_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f1c8-r-20170303T080401_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:13:40.444835 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06411.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06667.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06540.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/reference-custom-212818m03520.fits Stage refs : Wall: 6.45 s, CPU: 2.94 s, VmPeak: 1042 MB, VmSize: 1032 MB, VmRSS: 198 MB, VmData: 229 MB, maxrss: 0.20224 MB Stage refs finished: 2020-08-05T19:13:46.898178 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.455 s, Cores in use: 0.46, Total efficiency (on 16 cores): 2.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:13:46.980488 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outlier-mask-custom-212818m03520.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outliers-pre-custom-212818m03520.jpg Image c4d_170303_080732_ooi_g_ls9-N16 g : masking 290 positive outlier pixels and 0 negative outlier pixels Image c4d_160410_052010_ooi_r_ls9-N10 r : masking 0 positive outlier pixels and 66 negative outlier pixels Image c4d_170401_083751_ooi_r_ls9-N9 r : masking 91 positive outlier pixels and 0 negative outlier pixels Image c4d_160721_030954_ooi_z_ls9-N9 z : masking 422 positive outlier pixels and 0 negative outlier pixels Image c4d_150110_075429_ooi_z_ls9-N16 z : masking 65 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outlier-mask-custom-212818m03520.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outliers-post-custom-212818m03520.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outliers-masked-pos-custom-212818m03520.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outliers-masked-neg-custom-212818m03520.jpg Stage outliers : Wall: 1.55 s, CPU: 1.15 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.214856 MB Stage outliers finished: 2020-08-05T19:13:48.533106 Resources for stage outliers : 0.572 s worker CPU, 0.633 s worker Wall, Wall: 1.554 s, Cores in use: 1.11, Total efficiency (on 16 cores): 6.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:13:48.618882 Stage halos : Wall: 1.84 s, CPU: 1.38 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.215072 MB Stage halos finished: 2020-08-05T19:13:50.457845 Resources for stage halos : 0.221 s worker CPU, 1.741 s worker Wall, Wall: 1.840 s, Cores in use: 0.87, Total efficiency (on 16 cores): 5.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:13:55.646302 PSF sigmas in coadd pixels: ['1.59', '1.79', '2.21'] Using average PSF sigma 1.8625546551498875 Gaussian PSF norm 0.15145584640638468 vs pixelized 0.12968922 average tim pixel scale / coadd scale: 1.0011045289766185 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.37', '2.13', '2.21'] Using average PSF sigma 1.9062002397726001 Gaussian PSF norm 0.14798801610030782 vs pixelized 0.11777039 average tim pixel scale / coadd scale: 1.001159615196174 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.79', '1.66', '2.33'] Using average PSF sigma 1.9280762108381653 Gaussian PSF norm 0.14630894265909078 vs pixelized 0.12436848 average tim pixel scale / coadd scale: 1.0012468600375506 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.14 s, CPU: 0.12 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.216664 MB Stage fit_on_coadds finished: 2020-08-05T19:13:55.787509 Resources for stage fit_on_coadds : 0.110 s worker CPU, 0.111 s worker Wall, Wall: 0.143 s, Cores in use: 1.61, Total efficiency (on 16 cores): 10.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:13:55.798786 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 12 potential peaks Of 12 potential peaks: 1 in veto map, 1 cut by saddle test, 0 cut by aper test, 10 kept SED z : 10 new peaks Found 22 potential peaks Of 22 potential peaks: 17 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 33 potential peaks Of 33 potential peaks: 15 in veto map, 4 cut by saddle test, 0 cut by aper test, 14 kept SED g : 14 new peaks Found 39 potential peaks Of 39 potential peaks: 30 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 37 potential peaks Of 37 potential peaks: 30 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 30 new sources Median coadd sky for g : 9.192625e-06 Median coadd sky for r : 8.421225e-05 Median coadd sky for z : 0.00021091799 Stage srcs : Wall: 0.83 s, CPU: 0.78 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.217068 MB Stage srcs finished: 2020-08-05T19:13:56.624579 Resources for stage srcs : 0.064 s worker CPU, 0.064 s worker Wall, Wall: 0.827 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:13:56.637827 Blob 1 of 16, id: 0, sources: 8, size: 98x171, npix 10533, brick X: 69,167, Y: 4,175, one pixel: 106 4 Blob 2 of 16, id: 5, sources: 6, size: 61x66, npix 1710, brick X: 170,231, Y: 87,153, one pixel: 193 87 Blob 3 of 16, id: 13, sources: 3, size: 49x43, npix 1235, brick X: 77,126, Y: 179,222, one pixel: 95 179 Blob 4 of 16, id: 11, sources: 1, size: 29x30, npix 598, brick X: 17,46, Y: 172,202, one pixel: 28 172 Blob 5 of 16, id: 4, sources: 1, size: 26x25, npix 428, brick X: 29,55, Y: 52,77, one pixel: 39 52 Blob 6 of 16, id: 12, sources: 2, size: 29x29, npix 420, brick X: 174,203, Y: 173,202, one pixel: 193 173 Blob 7 of 16, id: 6, sources: 1, size: 24x23, npix 367, brick X: 15,39, Y: 102,125, one pixel: 27 102 Blob 8 of 16, id: 9, sources: 1, size: 23x22, npix 295, brick X: 209,232, Y: 142,164, one pixel: 220 142 Blob 9 of 16, id: 3, sources: 1, size: 22x22, npix 294, brick X: 0,22, Y: 51,73, one pixel: 9 51 Blob 10 of 16, id: 14, sources: 1, size: 22x20, npix 259, brick X: 54,76, Y: 182,202, one pixel: 63 182 Blob 11 of 16, id: 8, sources: 1, size: 20x20, npix 229, brick X: 42,62, Y: 133,153, one pixel: 51 133 Blob 12 of 16, id: 1, sources: 1, size: 19x20, npix 227, brick X: 215,234, Y: 27,47, one pixel: 223 27 Blob 13 of 16, id: 7, sources: 1, size: 19x19, npix 208, brick X: 205,224, Y: 127,146, one pixel: 213 127 Blob 14 of 16, id: 10, sources: 1, size: 19x18, npix 189, brick X: 204,223, Y: 171,189, one pixel: 213 171 Blob 15 of 16, id: 2, sources: 1, size: 18x18, npix 171, brick X: 177,195, Y: 48,66, one pixel: 185 48 Blob 16 of 16, id: 15, sources: 1, size: 14x20, npix 170, brick X: 0,14, Y: 202,222, one pixel: 4 202 Blob 14 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 138 MB, maxrss: 0.088384 MB Blob 8 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 110 MB, VmData: 165 MB, maxrss: 0.112724 MB Blob 12 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 944 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14762 MB Blob 9 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 109 MB, VmData: 164 MB, maxrss: 0.112052 MB Blob 15 finished, total: Wall: 0.38 s, CPU: 0.31 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148416 MB Blob 7 finished, total: Wall: 0.68 s, CPU: 0.67 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14772 MB Blob 6 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147472 MB Blob 4 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 110 MB, VmData: 165 MB, maxrss: 0.112496 MB Blob 5 finished, total: Wall: 0.85 s, CPU: 0.84 s, VmPeak: 936 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149352 MB Blob 16 finished, total: Wall: 0.85 s, CPU: 0.77 s, VmPeak: 937 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14834 MB Blob 11 finished, total: Wall: 0.90 s, CPU: 0.84 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14816 MB Blob 10 finished, total: Wall: 0.97 s, CPU: 0.95 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148372 MB Blob 13 finished, total: Wall: 0.99 s, CPU: 0.94 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149048 MB Blob 3 finished, total: Wall: 2.07 s, CPU: 2.07 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 112 MB, VmData: 166 MB, maxrss: 0.11472 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 2.52 s, CPU: 2.52 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095132 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.04608, ee1=0.0917183, ee2=-0.229979 Measuring 10 iterative sources Blob 1 finished, total: Wall: 16.61 s, CPU: 16.61 s, VmPeak: 697 MB, VmSize: 697 MB, VmRSS: 126 MB, VmData: 168 MB, maxrss: 0.129488 MB Old catalog: 35 New catalog: 26 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/blobs-custom-212818m03520.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/all-models-custom-212818m03520.fits Stage fitblobs : Wall: 17.26 s, CPU: 0.61 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.217236 MB Stage fitblobs finished: 2020-08-05T19:14:13.894283 Resources for stage fitblobs : 29.369 s worker CPU, 29.768 s worker Wall, Wall: 17.258 s, Cores in use: 1.74, Total efficiency (on 16 cores): 10.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:14:13.910403 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-resid.jpg Stage coadds : Wall: 3.56 s, CPU: 1.40 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 213 MB, VmData: 238 MB, maxrss: 0.217748 MB Stage coadds finished: 2020-08-05T19:14:17.471443 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 11.215 s worker CPU, 17.302 s worker Wall, Wall: 3.562 s, Cores in use: 3.54, Total efficiency (on 16 cores): 22.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:14:17.490654 Cut to 1 unWISE tiles Reading WISE tile 2132m031 band 3 Reading WISE tile 2132m031 band 2 Reading WISE tile 2132m031 band 1 Reading WISE tile 2132m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 940 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 176 MB, maxrss: 0.192304 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.208172 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 940 MB, VmSize: 806 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.20788 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 940 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.209124 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.61 s, CPU: 1.42 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 213 MB, VmData: 238 MB, maxrss: 0.218456 MB Stage wise_forced finished: 2020-08-05T19:14:23.100049 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.224 s worker CPU, 7.745 s worker Wall, Wall: 5.611 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-wise_forced.p Running stage writecat WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage writecat at 2020-08-05T19:14:23.118252 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/tractor-i/cus/tractor-custom-212818m03520.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/tractor/cus/tractor-custom-212818m03520.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/tractor/cus/brick-custom-212818m03520.sha256sum Stage writecat : Wall: 1.13 s, CPU: 0.92 s, VmPeak: 1174 MB, VmSize: 1046 MB, VmRSS: 215 MB, VmData: 238 MB, maxrss: 0.35146 MB Stage writecat finished: 2020-08-05T19:14:24.245090 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.128 s, Cores in use: 0.82, Total efficiency (on 16 cores): 5.1 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-writecat.p All done: 50.354 s worker CPU, 244.514 s worker Wall, Wall: 70.897 s, Cores in use: 0.88, Total efficiency (on 16 cores): 5.5 % Finished galaxy PGC050656 in 1.268 minutes. Started working on galaxy PGC050656 at Wed Aug 5 19:26:45 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.8182585 -3.5206413 --width 235 --height 235 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:26:47.629791 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '212.8182585', '-3.5206413', '--width', '235', '--height', '235', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.8182585 -3.5206413 --width 235 --height 235 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 212.8182585 -3.5206413 Starting process 36398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 36399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 36400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 36401 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 36402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 36403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 36404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 36405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 36406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 36407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 36408 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 36409 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 36410 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 36411 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 36412 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 36413 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 36414 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 36415 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 36416 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 36417 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 36418 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 36419 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 36420 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 36421 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 36422 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 36423 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 36424 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 36425 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 36427 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 36428 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 36426 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 36429 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:26:48.997953 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 9 CCDs: c4d_170303_080732_ooi_g_ls9-N16 g expnum 625451 exptime 85.0 propid 2014B-0404 seeing 0.98 MJD 57815.337 object DECaLS_1304_g decam/CP/V4.8.2/CP20170302/c4d_170303_080732_ooi_g_ls9.fits.fz c4d_150110_075429_ooi_z_ls9-N16 z expnum 396445 exptime 90.0 propid 2014B-0404 seeing 1.10 MJD 57032.328 object DECaLS_1304_z decam/CP/V4.8.2a/CP20150109/c4d_150110_075429_ooi_z_ls9.fits.fz c4d_170303_080536_ooi_r_ls9-N16 r expnum 625450 exptime 47.0 propid 2014B-0404 seeing 0.85 MJD 57815.336 object DECaLS_1304_r decam/CP/V4.8.2/CP20170302/c4d_170303_080536_ooi_r_ls9.fits.fz c4d_160609_000015_ooi_z_ls9-N9 z expnum 548198 exptime 82.0 propid 2014B-0404 seeing 1.02 MJD 57547.999 object DECaLS_17176_z decam/CP/V4.8.2a/CP20160608/c4d_160609_000015_ooi_z_ls9.fits.fz c4d_170401_083751_ooi_r_ls9-N9 r expnum 636062 exptime 88.0 propid 2014B-0404 seeing 1.31 MJD 57844.358 object DECaLS_33048_r decam/CP/V4.8.2/CP20170331/c4d_170401_083751_ooi_r_ls9.fits.fz c4d_170503_053904_ooi_g_ls9-N9 g expnum 646591 exptime 126.0 propid 2014B-0404 seeing 1.10 MJD 57876.233 object DECaLS_33048_g decam/CP/V4.8.2/CP20170502/c4d_170503_053904_ooi_g_ls9.fits.fz c4d_160721_030954_ooi_z_ls9-N9 z expnum 553461 exptime 240.0 propid 2016A-0190 seeing 1.44 MJD 57590.129 object DECaLS_33048_z decam/CP/V4.8.2a/CP20160720/c4d_160721_030954_ooi_z_ls9.fits.fz c4d_160408_060104_ooi_g_ls9-N10 g expnum 535259 exptime 114.0 propid 2014B-0404 seeing 1.36 MJD 57486.249 object DECaLS_17176_g decam/CP/V4.8.2a/CP20160407/c4d_160408_060104_ooi_g_ls9.fits.fz c4d_160410_052010_ooi_r_ls9-N10 r expnum 536024 exptime 70.0 propid 2014B-0404 seeing 1.36 MJD 57488.221 object DECaLS_17176_r decam/CP/V4.8.2a/CP20160409/c4d_160410_052010_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f1c8-r-20170303T080401_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563f3b-z-20150110T075209_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c7e7-z-20160721T030503_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95176d0-r-20170401T083532_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956cfb1-r-20160410T051801_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160408T055819_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518570-g-20170503T053609_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb50-z-20160608T235805_oi[N9,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ee1d-g-20170303T080517_oi[N16,noinherit][2046,4094][real]: DECaLS_ Clipping 1 pixels with anomalously large oow values: max 0.0461014 vs median 0.0354224 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 28.00 s, CPU: 1.28 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.179356 MB Stage tims finished: 2020-08-05T19:27:17.002451 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563f3b-z-20150110T075209_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95176d0-r-20170401T083532_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518570-g-20170503T053609_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160408T055819_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ee1d-g-20170303T080517_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb50-z-20160608T235805_oi[N9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.489 s worker CPU, 201.911 s worker Wall, Wall: 28.007 s, Cores in use: 0.24, Total efficiency (on 32 cores): 0.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f1c8-r-20170303T080401_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c7e7-z-20160721T030503_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956cfb1-r-20160410T051801_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:27:17.344135 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06411.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06667.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06540.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/reference-custom-212818m03520.fits Stage refs : Wall: 7.15 s, CPU: 2.60 s, VmPeak: 1042 MB, VmSize: 1032 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.201916 MB Stage refs finished: 2020-08-05T19:27:24.493569 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 7.152 s, Cores in use: 0.36, Total efficiency (on 32 cores): 1.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:27:24.630626 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outlier-mask-custom-212818m03520.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outliers-pre-custom-212818m03520.jpg Image c4d_170303_080732_ooi_g_ls9-N16 g : masking 290 positive outlier pixels and 0 negative outlier pixels Image c4d_160410_052010_ooi_r_ls9-N10 r : masking 0 positive outlier pixels and 66 negative outlier pixels Image c4d_170401_083751_ooi_r_ls9-N9 r : masking 91 positive outlier pixels and 0 negative outlier pixels Image c4d_160721_030954_ooi_z_ls9-N9 z : masking 422 positive outlier pixels and 0 negative outlier pixels Image c4d_150110_075429_ooi_z_ls9-N16 z : masking 65 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outlier-mask-custom-212818m03520.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outliers-post-custom-212818m03520.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outliers-masked-pos-custom-212818m03520.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/outliers-masked-neg-custom-212818m03520.jpg Stage outliers : Wall: 1.22 s, CPU: 0.85 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.214756 MB Stage outliers finished: 2020-08-05T19:27:25.846917 Resources for stage outliers : 0.695 s worker CPU, 0.865 s worker Wall, Wall: 1.218 s, Cores in use: 1.27, Total efficiency (on 32 cores): 4.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:27:25.923760 Stage halos : Wall: 1.94 s, CPU: 1.11 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.215016 MB Stage halos finished: 2020-08-05T19:27:27.868219 Resources for stage halos : 0.273 s worker CPU, 2.585 s worker Wall, Wall: 1.947 s, Cores in use: 0.71, Total efficiency (on 32 cores): 2.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:27:28.021377 PSF sigmas in coadd pixels: ['1.59', '1.79', '2.21'] Using average PSF sigma 1.8625546551498875 Gaussian PSF norm 0.15145584640638468 vs pixelized 0.12968922 average tim pixel scale / coadd scale: 1.0011045289766185 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.37', '2.13', '2.21'] Using average PSF sigma 1.9062002397726001 Gaussian PSF norm 0.14798801610030782 vs pixelized 0.11777039 average tim pixel scale / coadd scale: 1.001159615196174 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.79', '1.66', '2.33'] Using average PSF sigma 1.9280762108381653 Gaussian PSF norm 0.14630894265909078 vs pixelized 0.12436848 average tim pixel scale / coadd scale: 1.0012468600375506 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.12 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.216608 MB Stage fit_on_coadds finished: 2020-08-05T19:27:28.172585 Resources for stage fit_on_coadds : 0.106 s worker CPU, 0.107 s worker Wall, Wall: 0.153 s, Cores in use: 1.46, Total efficiency (on 32 cores): 4.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:27:28.187985 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 12 potential peaks Of 12 potential peaks: 1 in veto map, 1 cut by saddle test, 0 cut by aper test, 10 kept SED z : 10 new peaks Found 22 potential peaks Of 22 potential peaks: 17 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 33 potential peaks Of 33 potential peaks: 15 in veto map, 4 cut by saddle test, 0 cut by aper test, 14 kept SED g : 14 new peaks Found 39 potential peaks Of 39 potential peaks: 30 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 37 potential peaks Of 37 potential peaks: 30 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 30 new sources Median coadd sky for g : 9.192616e-06 Median coadd sky for r : 8.421225e-05 Median coadd sky for z : 0.00021091799 Stage srcs : Wall: 1.16 s, CPU: 1.11 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.217012 MB Stage srcs finished: 2020-08-05T19:27:29.349644 Resources for stage srcs : 0.068 s worker CPU, 0.069 s worker Wall, Wall: 1.164 s, Cores in use: 1.01, Total efficiency (on 32 cores): 3.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:27:29.368616 Blob 1 of 16, id: 0, sources: 8, size: 98x171, npix 10533, brick X: 69,167, Y: 4,175, one pixel: 106 4 Blob 2 of 16, id: 5, sources: 6, size: 61x66, npix 1710, brick X: 170,231, Y: 87,153, one pixel: 193 87 Blob 3 of 16, id: 13, sources: 3, size: 49x43, npix 1235, brick X: 77,126, Y: 179,222, one pixel: 95 179 Blob 4 of 16, id: 11, sources: 1, size: 29x30, npix 598, brick X: 17,46, Y: 172,202, one pixel: 28 172 Blob 5 of 16, id: 4, sources: 1, size: 26x25, npix 428, brick X: 29,55, Y: 52,77, one pixel: 39 52 Blob 6 of 16, id: 12, sources: 2, size: 29x29, npix 420, brick X: 174,203, Y: 173,202, one pixel: 193 173 Blob 7 of 16, id: 6, sources: 1, size: 24x23, npix 367, brick X: 15,39, Y: 102,125, one pixel: 27 102 Blob 8 of 16, id: 9, sources: 1, size: 23x22, npix 295, brick X: 209,232, Y: 142,164, one pixel: 220 142 Blob 9 of 16, id: 3, sources: 1, size: 22x22, npix 294, brick X: 0,22, Y: 51,73, one pixel: 9 51 Blob 10 of 16, id: 14, sources: 1, size: 22x20, npix 259, brick X: 54,76, Y: 182,202, one pixel: 63 182 Blob 11 of 16, id: 8, sources: 1, size: 20x20, npix 229, brick X: 42,62, Y: 133,153, one pixel: 51 133 Blob 12 of 16, id: 1, sources: 1, size: 19x20, npix 227, brick X: 215,234, Y: 27,47, one pixel: 223 27 Blob 13 of 16, id: 7, sources: 1, size: 19x19, npix 208, brick X: 205,224, Y: 127,146, one pixel: 213 127 Blob 14 of 16, id: 10, sources: 1, size: 19x18, npix 189, brick X: 204,223, Y: 171,189, one pixel: 213 171 Blob 15 of 16, id: 2, sources: 1, size: 18x18, npix 171, brick X: 177,195, Y: 48,66, one pixel: 185 48 Blob 16 of 16, id: 15, sources: 1, size: 14x20, npix 170, brick X: 0,14, Y: 202,222, one pixel: 4 202 Blob 14 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 139 MB, maxrss: 0.087824 MB Blob 8 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.11394 MB Blob 12 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147908 MB Blob 15 finished, total: Wall: 0.23 s, CPU: 0.22 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147404 MB Blob 9 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 109 MB, VmData: 164 MB, maxrss: 0.11186 MB Blob 6 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092324 MB Blob 5 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.0931 MB Blob 7 finished, total: Wall: 0.61 s, CPU: 0.60 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.113264 MB Blob 16 finished, total: Wall: 0.60 s, CPU: 0.59 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.11362 MB Blob 11 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092668 MB Blob 10 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092268 MB Blob 4 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092696 MB Blob 13 finished, total: Wall: 0.75 s, CPU: 0.74 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094708 MB Measuring 2 iterative sources Blob 3 finished, total: Wall: 1.93 s, CPU: 1.93 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093784 MB Blob 2 finished, total: Wall: 2.28 s, CPU: 2.28 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.113748 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.04608, ee1=0.0917183, ee2=-0.229979 Measuring 10 iterative sources Blob 1 finished, total: Wall: 17.37 s, CPU: 17.36 s, VmPeak: 686 MB, VmSize: 683 MB, VmRSS: 109 MB, VmData: 154 MB, maxrss: 0.114872 MB Old catalog: 35 New catalog: 26 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/blobs-custom-212818m03520.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/metrics/cus/all-models-custom-212818m03520.fits Stage fitblobs : Wall: 18.41 s, CPU: 0.96 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.217176 MB Stage fitblobs finished: 2020-08-05T19:27:47.778499 Resources for stage fitblobs : 27.789 s worker CPU, 27.959 s worker Wall, Wall: 18.412 s, Cores in use: 1.56, Total efficiency (on 32 cores): 4.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:27:47.820089 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-resid.jpg Stage coadds : Wall: 6.62 s, CPU: 3.59 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 213 MB, VmData: 238 MB, maxrss: 0.217696 MB Stage coadds finished: 2020-08-05T19:27:54.441382 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 29.020 s worker CPU, 54.954 s worker Wall, Wall: 6.624 s, Cores in use: 4.92, Total efficiency (on 32 cores): 15.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:27:54.474424 Cut to 1 unWISE tiles Reading WISE tile 2132m031 band 1 Reading WISE tile 2132m031 band 3 Reading WISE tile 2132m031 band 4 Reading WISE tile 2132m031 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 955 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.2109 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 802 MB, VmSize: 802 MB, VmRSS: 142 MB, VmData: 174 MB, maxrss: 0.181204 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 862 MB, VmSize: 862 MB, VmRSS: 203 MB, VmData: 234 MB, maxrss: 0.207972 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 937 MB, VmSize: 810 MB, VmRSS: 150 MB, VmData: 179 MB, maxrss: 0.205764 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/tmp-legacysurvey-custom-212818m03520-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 7.06 s, CPU: 2.62 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 213 MB, VmData: 238 MB, maxrss: 0.2184 MB Stage wise_forced finished: 2020-08-05T19:28:01.534632 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.147 s worker CPU, 10.140 s worker Wall, Wall: 7.063 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:28:01.562604 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/coadd/cus/custom-212818m03520/legacysurvey-custom-212818m03520-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/tractor-i/cus/tractor-custom-212818m03520.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/tractor/cus/tractor-custom-212818m03520.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/tractor/cus/brick-custom-212818m03520.sha256sum Stage writecat : Wall: 1.58 s, CPU: 1.29 s, VmPeak: 1174 MB, VmSize: 1046 MB, VmRSS: 215 MB, VmData: 238 MB, maxrss: 0.351404 MB Stage writecat finished: 2020-08-05T19:28:03.146920 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.587 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.5 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/212/PGC050656/PGC050656-largegalaxy-writecat.p All done: 66.594 s worker CPU, 298.596 s worker Wall, Wall: 74.173 s, Cores in use: 1.11, Total efficiency (on 32 cores): 3.5 % Finished galaxy PGC050656 in 1.304 minutes. Started working on galaxy PGC050656 at Mon Aug 10 07:55:36 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.81793563854873 -3.520677992253556 --width 235 --height 235 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T07:55:36.957349 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '212.81793563854873', '-3.520677992253556', '--width', '235', '--height', '235', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.81793563854873 -3.520677992253556 --width 235 --height 235 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 212.81793563854873 -3.520677992253556 Starting process 10935 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 10936 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 10937 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 10938 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 10940 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05946 MB Starting process 10944 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB Starting process 10942 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB Starting process 10946 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T07:55:37.470316 Keeping 9 CCDs: c4d_170303_080732_ooi_g_ls9-N16 g expnum 625451 exptime 85.0 propid 2014B-0404 seeing 0.98 MJD 57815.337 object DECaLS_1304_g decam/CP/V4.8.2/CP20170302/c4d_170303_080732_ooi_g_ls9.fits.fz c4d_150110_075429_ooi_z_ls9-N16 z expnum 396445 exptime 90.0 propid 2014B-0404 seeing 1.10 MJD 57032.328 object DECaLS_1304_z decam/CP/V4.8.2a/CP20150109/c4d_150110_075429_ooi_z_ls9.fits.fz c4d_170303_080536_ooi_r_ls9-N16 r expnum 625450 exptime 47.0 propid 2014B-0404 seeing 0.85 MJD 57815.336 object DECaLS_1304_r decam/CP/V4.8.2/CP20170302/c4d_170303_080536_ooi_r_ls9.fits.fz c4d_160609_000015_ooi_z_ls9-N9 z expnum 548198 exptime 82.0 propid 2014B-0404 seeing 1.02 MJD 57547.999 object DECaLS_17176_z decam/CP/V4.8.2a/CP20160608/c4d_160609_000015_ooi_z_ls9.fits.fz c4d_170401_083751_ooi_r_ls9-N9 r expnum 636062 exptime 88.0 propid 2014B-0404 seeing 1.31 MJD 57844.358 object DECaLS_33048_r decam/CP/V4.8.2/CP20170331/c4d_170401_083751_ooi_r_ls9.fits.fz c4d_170503_053904_ooi_g_ls9-N9 g expnum 646591 exptime 126.0 propid 2014B-0404 seeing 1.10 MJD 57876.233 object DECaLS_33048_g decam/CP/V4.8.2/CP20170502/c4d_170503_053904_ooi_g_ls9.fits.fz c4d_160721_030954_ooi_z_ls9-N9 z expnum 553461 exptime 240.0 propid 2016A-0190 seeing 1.44 MJD 57590.129 object DECaLS_33048_z decam/CP/V4.8.2a/CP20160720/c4d_160721_030954_ooi_z_ls9.fits.fz c4d_160408_060104_ooi_g_ls9-N10 g expnum 535259 exptime 114.0 propid 2014B-0404 seeing 1.36 MJD 57486.249 object DECaLS_17176_g decam/CP/V4.8.2a/CP20160407/c4d_160408_060104_ooi_g_ls9.fits.fz c4d_160410_052010_ooi_r_ls9-N10 r expnum 536024 exptime 70.0 propid 2014B-0404 seeing 1.36 MJD 57488.221 object DECaLS_17176_r decam/CP/V4.8.2a/CP20160409/c4d_160410_052010_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95176d0-r-20170401T083532_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb50-z-20160608T235805_oi[N9,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160408T055819_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f1c8-r-20170303T080401_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563f3b-z-20150110T075209_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c7e7-z-20160721T030503_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518570-g-20170503T053609_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ee1d-g-20170303T080517_oi[N16,noinherit][2046,4094][real]: DECaLS_ Clipping 1 pixels with anomalously large oow values: max 0.0461014 vs median 0.0354224 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956cfb1-r-20160410T051801_oi[N10,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 74.10 s, CPU: 0.89 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.177816 MB Stage tims finished: 2020-08-10T07:56:51.572775 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518570-g-20170503T053609_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f1c8-r-20170303T080401_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb50-z-20160608T235805_oi[N9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c7e7-z-20160721T030503_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160408T055819_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95176d0-r-20170401T083532_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956cfb1-r-20160410T051801_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.197 s worker CPU, 406.734 s worker Wall, Wall: 74.104 s, Cores in use: 0.08, Total efficiency (on 8 cores): 1.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ee1d-g-20170303T080517_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563f3b-z-20150110T075209_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-10T07:56:51.707597 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06411.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06667.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06540.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/metrics/cus/reference-custom-212817m03520.fits Stage refs : Wall: 11.88 s, CPU: 1.99 s, VmPeak: 1035 MB, VmSize: 1026 MB, VmRSS: 196 MB, VmData: 228 MB, maxrss: 0.200448 MB Stage refs finished: 2020-08-10T07:57:03.587736 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.881 s, Cores in use: 0.17, Total efficiency (on 8 cores): 2.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T07:57:03.673319 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/metrics/cus/outlier-mask-custom-212817m03520.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/metrics/cus/outliers-pre-custom-212817m03520.jpg Image c4d_170303_080732_ooi_g_ls9-N16 g : masking 299 positive outlier pixels and 0 negative outlier pixels Image c4d_160410_052010_ooi_r_ls9-N10 r : masking 0 positive outlier pixels and 70 negative outlier pixels Image c4d_170401_083751_ooi_r_ls9-N9 r : masking 97 positive outlier pixels and 0 negative outlier pixels Image c4d_160721_030954_ooi_z_ls9-N9 z : masking 412 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/metrics/cus/outlier-mask-custom-212817m03520.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/metrics/cus/outliers-post-custom-212817m03520.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/metrics/cus/outliers-masked-pos-custom-212817m03520.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/metrics/cus/outliers-masked-neg-custom-212817m03520.jpg Stage outliers : Wall: 0.78 s, CPU: 0.63 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 207 MB, VmData: 237 MB, maxrss: 0.212068 MB Stage outliers finished: 2020-08-10T07:57:04.457320 Resources for stage outliers : 0.492 s worker CPU, 0.492 s worker Wall, Wall: 0.785 s, Cores in use: 1.43, Total efficiency (on 8 cores): 17.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T07:57:04.487059 Stage halos : Wall: 1.88 s, CPU: 0.30 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 207 MB, VmData: 237 MB, maxrss: 0.212332 MB Stage halos finished: 2020-08-10T07:57:06.365733 Resources for stage halos : 0.147 s worker CPU, 3.428 s worker Wall, Wall: 1.880 s, Cores in use: 0.24, Total efficiency (on 8 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T07:57:06.386046 PSF sigmas in coadd pixels: ['1.59', '1.79', '2.21'] Using average PSF sigma 1.8625546551498875 Gaussian PSF norm 0.15145584640638468 vs pixelized 0.12968779 average tim pixel scale / coadd scale: 1.0011045289766185 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.37', '2.13', '2.21'] Using average PSF sigma 1.9062002397726001 Gaussian PSF norm 0.14798801610030782 vs pixelized 0.11776944 average tim pixel scale / coadd scale: 1.001159615196174 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.79', '1.66', '2.33'] Using average PSF sigma 1.9280762108381653 Gaussian PSF norm 0.14630894265909078 vs pixelized 0.12437122 average tim pixel scale / coadd scale: 1.0012468600375506 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.12 s, CPU: 0.12 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.214184 MB Stage fit_on_coadds finished: 2020-08-10T07:57:06.509587 Resources for stage fit_on_coadds : 0.113 s worker CPU, 0.113 s worker Wall, Wall: 0.124 s, Cores in use: 1.84, Total efficiency (on 8 cores): 23.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T07:57:06.539887 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 12 potential peaks Of 12 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 9 kept SED z : 9 new peaks Found 18 potential peaks Of 18 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 33 potential peaks Of 33 potential peaks: 15 in veto map, 4 cut by saddle test, 0 cut by aper test, 14 kept SED g : 14 new peaks Found 37 potential peaks Of 37 potential peaks: 27 in veto map, 6 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 34 potential peaks Of 34 potential peaks: 29 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 28 new sources Median coadd sky for g : 3.0097985e-05 Median coadd sky for r : 0.0001041401 Median coadd sky for z : 0.00022786767 Stage srcs : Wall: 0.49 s, CPU: 0.46 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.21458 MB Stage srcs finished: 2020-08-10T07:57:07.028424 Resources for stage srcs : 0.063 s worker CPU, 0.063 s worker Wall, Wall: 0.490 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T07:57:07.047762 Blob 1 of 16, id: 1, sources: 7, size: 99x170, npix 10381, brick X: 64,163, Y: 5,175, one pixel: 101 5 Blob 2 of 16, id: 6, sources: 5, size: 60x66, npix 1712, brick X: 166,226, Y: 87,153, one pixel: 188 87 Blob 3 of 16, id: 14, sources: 3, size: 49x43, npix 1221, brick X: 73,122, Y: 179,222, one pixel: 91 179 Blob 4 of 16, id: 11, sources: 1, size: 30x30, npix 601, brick X: 12,42, Y: 172,202, one pixel: 25 172 Blob 5 of 16, id: 5, sources: 1, size: 27x26, npix 431, brick X: 24,51, Y: 52,78, one pixel: 37 52 Blob 6 of 16, id: 13, sources: 2, size: 29x29, npix 429, brick X: 170,199, Y: 173,202, one pixel: 189 173 Blob 7 of 16, id: 7, sources: 1, size: 24x23, npix 350, brick X: 11,35, Y: 103,126, one pixel: 21 103 Blob 8 of 16, id: 10, sources: 1, size: 22x22, npix 292, brick X: 205,227, Y: 142,164, one pixel: 216 142 Blob 9 of 16, id: 4, sources: 1, size: 18x21, npix 248, brick X: 0,18, Y: 52,73, one pixel: 5 52 Blob 8 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.143796 MB Blob 7 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 944 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143896 MB Blob 10 of 16, id: 15, sources: 1, size: 22x20, npix 248, brick X: 50,72, Y: 182,202, one pixel: 61 182 Blob 11 of 16, id: 2, sources: 1, size: 20x20, npix 228, brick X: 210,230, Y: 27,47, one pixel: 220 27 Blob 9 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.143796 MB Blob 12 of 16, id: 9, sources: 1, size: 20x20, npix 228, brick X: 38,58, Y: 134,154, one pixel: 46 134 Blob 6 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143936 MB Blob 13 of 16, id: 8, sources: 1, size: 20x19, npix 209, brick X: 200,220, Y: 127,146, one pixel: 209 127 Blob 5 finished, total: Wall: 0.78 s, CPU: 0.77 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14412 MB Blob 14 of 16, id: 3, sources: 1, size: 18x19, npix 189, brick X: 172,190, Y: 48,67, one pixel: 181 48 Blob 11 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.143796 MB Blob 15 of 16, id: 12, sources: 1, size: 19x17, npix 179, brick X: 200,219, Y: 172,189, one pixel: 208 172 Blob 4 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 936 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14464 MB Blob 16 of 16, id: 0, sources: 1, size: 17x12, npix 120, brick X: 32,49, Y: 0,12, one pixel: 35 0 Blob 15 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 936 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14464 MB Blob 13 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14412 MB Blob 10 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 944 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143896 MB Blob 14 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.143796 MB Blob 12 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145672 MB Blob 16 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 936 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14464 MB Measuring 3 iterative sources Blob 3 finished, total: Wall: 2.35 s, CPU: 2.33 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146256 MB Blob 2 finished, total: Wall: 2.97 s, CPU: 2.97 s, VmPeak: 965 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144576 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.677632, ee1=0.0741098, ee2=-0.197026 Measuring 7 iterative sources Blob 1 finished, total: Wall: 10.23 s, CPU: 10.22 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.14692 MB Old catalog: 33 New catalog: 23 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/metrics/cus/blobs-custom-212817m03520.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/metrics/cus/all-models-custom-212817m03520.fits Stage fitblobs : Wall: 10.71 s, CPU: 0.49 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.214744 MB Stage fitblobs finished: 2020-08-10T07:57:17.762464 Resources for stage fitblobs : 22.278 s worker CPU, 22.391 s worker Wall, Wall: 10.716 s, Cores in use: 2.12, Total efficiency (on 8 cores): 26.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T07:57:17.778509 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/tmp-legacysurvey-custom-212817m03520-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/tmp-legacysurvey-custom-212817m03520-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/tmp-legacysurvey-custom-212817m03520-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/tmp-legacysurvey-custom-212817m03520-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-resid.jpg Stage coadds : Wall: 2.94 s, CPU: 0.74 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.21526 MB Stage coadds finished: 2020-08-10T07:57:20.717915 Resources for stage coadds : 4.250 s worker CPU, 5.083 s worker Wall, Wall: 2.941 s, Cores in use: 1.70, Total efficiency (on 8 cores): 21.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T07:57:20.741882 Cut to 1 unWISE tiles Reading WISE tile 2132m031 band 1 Reading WISE tile 2132m031 band 2 Reading WISE tile 2132m031 band 3 Reading WISE tile 2132m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.19362 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 940 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205708 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 965 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208236 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2132m031/unwise-2132m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 940 MB, VmSize: 801 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.206632 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/tmp-legacysurvey-custom-212817m03520-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/tmp-legacysurvey-custom-212817m03520-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.74 s, CPU: 0.43 s, VmPeak: 1035 MB, VmSize: 1035 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.215964 MB Stage wise_forced finished: 2020-08-10T07:57:23.482828 Resources for stage wise_forced : 3.216 s worker CPU, 5.221 s worker Wall, Wall: 2.742 s, Cores in use: 1.33, Total efficiency (on 8 cores): 16.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T07:57:23.495850 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/coadd/cus/custom-212817m03520/legacysurvey-custom-212817m03520-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/tractor-i/cus/tractor-custom-212817m03520.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/tractor/cus/tractor-custom-212817m03520.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/tractor/cus/brick-custom-212817m03520.sha256sum Stage writecat : Wall: 0.61 s, CPU: 0.45 s, VmPeak: 1168 MB, VmSize: 1040 MB, VmRSS: 213 MB, VmData: 237 MB, maxrss: 0.348952 MB Stage writecat finished: 2020-08-10T07:57:24.102871 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.608 s, Cores in use: 0.75, Total efficiency (on 8 cores): 9.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC050656/PGC050656-largegalaxy-writecat.p All done: 35.758 s worker CPU, 443.527 s worker Wall, Wall: 106.749 s, Cores in use: 0.40, Total efficiency (on 8 cores): 5.0 % Finished galaxy PGC050656 in 1.806 minutes.