Started working on galaxy PGC1033748 at Wed Aug 5 19:48:45 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.136641 -6.3618175 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:48:47.606599 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.136641', '-6.3618175', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.136641 -6.3618175 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 336.136641 -6.3618175 Starting process 44724 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 44725 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 44726 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 44727 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 44728 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 44729 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 44730 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 44731 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 44732 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 44733 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 44734 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 44735 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 44736 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 44737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 44738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 44739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:48:48.091624 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 9 CCDs: c4d_180918_002008_ooi_z_ls9-N17 z expnum 774993 exptime 250.0 propid 2014B-0404 seeing 1.14 MJD 58379.014 object DECaLS_45743_z decam/CP/V4.8.2a/CP20180917/c4d_180918_002008_ooi_z_ls9.fits.fz c4d_180619_072904_ooi_g_ls9-N11 g expnum 754086 exptime 179.0 propid 2014B-0404 seeing 1.13 MJD 58288.312 object DECaLS_29871_g decam/CP/V4.8.2a/CP20180618/c4d_180619_072904_ooi_g_ls9.fits.fz c4d_170821_031253_ooi_r_ls9-N11 r expnum 669920 exptime 109.0 propid 2014B-0404 seeing 1.36 MJD 57986.134 object DECaLS_29871_r decam/CP/V4.8.2a/CP20170820/c4d_170821_031253_ooi_r_ls9.fits.fz c4d_160812_044354_ooi_z_ls9-N11 z expnum 563144 exptime 80.0 propid 2014B-0404 seeing 0.87 MJD 57612.196 object DECaLS_29871_z decam/CP/V4.8.2a/CP20160811/c4d_160812_044354_ooi_z_ls9.fits.fz c4d_180905_031734_ooi_g_ls9-S11 g expnum 769045 exptime 56.0 propid 2014B-0404 seeing 1.04 MJD 58366.137 object DECaLS_51890_g decam/CP/V4.8.2a/CP20180904/c4d_180905_031734_ooi_g_ls9.fits.fz c4d_180905_063353_ooi_r_ls9-S8 r expnum 769162 exptime 40.0 propid 2014B-0404 seeing 1.01 MJD 58366.274 object DECaLS_56764_r decam/CP/V4.8.2a/CP20180904/c4d_180905_063353_ooi_r_ls9.fits.fz c4d_180830_024037_ooi_z_ls9-N12 z expnum 767000 exptime 102.0 propid 2014B-0404 seeing 0.94 MJD 58360.112 object DECaLS_13999_z decam/CP/V4.8.2a/CP20180829/c4d_180830_024037_ooi_z_ls9.fits.fz c4d_180812_032938_ooi_g_ls9-N12 g expnum 764589 exptime 118.0 propid 2014B-0404 seeing 1.05 MJD 58342.146 object DECaLS_13999_g decam/CP/V4.8.2a/CP20180811/c4d_180812_032938_ooi_g_ls9.fits.fz c4d_180812_033204_ooi_r_ls9-N12 r expnum 764590 exptime 49.0 propid 2014B-0404 seeing 0.98 MJD 58342.147 object DECaLS_13999_r decam/CP/V4.8.2a/CP20180811/c4d_180812_033204_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T031734_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170821T031253_oi[N11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533ab3-r-20180905T063353_oi[S8,noinherit][2046,4094][real]: DECaLS_5 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a179-z-20160812T044139_oi[N11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T002008_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180619T072904_oi[N11,noinherit][2046,4094][real]: DECaLS_ Clipping 221 pixels with anomalously large oow values: max 0.0170124 vs median 0.0112751 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T032938_oi[N12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532aaf-r-20180812T033204_oi[N12,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952aa76-z-20180830T024037_oi[N12,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 69.40 s, CPU: 1.02 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.180428 MB Stage tims finished: 2020-08-05T19:49:57.492442 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533ab3-r-20180905T063353_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T031734_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T002008_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T032938_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170821T031253_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952aa76-z-20180830T024037_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.765 s worker CPU, 382.811 s worker Wall, Wall: 69.402 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180619T072904_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a179-z-20160812T044139_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:49:57.543953 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06840.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06839.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06711.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06967.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/reference-custom-336136m06361.fits Stage refs : Wall: 8.16 s, CPU: 3.23 s, VmPeak: 1042 MB, VmSize: 1030 MB, VmRSS: 196 MB, VmData: 227 MB, maxrss: 0.200608 MB Stage refs finished: 2020-08-05T19:50:05.706812 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532aaf-r-20180812T033204_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.164 s, Cores in use: 0.40, Total efficiency (on 16 cores): 2.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:50:05.793487 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outlier-mask-custom-336136m06361.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outliers-pre-custom-336136m06361.jpg Image c4d_180619_072904_ooi_g_ls9-N11 g : masking 104 positive outlier pixels and 0 negative outlier pixels Image c4d_180905_031734_ooi_g_ls9-S11 g : masking 219 positive outlier pixels and 0 negative outlier pixels Image c4d_180812_032938_ooi_g_ls9-N12 g : masking 0 positive outlier pixels and 145 negative outlier pixels Image c4d_170821_031253_ooi_r_ls9-N11 r : masking 392 positive outlier pixels and 0 negative outlier pixels Image c4d_180905_063353_ooi_r_ls9-S8 r : masking 242 positive outlier pixels and 0 negative outlier pixels Image c4d_180812_033204_ooi_r_ls9-N12 r : masking 0 positive outlier pixels and 181 negative outlier pixels Image c4d_180830_024037_ooi_z_ls9-N12 z : masking 352 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outlier-mask-custom-336136m06361.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outliers-post-custom-336136m06361.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outliers-masked-pos-custom-336136m06361.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outliers-masked-neg-custom-336136m06361.jpg Stage outliers : Wall: 0.88 s, CPU: 0.53 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 209 MB, VmData: 238 MB, maxrss: 0.214316 MB Stage outliers finished: 2020-08-05T19:50:06.669542 Resources for stage outliers : 0.748 s worker CPU, 0.975 s worker Wall, Wall: 0.878 s, Cores in use: 1.46, Total efficiency (on 16 cores): 9.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:50:06.776697 Stage halos : Wall: 1.04 s, CPU: 0.92 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.214648 MB Stage halos finished: 2020-08-05T19:50:07.817551 Resources for stage halos : 0.301 s worker CPU, 0.849 s worker Wall, Wall: 1.042 s, Cores in use: 1.17, Total efficiency (on 16 cores): 7.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:50:07.854600 PSF sigmas in coadd pixels: ['1.84', '1.68', '1.71'] Using average PSF sigma 1.7444350557411663 Gaussian PSF norm 0.16171126052842547 vs pixelized 0.13494669 average tim pixel scale / coadd scale: 1.0011203250250573 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.20', '1.65', '1.59'] Using average PSF sigma 1.8126184751061845 Gaussian PSF norm 0.15562833307067162 vs pixelized 0.12428849 average tim pixel scale / coadd scale: 1.0011353879235685 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.84', '1.42', '1.53'] Using average PSF sigma 1.5967924064610184 Gaussian PSF norm 0.17666341011671438 vs pixelized 0.14671315 average tim pixel scale / coadd scale: 1.001066805080347 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.13 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.216244 MB Stage fit_on_coadds finished: 2020-08-05T19:50:08.065007 Resources for stage fit_on_coadds : 0.149 s worker CPU, 0.150 s worker Wall, Wall: 0.212 s, Cores in use: 1.32, Total efficiency (on 16 cores): 8.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:50:08.098047 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 7 potential peaks Of 7 potential peaks: 2 in veto map, 0 cut by saddle test, 0 cut by aper test, 5 kept SED z : 5 new peaks Found 14 potential peaks Of 14 potential peaks: 7 in veto map, 0 cut by saddle test, 0 cut by aper test, 7 kept SED r : 7 new peaks Found 14 potential peaks Of 14 potential peaks: 11 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 20 potential peaks Of 20 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 18 potential peaks Of 18 potential peaks: 17 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 16 new sources Median coadd sky for g : -4.5695517e-05 Median coadd sky for r : -3.1679763e-05 Median coadd sky for z : 0.00017691945 Stage srcs : Wall: 0.87 s, CPU: 0.83 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.216648 MB Stage srcs finished: 2020-08-05T19:50:08.963391 Resources for stage srcs : 0.078 s worker CPU, 0.078 s worker Wall, Wall: 0.867 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:50:09.289679 Blob 1 of 17, id: 4, sources: 2, size: 65x119, npix 5464, brick X: 97,162, Y: 66,185, one pixel: 125 66 Blob 2 of 17, id: 2, sources: 1, size: 31x30, npix 656, brick X: 44,75, Y: 42,72, one pixel: 56 42 Blob 3 of 17, id: 11, sources: 1, size: 29x34, npix 642, brick X: 202,231, Y: 194,228, one pixel: 213 194 Blob 4 of 17, id: 10, sources: 2, size: 32x30, npix 524, brick X: 173,205, Y: 156,186, one pixel: 182 156 Blob 5 of 17, id: 15, sources: 1, size: 32x21, npix 469, brick X: 44,76, Y: 230,251, one pixel: 59 230 Blob 6 of 17, id: 5, sources: 1, size: 25x26, npix 403, brick X: 0,25, Y: 73,99, one pixel: 11 73 Blob 7 of 17, id: 6, sources: 1, size: 25x24, npix 374, brick X: 34,59, Y: 82,106, one pixel: 44 82 Blob 8 of 17, id: 9, sources: 1, size: 22x25, npix 354, brick X: 9,31, Y: 152,177, one pixel: 17 152 Blob 9 of 17, id: 13, sources: 1, size: 20x25, npix 329, brick X: 0,20, Y: 211,236, one pixel: 7 211 Blob 10 of 17, id: 12, sources: 1, size: 23x23, npix 316, brick X: 139,162, Y: 195,218, one pixel: 148 195 Blob 11 of 17, id: 7, sources: 1, size: 24x22, npix 304, brick X: 53,77, Y: 102,124, one pixel: 63 102 Blob 12 of 17, id: 0, sources: 1, size: 22x22, npix 293, brick X: 128,150, Y: 1,23, one pixel: 138 1 Blob 13 of 17, id: 1, sources: 1, size: 22x22, npix 293, brick X: 224,246, Y: 18,40, one pixel: 233 18 Blob 14 of 17, id: 16, sources: 1, size: 23x17, npix 272, brick X: 5,28, Y: 234,251, one pixel: 14 234 Blob 15 of 17, id: 3, sources: 1, size: 19x20, npix 209, brick X: 216,235, Y: 56,76, one pixel: 225 56 Blob 16 of 17, id: 14, sources: 1, size: 19x19, npix 208, brick X: 217,236, Y: 227,246, one pixel: 225 227 Blob 17 of 17, id: 8, sources: 1, size: 17x18, npix 162, brick X: 81,98, Y: 147,165, one pixel: 89 147 Blob 15 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 947 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147076 MB Blob 16 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 939 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148364 MB Blob 17 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 947 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148808 MB Blob 14 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115488 MB Blob 13 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 111 MB, VmData: 164 MB, maxrss: 0.113604 MB Blob 7 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147856 MB Blob 8 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 935 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150428 MB Blob 9 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149932 MB Blob 10 finished, total: Wall: 0.92 s, CPU: 0.89 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148116 MB Blob 12 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 115 MB, VmData: 168 MB, maxrss: 0.117428 MB Blob 6 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 941 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14988 MB Blob 11 finished, total: Wall: 1.08 s, CPU: 1.04 s, VmPeak: 922 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14786 MB Blob 5 finished, total: Wall: 1.21 s, CPU: 1.20 s, VmPeak: 906 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14808 MB Blob 4 finished, total: Wall: 1.24 s, CPU: 1.23 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115604 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.29 s, CPU: 1.28 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093412 MB Blob 3 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.113972 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.09486, ee1=0.303823, ee2=-0.0254677 Measuring 1 iterative sources Blob 1 finished, total: Wall: 5.33 s, CPU: 5.32 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.115376 MB Old catalog: 21 New catalog: 19 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/blobs-custom-336136m06361.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/all-models-custom-336136m06361.fits Stage fitblobs : Wall: 5.67 s, CPU: 0.34 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.216812 MB Stage fitblobs finished: 2020-08-05T19:50:14.960093 Resources for stage fitblobs : 18.980 s worker CPU, 19.200 s worker Wall, Wall: 5.672 s, Cores in use: 3.41, Total efficiency (on 16 cores): 21.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:50:14.975094 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-resid.jpg Stage coadds : Wall: 2.58 s, CPU: 0.68 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.217324 MB Stage coadds finished: 2020-08-05T19:50:17.554354 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 11.207 s worker CPU, 16.705 s worker Wall, Wall: 2.581 s, Cores in use: 4.61, Total efficiency (on 16 cores): 28.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:50:17.569525 Cut to 1 unWISE tiles Reading WISE tile 3356m061 band 1 Reading WISE tile 3356m061 band 2 Reading WISE tile 3356m061 band 3 Reading WISE tile 3356m061 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 808 MB, VmSize: 808 MB, VmRSS: 149 MB, VmData: 176 MB, maxrss: 0.189844 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 906 MB, VmSize: 806 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.20784 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 947 MB, VmSize: 806 MB, VmRSS: 148 MB, VmData: 171 MB, maxrss: 0.210176 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 941 MB, VmSize: 872 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.215936 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.98 s, CPU: 1.13 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 213 MB, VmData: 238 MB, maxrss: 0.218032 MB Stage wise_forced finished: 2020-08-05T19:50:20.546611 Resources for stage wise_forced : 3.286 s worker CPU, 5.907 s worker Wall, Wall: 2.979 s, Cores in use: 1.48, Total efficiency (on 16 cores): 9.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-wise_forced.p Running stage writecat WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage writecat at 2020-08-05T19:50:20.563317 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/tractor-i/cus/tractor-custom-336136m06361.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/tractor/cus/tractor-custom-336136m06361.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/tractor/cus/brick-custom-336136m06361.sha256sum Stage writecat : Wall: 2.48 s, CPU: 1.27 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 215 MB, VmData: 238 MB, maxrss: 0.351036 MB Stage writecat finished: 2020-08-05T19:50:23.043893 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.482 s, Cores in use: 0.51, Total efficiency (on 16 cores): 3.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-writecat.p All done: 40.517 s worker CPU, 426.679 s worker Wall, Wall: 94.981 s, Cores in use: 0.53, Total efficiency (on 16 cores): 3.3 % Finished galaxy PGC1033748 in 1.632 minutes. Started working on galaxy PGC1033748 at Wed Aug 5 20:35:52 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.136641 -6.3618175 --width 251 --height 251 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:35:54.651479 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.136641', '-6.3618175', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.136641 -6.3618175 --width 251 --height 251 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 336.136641 -6.3618175 Starting process 54524 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 54525 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 54526 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 54527 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 54528 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 54529 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 54530 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 54531 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 54532 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 54533 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 54534 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 54535 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 54536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 54537 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 54538 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 54539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 54540 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 54541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 54542 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 54543 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 54544 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 54545 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 54546 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 54547 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 54548 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 54549 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 54550 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 54551 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 54552 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 54553 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 54555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 54554 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:35:57.739890 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 9 CCDs: c4d_180918_002008_ooi_z_ls9-N17 z expnum 774993 exptime 250.0 propid 2014B-0404 seeing 1.14 MJD 58379.014 object DECaLS_45743_z decam/CP/V4.8.2a/CP20180917/c4d_180918_002008_ooi_z_ls9.fits.fz c4d_180619_072904_ooi_g_ls9-N11 g expnum 754086 exptime 179.0 propid 2014B-0404 seeing 1.13 MJD 58288.312 object DECaLS_29871_g decam/CP/V4.8.2a/CP20180618/c4d_180619_072904_ooi_g_ls9.fits.fz c4d_170821_031253_ooi_r_ls9-N11 r expnum 669920 exptime 109.0 propid 2014B-0404 seeing 1.36 MJD 57986.134 object DECaLS_29871_r decam/CP/V4.8.2a/CP20170820/c4d_170821_031253_ooi_r_ls9.fits.fz c4d_160812_044354_ooi_z_ls9-N11 z expnum 563144 exptime 80.0 propid 2014B-0404 seeing 0.87 MJD 57612.196 object DECaLS_29871_z decam/CP/V4.8.2a/CP20160811/c4d_160812_044354_ooi_z_ls9.fits.fz c4d_180905_031734_ooi_g_ls9-S11 g expnum 769045 exptime 56.0 propid 2014B-0404 seeing 1.04 MJD 58366.137 object DECaLS_51890_g decam/CP/V4.8.2a/CP20180904/c4d_180905_031734_ooi_g_ls9.fits.fz c4d_180905_063353_ooi_r_ls9-S8 r expnum 769162 exptime 40.0 propid 2014B-0404 seeing 1.01 MJD 58366.274 object DECaLS_56764_r decam/CP/V4.8.2a/CP20180904/c4d_180905_063353_ooi_r_ls9.fits.fz c4d_180830_024037_ooi_z_ls9-N12 z expnum 767000 exptime 102.0 propid 2014B-0404 seeing 0.94 MJD 58360.112 object DECaLS_13999_z decam/CP/V4.8.2a/CP20180829/c4d_180830_024037_ooi_z_ls9.fits.fz c4d_180812_032938_ooi_g_ls9-N12 g expnum 764589 exptime 118.0 propid 2014B-0404 seeing 1.05 MJD 58342.146 object DECaLS_13999_g decam/CP/V4.8.2a/CP20180811/c4d_180812_032938_ooi_g_ls9.fits.fz c4d_180812_033204_ooi_r_ls9-N12 r expnum 764590 exptime 49.0 propid 2014B-0404 seeing 0.98 MJD 58342.147 object DECaLS_13999_r decam/CP/V4.8.2a/CP20180811/c4d_180812_033204_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170821T031253_oi[N11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533ab3-r-20180905T063353_oi[S8,noinherit][2046,4094][real]: DECaLS_5 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532aaf-r-20180812T033204_oi[N12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T031734_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T032938_oi[N12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T002008_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a179-z-20160812T044139_oi[N11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180619T072904_oi[N11,noinherit][2046,4094][real]: DECaLS_ Clipping 221 pixels with anomalously large oow values: max 0.0170124 vs median 0.0112751 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952aa76-z-20180830T024037_oi[N12,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 65.66 s, CPU: 2.51 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.180428 MB Stage tims finished: 2020-08-05T20:37:03.400143 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170821T031253_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T031734_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533ab3-r-20180905T063353_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a179-z-20160812T044139_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180619T072904_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T032938_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T002008_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952aa76-z-20180830T024037_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532aaf-r-20180812T033204_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.522 s worker CPU, 200.246 s worker Wall, Wall: 65.663 s, Cores in use: 0.12, Total efficiency (on 32 cores): 0.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-05T20:37:03.502237 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06840.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06839.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06711.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06967.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/reference-custom-336136m06361.fits Stage refs : Wall: 7.37 s, CPU: 2.18 s, VmPeak: 1042 MB, VmSize: 1030 MB, VmRSS: 196 MB, VmData: 227 MB, maxrss: 0.200668 MB Stage refs finished: 2020-08-05T20:37:10.873099 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 7.373 s, Cores in use: 0.30, Total efficiency (on 32 cores): 0.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:37:10.972958 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outlier-mask-custom-336136m06361.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outliers-pre-custom-336136m06361.jpg Image c4d_180619_072904_ooi_g_ls9-N11 g : masking 104 positive outlier pixels and 0 negative outlier pixels Image c4d_180905_031734_ooi_g_ls9-S11 g : masking 219 positive outlier pixels and 0 negative outlier pixels Image c4d_180812_032938_ooi_g_ls9-N12 g : masking 0 positive outlier pixels and 145 negative outlier pixels Image c4d_180905_063353_ooi_r_ls9-S8 r : masking 242 positive outlier pixels and 0 negative outlier pixels Image c4d_180812_033204_ooi_r_ls9-N12 r : masking 0 positive outlier pixels and 181 negative outlier pixels Image c4d_170821_031253_ooi_r_ls9-N11 r : masking 392 positive outlier pixels and 0 negative outlier pixels Image c4d_180830_024037_ooi_z_ls9-N12 z : masking 352 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outlier-mask-custom-336136m06361.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outliers-post-custom-336136m06361.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outliers-masked-pos-custom-336136m06361.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/outliers-masked-neg-custom-336136m06361.jpg Stage outliers : Wall: 1.57 s, CPU: 1.06 s, VmPeak: 1042 MB, VmSize: 1039 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.213804 MB Stage outliers finished: 2020-08-05T20:37:12.544915 Resources for stage outliers : 0.802 s worker CPU, 1.290 s worker Wall, Wall: 1.574 s, Cores in use: 1.19, Total efficiency (on 32 cores): 3.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:37:12.571662 Stage halos : Wall: 1.12 s, CPU: 0.89 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.21396 MB Stage halos finished: 2020-08-05T20:37:13.689580 Resources for stage halos : 0.321 s worker CPU, 1.364 s worker Wall, Wall: 1.120 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:37:13.803266 PSF sigmas in coadd pixels: ['1.84', '1.68', '1.71'] Using average PSF sigma 1.7444350557411663 Gaussian PSF norm 0.16171126052842547 vs pixelized 0.13494669 average tim pixel scale / coadd scale: 1.0011203250250573 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.20', '1.65', '1.59'] Using average PSF sigma 1.8126184751061845 Gaussian PSF norm 0.15562833307067162 vs pixelized 0.12428849 average tim pixel scale / coadd scale: 1.0011353879235685 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.84', '1.42', '1.53'] Using average PSF sigma 1.5967924064610184 Gaussian PSF norm 0.17666341011671438 vs pixelized 0.14671315 average tim pixel scale / coadd scale: 1.001066805080347 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.13 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.215564 MB Stage fit_on_coadds finished: 2020-08-05T20:37:13.968365 Resources for stage fit_on_coadds : 0.149 s worker CPU, 0.149 s worker Wall, Wall: 0.167 s, Cores in use: 1.70, Total efficiency (on 32 cores): 5.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:37:13.987882 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 7 potential peaks Of 7 potential peaks: 2 in veto map, 0 cut by saddle test, 0 cut by aper test, 5 kept SED z : 5 new peaks Found 14 potential peaks Of 14 potential peaks: 7 in veto map, 0 cut by saddle test, 0 cut by aper test, 7 kept SED r : 7 new peaks Found 14 potential peaks Of 14 potential peaks: 11 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 20 potential peaks Of 20 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 18 potential peaks Of 18 potential peaks: 17 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 16 new sources Median coadd sky for g : -4.5695517e-05 Median coadd sky for r : -3.167972e-05 Median coadd sky for z : 0.00017691945 Stage srcs : Wall: 1.14 s, CPU: 1.08 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.215968 MB Stage srcs finished: 2020-08-05T20:37:15.129586 Resources for stage srcs : 0.091 s worker CPU, 0.091 s worker Wall, Wall: 1.144 s, Cores in use: 1.03, Total efficiency (on 32 cores): 3.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:37:15.147178 Blob 1 of 17, id: 4, sources: 2, size: 65x119, npix 5464, brick X: 97,162, Y: 66,185, one pixel: 125 66 Blob 2 of 17, id: 2, sources: 1, size: 31x30, npix 656, brick X: 44,75, Y: 42,72, one pixel: 56 42 Blob 3 of 17, id: 11, sources: 1, size: 29x34, npix 642, brick X: 202,231, Y: 194,228, one pixel: 213 194 Blob 4 of 17, id: 10, sources: 2, size: 32x30, npix 524, brick X: 173,205, Y: 156,186, one pixel: 182 156 Blob 5 of 17, id: 15, sources: 1, size: 32x21, npix 469, brick X: 44,76, Y: 230,251, one pixel: 59 230 Blob 6 of 17, id: 5, sources: 1, size: 25x26, npix 403, brick X: 0,25, Y: 73,99, one pixel: 11 73 Blob 7 of 17, id: 6, sources: 1, size: 25x24, npix 374, brick X: 34,59, Y: 82,106, one pixel: 44 82 Blob 8 of 17, id: 9, sources: 1, size: 22x25, npix 354, brick X: 9,31, Y: 152,177, one pixel: 17 152 Blob 9 of 17, id: 13, sources: 1, size: 20x25, npix 329, brick X: 0,20, Y: 211,236, one pixel: 7 211 Blob 10 of 17, id: 12, sources: 1, size: 23x23, npix 316, brick X: 139,162, Y: 195,218, one pixel: 148 195 Blob 11 of 17, id: 7, sources: 1, size: 24x22, npix 304, brick X: 53,77, Y: 102,124, one pixel: 63 102 Blob 12 of 17, id: 0, sources: 1, size: 22x22, npix 293, brick X: 128,150, Y: 1,23, one pixel: 138 1 Blob 13 of 17, id: 1, sources: 1, size: 22x22, npix 293, brick X: 224,246, Y: 18,40, one pixel: 233 18 Blob 14 of 17, id: 16, sources: 1, size: 23x17, npix 272, brick X: 5,28, Y: 234,251, one pixel: 14 234 Blob 15 of 17, id: 3, sources: 1, size: 19x20, npix 209, brick X: 216,235, Y: 56,76, one pixel: 225 56 Blob 16 of 17, id: 14, sources: 1, size: 19x19, npix 208, brick X: 217,236, Y: 227,246, one pixel: 225 227 Blob 17 of 17, id: 8, sources: 1, size: 17x18, npix 162, brick X: 81,98, Y: 147,165, one pixel: 89 147 Blob 17 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 108 MB, VmData: 166 MB, maxrss: 0.110352 MB Blob 16 finished, total: Wall: 0.26 s, CPU: 0.25 s, VmPeak: 955 MB, VmSize: 731 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.14572 MB Blob 15 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 94 MB, VmData: 142 MB, maxrss: 0.09666 MB Blob 14 finished, total: Wall: 0.30 s, CPU: 0.29 s, VmPeak: 947 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14838 MB Blob 13 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.093952 MB Blob 10 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 111 MB, VmData: 164 MB, maxrss: 0.113544 MB Blob 12 finished, total: Wall: 0.63 s, CPU: 0.62 s, VmPeak: 692 MB, VmSize: 692 MB, VmRSS: 109 MB, VmData: 164 MB, maxrss: 0.112084 MB Blob 7 finished, total: Wall: 0.67 s, CPU: 0.66 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.11376 MB Blob 9 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 115 MB, VmData: 167 MB, maxrss: 0.11726 MB Blob 8 finished, total: Wall: 0.78 s, CPU: 0.77 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.115164 MB Blob 6 finished, total: Wall: 0.82 s, CPU: 0.80 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095024 MB Blob 11 finished, total: Wall: 0.84 s, CPU: 0.83 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09398 MB Blob 2 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 922 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.146984 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.06 s, CPU: 1.05 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09248 MB Blob 4 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147668 MB Blob 5 finished, total: Wall: 1.16 s, CPU: 1.15 s, VmPeak: 941 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148144 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.09486, ee1=0.303823, ee2=-0.0254678 Measuring 1 iterative sources Blob 1 finished, total: Wall: 5.34 s, CPU: 5.34 s, VmPeak: 906 MB, VmSize: 733 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150264 MB Old catalog: 21 New catalog: 19 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/blobs-custom-336136m06361.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/metrics/cus/all-models-custom-336136m06361.fits Stage fitblobs : Wall: 6.28 s, CPU: 0.92 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.216132 MB Stage fitblobs finished: 2020-08-05T20:37:21.423818 Resources for stage fitblobs : 16.177 s worker CPU, 16.514 s worker Wall, Wall: 6.279 s, Cores in use: 2.72, Total efficiency (on 32 cores): 8.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:37:21.439805 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-resid.jpg Stage coadds : Wall: 4.00 s, CPU: 1.21 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 212 MB, VmData: 237 MB, maxrss: 0.216644 MB Stage coadds finished: 2020-08-05T20:37:25.443226 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 28.361 s worker CPU, 54.502 s worker Wall, Wall: 4.006 s, Cores in use: 7.38, Total efficiency (on 32 cores): 23.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:37:25.662612 Cut to 1 unWISE tiles Reading WISE tile 3356m061 band 1 Reading WISE tile 3356m061 band 4 Reading WISE tile 3356m061 band 2 Reading WISE tile 3356m061 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 939 MB, VmSize: 807 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.187956 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 906 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 171 MB, maxrss: 0.209872 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 935 MB, VmSize: 801 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.20282 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 955 MB, VmSize: 809 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210624 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/tmp-legacysurvey-custom-336136m06361-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.70 s, CPU: 1.11 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 212 MB, VmData: 237 MB, maxrss: 0.217352 MB Stage wise_forced finished: 2020-08-05T20:37:28.361657 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.199 s worker CPU, 4.730 s worker Wall, Wall: 2.701 s, Cores in use: 1.60, Total efficiency (on 32 cores): 5.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:37:28.377706 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/coadd/cus/custom-336136m06361/legacysurvey-custom-336136m06361-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/tractor-i/cus/tractor-custom-336136m06361.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/tractor/cus/tractor-custom-336136m06361.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/tractor/cus/brick-custom-336136m06361.sha256sum Stage writecat : Wall: 1.14 s, CPU: 0.93 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 214 MB, VmData: 237 MB, maxrss: 0.350356 MB Stage writecat finished: 2020-08-05T20:37:29.516102 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.141 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1033748/PGC1033748-largegalaxy-writecat.p All done: 54.629 s worker CPU, 278.893 s worker Wall, Wall: 91.809 s, Cores in use: 0.73, Total efficiency (on 32 cores): 2.3 % Finished galaxy PGC1033748 in 1.615 minutes. Started working on galaxy PGC1033748 at Mon Aug 10 09:12:45 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.13627123223836 -6.362142682459378 --width 251 --height 251 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T09:12:46.718983 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.13627123223836', '-6.362142682459378', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.13627123223836 -6.362142682459378 --width 251 --height 251 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 336.13627123223836 -6.362142682459378 Starting process 12424 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 12426 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 12428 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 12430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 12432 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059468 MB Starting process 12434 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 12436 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 12438 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T09:12:47.435482 Keeping 9 CCDs: c4d_180918_002008_ooi_z_ls9-N17 z expnum 774993 exptime 250.0 propid 2014B-0404 seeing 1.14 MJD 58379.014 object DECaLS_45743_z decam/CP/V4.8.2a/CP20180917/c4d_180918_002008_ooi_z_ls9.fits.fz c4d_180619_072904_ooi_g_ls9-N11 g expnum 754086 exptime 179.0 propid 2014B-0404 seeing 1.13 MJD 58288.312 object DECaLS_29871_g decam/CP/V4.8.2a/CP20180618/c4d_180619_072904_ooi_g_ls9.fits.fz c4d_170821_031253_ooi_r_ls9-N11 r expnum 669920 exptime 109.0 propid 2014B-0404 seeing 1.36 MJD 57986.134 object DECaLS_29871_r decam/CP/V4.8.2a/CP20170820/c4d_170821_031253_ooi_r_ls9.fits.fz c4d_160812_044354_ooi_z_ls9-N11 z expnum 563144 exptime 80.0 propid 2014B-0404 seeing 0.87 MJD 57612.196 object DECaLS_29871_z decam/CP/V4.8.2a/CP20160811/c4d_160812_044354_ooi_z_ls9.fits.fz c4d_180905_031734_ooi_g_ls9-S11 g expnum 769045 exptime 56.0 propid 2014B-0404 seeing 1.04 MJD 58366.137 object DECaLS_51890_g decam/CP/V4.8.2a/CP20180904/c4d_180905_031734_ooi_g_ls9.fits.fz c4d_180905_063353_ooi_r_ls9-S8 r expnum 769162 exptime 40.0 propid 2014B-0404 seeing 1.01 MJD 58366.274 object DECaLS_56764_r decam/CP/V4.8.2a/CP20180904/c4d_180905_063353_ooi_r_ls9.fits.fz c4d_180830_024037_ooi_z_ls9-N12 z expnum 767000 exptime 102.0 propid 2014B-0404 seeing 0.94 MJD 58360.112 object DECaLS_13999_z decam/CP/V4.8.2a/CP20180829/c4d_180830_024037_ooi_z_ls9.fits.fz c4d_180812_032938_ooi_g_ls9-N12 g expnum 764589 exptime 118.0 propid 2014B-0404 seeing 1.05 MJD 58342.146 object DECaLS_13999_g decam/CP/V4.8.2a/CP20180811/c4d_180812_032938_ooi_g_ls9.fits.fz c4d_180812_033204_ooi_r_ls9-N12 r expnum 764590 exptime 49.0 propid 2014B-0404 seeing 0.98 MJD 58342.147 object DECaLS_13999_r decam/CP/V4.8.2a/CP20180811/c4d_180812_033204_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180619T072904_oi[N11,noinherit][2046,4094][real]: DECaLS_ Clipping 229 pixels with anomalously large oow values: max 0.0175179 vs median 0.0112751 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a179-z-20160812T044139_oi[N11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T031734_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T002008_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533ab3-r-20180905T063353_oi[S8,noinherit][2046,4094][real]: DECaLS_5 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170821T031253_oi[N11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T032938_oi[N12,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532aaf-r-20180812T033204_oi[N12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952aa76-z-20180830T024037_oi[N12,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 137.79 s, CPU: 1.05 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178604 MB Stage tims finished: 2020-08-10T09:15:05.222795 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170821T031253_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T002008_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180619T072904_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a179-z-20160812T044139_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T032938_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T031734_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532aaf-r-20180812T033204_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.469 s worker CPU, 450.401 s worker Wall, Wall: 137.789 s, Cores in use: 0.05, Total efficiency (on 8 cores): 0.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533ab3-r-20180905T063353_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952aa76-z-20180830T024037_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-10T09:15:05.293679 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06840.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06839.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06711.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06967.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/metrics/cus/reference-custom-336136m06362.fits Stage refs : Wall: 8.96 s, CPU: 1.96 s, VmPeak: 1035 MB, VmSize: 1023 MB, VmRSS: 194 MB, VmData: 227 MB, maxrss: 0.19876 MB Stage refs finished: 2020-08-10T09:15:14.258600 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.966 s, Cores in use: 0.22, Total efficiency (on 8 cores): 2.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T09:15:14.278760 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/metrics/cus/outlier-mask-custom-336136m06362.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/metrics/cus/outliers-pre-custom-336136m06362.jpg Image c4d_180619_072904_ooi_g_ls9-N11 g : masking 0 positive outlier pixels and 102 negative outlier pixels Image c4d_180812_032938_ooi_g_ls9-N12 g : masking 100 positive outlier pixels and 0 negative outlier pixels Image c4d_170821_031253_ooi_r_ls9-N11 r : masking 373 positive outlier pixels and 0 negative outlier pixels Image c4d_180905_063353_ooi_r_ls9-S8 r : masking 147 positive outlier pixels and 0 negative outlier pixels Image c4d_180812_033204_ooi_r_ls9-N12 r : masking 0 positive outlier pixels and 177 negative outlier pixels Image c4d_180830_024037_ooi_z_ls9-N12 z : masking 207 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/metrics/cus/outlier-mask-custom-336136m06362.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/metrics/cus/outliers-post-custom-336136m06362.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/metrics/cus/outliers-masked-pos-custom-336136m06362.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/metrics/cus/outliers-masked-neg-custom-336136m06362.jpg Stage outliers : Wall: 0.91 s, CPU: 0.66 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 207 MB, VmData: 237 MB, maxrss: 0.211988 MB Stage outliers finished: 2020-08-10T09:15:15.186861 Resources for stage outliers : 0.699 s worker CPU, 0.699 s worker Wall, Wall: 0.909 s, Cores in use: 1.49, Total efficiency (on 8 cores): 18.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T09:15:15.295287 Stage halos : Wall: 1.22 s, CPU: 0.54 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 207 MB, VmData: 237 MB, maxrss: 0.21244 MB Stage halos finished: 2020-08-10T09:15:16.517331 Resources for stage halos : 0.208 s worker CPU, 1.387 s worker Wall, Wall: 1.223 s, Cores in use: 0.61, Total efficiency (on 8 cores): 7.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T09:15:16.578129 PSF sigmas in coadd pixels: ['1.84', '1.68', '1.71'] Using average PSF sigma 1.7444350557411663 Gaussian PSF norm 0.16171126052842547 vs pixelized 0.13494718 average tim pixel scale / coadd scale: 1.0011203250250573 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.20', '1.65', '1.59'] Using average PSF sigma 1.8126184751061845 Gaussian PSF norm 0.15562833307067162 vs pixelized 0.12428872 average tim pixel scale / coadd scale: 1.0011353879235685 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.84', '1.42', '1.53'] Using average PSF sigma 1.5967924064610184 Gaussian PSF norm 0.17666341011671438 vs pixelized 0.14671294 average tim pixel scale / coadd scale: 1.001066805080347 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-copsf-z.fits.fz Stage fit_on_coadds : Wall: 1.81 s, CPU: 0.13 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 209 MB, VmData: 238 MB, maxrss: 0.214192 MB Stage fit_on_coadds finished: 2020-08-10T09:15:18.390562 Resources for stage fit_on_coadds : 0.161 s worker CPU, 0.165 s worker Wall, Wall: 1.813 s, Cores in use: 0.16, Total efficiency (on 8 cores): 2.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T09:15:18.401071 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 7 potential peaks Of 7 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept SED z : 4 new peaks Found 12 potential peaks Of 12 potential peaks: 5 in veto map, 0 cut by saddle test, 0 cut by aper test, 7 kept SED r : 7 new peaks Found 16 potential peaks Of 16 potential peaks: 13 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 19 potential peaks Of 19 potential peaks: 14 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 17 potential peaks Of 17 potential peaks: 16 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 15 new sources Median coadd sky for g : -3.745076e-05 Median coadd sky for r : -1.8148081e-05 Median coadd sky for z : 0.00013698133 Stage srcs : Wall: 0.58 s, CPU: 0.55 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.2146 MB Stage srcs finished: 2020-08-10T09:15:18.985458 Resources for stage srcs : 0.072 s worker CPU, 0.072 s worker Wall, Wall: 0.585 s, Cores in use: 1.06, Total efficiency (on 8 cores): 13.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T09:15:18.997395 Blob 1 of 16, id: 4, sources: 1, size: 65x119, npix 5462, brick X: 92,157, Y: 70,189, one pixel: 121 70 Blob 2 of 16, id: 11, sources: 1, size: 29x34, npix 659, brick X: 197,226, Y: 198,232, one pixel: 209 198 Blob 3 of 16, id: 2, sources: 1, size: 31x31, npix 645, brick X: 39,70, Y: 46,77, one pixel: 52 46 Blob 4 of 16, id: 10, sources: 2, size: 32x30, npix 520, brick X: 168,200, Y: 160,190, one pixel: 178 160 Blob 5 of 16, id: 6, sources: 1, size: 25x25, npix 368, brick X: 29,54, Y: 86,111, one pixel: 39 86 Blob 6 of 16, id: 5, sources: 1, size: 20x25, npix 353, brick X: 0,20, Y: 78,103, one pixel: 5 78 Blob 7 of 16, id: 9, sources: 1, size: 22x25, npix 348, brick X: 4,26, Y: 156,181, one pixel: 13 156 Blob 8 of 16, id: 15, sources: 2, size: 28x16, npix 322, brick X: 41,69, Y: 235,251, one pixel: 53 235 Blob 9 of 16, id: 12, sources: 1, size: 22x23, npix 314, brick X: 134,156, Y: 199,222, one pixel: 144 199 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (336.14141, -6.35295), pm (-6.2, -5.8), parallax 1.527 with NanoMaggies: g=23.6, r=22.9, z=20.2 Reset brightness to NanoMaggies: g=21.4, r=19.9, z=18.3 Blob 7 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145828 MB Blob 10 of 16, id: 7, sources: 1, size: 23x21, npix 302, brick X: 48,71, Y: 107,128, one pixel: 57 107 Blob 6 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145684 MB Blob 11 of 16, id: 0, sources: 1, size: 22x23, npix 293, brick X: 123,145, Y: 5,28, one pixel: 134 5 Blob 5 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.14504 MB Blob 12 of 16, id: 1, sources: 1, size: 22x22, npix 292, brick X: 219,241, Y: 22,44, one pixel: 229 22 Blob 3 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145544 MB Blob 13 of 16, id: 3, sources: 1, size: 19x19, npix 217, brick X: 211,230, Y: 61,80, one pixel: 219 61 Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.45 s, CPU: 1.45 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145288 MB Blob 14 of 16, id: 14, sources: 1, size: 19x19, npix 208, brick X: 212,231, Y: 231,250, one pixel: 221 231 Blob 4 finished, total: Wall: 1.58 s, CPU: 1.58 s, VmPeak: 947 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145524 MB Blob 15 of 16, id: 13, sources: 1, size: 15x22, npix 200, brick X: 0,15, Y: 217,239, one pixel: 4 217 Blob 9 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145828 MB Blob 16 of 16, id: 8, sources: 1, size: 17x17, npix 145, brick X: 76,93, Y: 152,169, one pixel: 84 152 Blob 13 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145288 MB Blob 11 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.14504 MB Blob 16 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145288 MB Blob 10 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145684 MB Blob 12 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145544 MB Blob 14 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 947 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145524 MB Blob 8 finished, total: Wall: 2.06 s, CPU: 2.06 s, VmPeak: 935 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145404 MB Blob 15 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145828 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.152094, ee1=0.0907651, ee2=-0.0016228 Blob 1 finished, total: Wall: 3.61 s, CPU: 3.61 s, VmPeak: 922 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147504 MB Old catalog: 20 New catalog: 17 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/metrics/cus/blobs-custom-336136m06362.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/metrics/cus/all-models-custom-336136m06362.fits Stage fitblobs : Wall: 3.96 s, CPU: 0.35 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.214744 MB Stage fitblobs finished: 2020-08-10T09:15:22.952526 Resources for stage fitblobs : 17.128 s worker CPU, 17.220 s worker Wall, Wall: 3.956 s, Cores in use: 4.42, Total efficiency (on 8 cores): 55.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T09:15:22.966512 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/tmp-legacysurvey-custom-336136m06362-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/tmp-legacysurvey-custom-336136m06362-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/tmp-legacysurvey-custom-336136m06362-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/tmp-legacysurvey-custom-336136m06362-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-resid.jpg Stage coadds : Wall: 1.40 s, CPU: 0.69 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.21528 MB Stage coadds finished: 2020-08-10T09:15:24.362008 Resources for stage coadds : 3.583 s worker CPU, 4.175 s worker Wall, Wall: 1.396 s, Cores in use: 3.06, Total efficiency (on 8 cores): 38.3 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T09:15:24.373027 Cut to 1 unWISE tiles Reading WISE tile 3356m061 band 1 Reading WISE tile 3356m061 band 3 Reading WISE tile 3356m061 band 2 Reading WISE tile 3356m061 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 968 MB, VmSize: 800 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.204576 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.193224 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 922 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209312 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3356m061/unwise-3356m061-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 941 MB, VmSize: 800 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.205172 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/tmp-legacysurvey-custom-336136m06362-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/tmp-legacysurvey-custom-336136m06362-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.82 s, CPU: 0.42 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.215984 MB Stage wise_forced finished: 2020-08-10T09:15:26.193337 Resources for stage wise_forced : 3.130 s worker CPU, 5.037 s worker Wall, Wall: 1.821 s, Cores in use: 1.95, Total efficiency (on 8 cores): 24.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T09:15:26.205403 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/coadd/cus/custom-336136m06362/legacysurvey-custom-336136m06362-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/tractor-i/cus/tractor-custom-336136m06362.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/tractor/cus/tractor-custom-336136m06362.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/tractor/cus/brick-custom-336136m06362.sha256sum Stage writecat : Wall: 0.63 s, CPU: 0.47 s, VmPeak: 1166 MB, VmSize: 1038 MB, VmRSS: 213 MB, VmData: 238 MB, maxrss: 0.348792 MB Stage writecat finished: 2020-08-10T09:15:26.837395 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.633 s, Cores in use: 0.75, Total efficiency (on 8 cores): 9.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1033748/PGC1033748-largegalaxy-writecat.p All done: 30.451 s worker CPU, 479.159 s worker Wall, Wall: 159.418 s, Cores in use: 0.23, Total efficiency (on 8 cores): 2.9 % Finished galaxy PGC1033748 in 2.690 minutes.