Started working on galaxy PGC440416 at Wed Aug 5 21:44:39 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.523846 -52.67175579999999 --width 345 --height 345 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:44:40.696785 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '299.523846', '-52.67175579999999', '--width', '345', '--height', '345', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.523846 -52.67175579999999 --width 345 --height 345 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 299.523846 -52.67175579999999 Starting process 38919 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 38920 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 38921 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 38922 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 38923 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB Starting process 38924 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 38925 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 38926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 38927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 38928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 38929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 38930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 38931 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 38932 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 38933 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 38934 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:44:41.174113 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 10 CCDs: c4d_170912_005509_ooi_z_v1-S3 z expnum 676727 exptime 90.0 propid 2012B-0001 seeing 1.47 MJD 58008.038 object DES survey hex -611-532 tiling 9 decam/CP/V4.1/CP20170911/c4d_170912_005509_ooi_z_v1.fits.fz c4d_170912_005113_ooi_r_v1-S3 r expnum 676725 exptime 90.0 propid 2012B-0001 seeing 1.75 MJD 58008.036 object DES survey hex -611-532 tiling 9 decam/CP/V4.1/CP20170911/c4d_170912_005113_ooi_r_v1.fits.fz c4d_170923_000749_ooi_r_v1-S3 r expnum 680410 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 58019.005 object DES survey hex -611-532 tiling 9 decam/CP/V4.1/CP20170922/c4d_170923_000749_ooi_r_v1.fits.fz c4d_170923_001545_ooi_g_v1-S3 g expnum 680414 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 58019.011 object DES survey hex -611-532 tiling 9 decam/CP/V4.1/CP20170922/c4d_170923_001545_ooi_g_v1.fits.fz c4d_160909_235459_ooi_z_ls9-S2 z expnum 572890 exptime 90.0 propid 2012B-0001 seeing 1.54 MJD 57640.995 object DES survey hex -611-532 tiling 7 decam/CP/V4.8.2a/CP20160909/c4d_160909_235459_ooi_z_ls9.fits.fz c4d_160929_000425_ooi_r_ls9-S2 r expnum 578577 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57660.001 object DES survey hex -611-532 tiling 7 decam/CP/V4.8.2a/CP20160928/c4d_160929_000425_ooi_r_ls9.fits.fz c4d_160929_000621_ooi_g_ls9-S2 g expnum 578578 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57660.003 object DES survey hex -611-532 tiling 7 decam/CP/V4.8.2a/CP20160928/c4d_160929_000621_ooi_g_ls9.fits.fz c4d_160910_234044_ooi_z_ls9-S2 z expnum 573333 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57641.985 object DES survey hex -611-532 tiling 7 decam/CP/V4.8.2a/CP20160910/c4d_160910_234044_ooi_z_ls9.fits.fz c4d_130901_013104_ooi_r_ls9-S8 r expnum 229293 exptime 90.0 propid 2012B-0001 seeing 0.92 MJD 56536.063 object DES survey hex -582-521 tiling 3 decam/CP/V4.8.2a/CP20130831/c4d_130901_013104_ooi_r_ls9.fits.fz c4d_130831_235707_ooi_g_ls9-S8 g expnum 229251 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 56535.998 object DES survey hex -582-521 tiling 3 decam/CP/V4.8.2a/CP20130831/c4d_130831_235707_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9632a12-r-20130901T013104_oi[S8,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d087-r-20160929T000201_oi[S2,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962fa53-g-20130831T235707_oi[S8,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S3,noinherit][2046,4094][real]: DES Zeroing out 11 weight-map pixels below quantization error (= median 0.000183) Clipping 1 pixels with anomalously large oow values: max 0.041241 vs median 0.0316017 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c605-g-20160929T000400_oi[S2,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S3,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160910T233824_oi[S2,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160909T235241_oi[S2,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S3,noinherit][2046,4094][real]: DES CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 124 weight-map pixels below quantization error (= median 4.29e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 5577 weight-map pixels below quantization error (= median 4.36e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S3,noinherit][2046,4094][real]: DES Zeroing out 2 weight-map pixels below quantization error (= median 5.38e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 138.53 s, CPU: 1.07 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 184 MB, VmData: 216 MB, maxrss: 0.18866 MB Stage tims finished: 2020-08-05T21:46:59.706344 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d087-r-20160929T000201_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c605-g-20160929T000400_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160909T235241_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160910T233824_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9632a12-r-20130901T013104_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962fa53-g-20130831T235707_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.910 s worker CPU, 431.396 s worker Wall, Wall: 138.534 s, Cores in use: 0.05, Total efficiency (on 16 cores): 0.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:47:00.003167 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11167.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10970.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11070.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11071.fits Matched 23 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/metrics/cus/reference-custom-299523m52671.fits Stage refs : Wall: 19.42 s, CPU: 7.40 s, VmPeak: 1090 MB, VmSize: 1085 MB, VmRSS: 261 MB, VmData: 290 MB, maxrss: 0.266868 MB Stage refs finished: 2020-08-05T21:47:19.425542 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 19.424 s, Cores in use: 0.38, Total efficiency (on 16 cores): 2.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:47:19.462379 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/metrics/cus/outlier-mask-custom-299523m52671.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/metrics/cus/outliers-pre-custom-299523m52671.jpg Image c4d_170923_001545_ooi_g_v1-S3 g : masking 1760 positive outlier pixels and 0 negative outlier pixels Image c4d_130901_013104_ooi_r_ls9-S8 r : masking 158 positive outlier pixels and 0 negative outlier pixels Image c4d_170912_005113_ooi_r_v1-S3 r : masking 4378 positive outlier pixels and 0 negative outlier pixels Image c4d_170923_000749_ooi_r_v1-S3 r : masking 383 positive outlier pixels and 0 negative outlier pixels Image c4d_170912_005509_ooi_z_v1-S3 z : masking 440 positive outlier pixels and 0 negative outlier pixels Image c4d_160909_235459_ooi_z_ls9-S2 z : masking 1651 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/metrics/cus/outlier-mask-custom-299523m52671.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/metrics/cus/outliers-post-custom-299523m52671.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/metrics/cus/outliers-masked-pos-custom-299523m52671.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/metrics/cus/outliers-masked-neg-custom-299523m52671.jpg Stage outliers : Wall: 1.97 s, CPU: 1.54 s, VmPeak: 1095 MB, VmSize: 1095 MB, VmRSS: 283 MB, VmData: 309 MB, maxrss: 0.289312 MB Stage outliers finished: 2020-08-05T21:47:21.430904 Resources for stage outliers : 1.689 s worker CPU, 1.869 s worker Wall, Wall: 1.970 s, Cores in use: 1.64, Total efficiency (on 16 cores): 10.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:47:21.465368 Stage halos : Wall: 1.38 s, CPU: 0.53 s, VmPeak: 1095 MB, VmSize: 1095 MB, VmRSS: 283 MB, VmData: 310 MB, maxrss: 0.289612 MB Stage halos finished: 2020-08-05T21:47:22.846402 Resources for stage halos : 0.851 s worker CPU, 2.754 s worker Wall, Wall: 1.382 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T21:47:23.429541 PSF sigmas in coadd pixels: ['1.83', '1.64', '1.93'] Using average PSF sigma 1.8003477478258425 Gaussian PSF norm 0.15668905749711123 vs pixelized 0.12962067 average tim pixel scale / coadd scale: 1.0010014547618062 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.83', '1.63', '1.59', '1.50'] Using average PSF sigma 1.8885905742548625 Gaussian PSF norm 0.14936789138915288 vs pixelized 0.12783392 average tim pixel scale / coadd scale: 1.0010218579910397 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.39', '2.50', '1.72'] Using average PSF sigma 2.202489994142972 Gaussian PSF norm 0.1280799424851173 vs pixelized 0.09743427 average tim pixel scale / coadd scale: 1.0009625311656534 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.27 s, CPU: 0.25 s, VmPeak: 1095 MB, VmSize: 1095 MB, VmRSS: 286 MB, VmData: 311 MB, maxrss: 0.292596 MB Stage fit_on_coadds finished: 2020-08-05T21:47:23.703982 Resources for stage fit_on_coadds : 0.445 s worker CPU, 0.445 s worker Wall, Wall: 0.276 s, Cores in use: 2.53, Total efficiency (on 16 cores): 15.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:47:23.717014 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 296 potential peaks Of 296 potential peaks: 263 in veto map, 9 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 80 potential peaks Of 80 potential peaks: 44 in veto map, 11 cut by saddle test, 0 cut by aper test, 25 kept SED r : 25 new peaks Found 59 potential peaks Of 59 potential peaks: 49 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 111 potential peaks Of 111 potential peaks: 95 in veto map, 10 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 112 potential peaks Of 112 potential peaks: 101 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 59 new sources Median coadd sky for g : -6.158244e-05 Median coadd sky for r : -4.8994414e-05 Median coadd sky for z : 0.00081694033 Stage srcs : Wall: 0.97 s, CPU: 0.89 s, VmPeak: 1095 MB, VmSize: 1095 MB, VmRSS: 286 MB, VmData: 311 MB, maxrss: 0.293324 MB Stage srcs finished: 2020-08-05T21:47:24.682403 Resources for stage srcs : 0.180 s worker CPU, 0.180 s worker Wall, Wall: 0.967 s, Cores in use: 1.11, Total efficiency (on 16 cores): 6.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:47:24.699261 Blob 1 of 21, id: 0, sources: 45, size: 345x345, npix 41841, brick X: 0,345, Y: 0,345, one pixel: 16 0 Blob 2 of 21, id: 8, sources: 5, size: 100x84, npix 5281, brick X: 234,334, Y: 54,138, one pixel: 259 54 Blob 3 of 21, id: 16, sources: 7, size: 91x72, npix 3592, brick X: 88,179, Y: 266,338, one pixel: 98 266 Blob 4 of 21, id: 7, sources: 2, size: 70x83, npix 3508, brick X: 147,217, Y: 36,119, one pixel: 165 36 Blob 5 of 21, id: 1, sources: 2, size: 38x47, npix 1198, brick X: 132,170, Y: 2,49, one pixel: 146 2 Blob 6 of 21, id: 18, sources: 2, size: 32x36, npix 791, brick X: 298,330, Y: 291,327, one pixel: 311 291 Blob 7 of 21, id: 3, sources: 1, size: 30x41, npix 755, brick X: 212,242, Y: 24,65, one pixel: 221 24 Blob 8 of 21, id: 15, sources: 1, size: 28x35, npix 657, brick X: 239,267, Y: 253,288, one pixel: 252 253 Blob 9 of 21, id: 12, sources: 1, size: 28x36, npix 645, brick X: 155,183, Y: 225,261, one pixel: 167 225 Blob 10 of 21, id: 19, sources: 1, size: 30x29, npix 558, brick X: 217,247, Y: 311,340, one pixel: 228 311 Blob 11 of 21, id: 2, sources: 1, size: 23x24, npix 349, brick X: 176,199, Y: 11,35, one pixel: 186 11 Blob 12 of 21, id: 13, sources: 1, size: 20x24, npix 340, brick X: 325,345, Y: 236,260, one pixel: 334 236 Blob 13 of 21, id: 9, sources: 1, size: 23x23, npix 317, brick X: 124,147, Y: 60,83, one pixel: 135 60 Blob 14 of 21, id: 11, sources: 1, size: 20x22, npix 258, brick X: 125,145, Y: 220,242, one pixel: 134 220 Blob 15 of 21, id: 17, sources: 1, size: 20x21, npix 249, brick X: 73,93, Y: 282,303, one pixel: 82 282 Blob 16 of 21, id: 20, sources: 1, size: 24x15, npix 246, brick X: 300,324, Y: 330,345, one pixel: 311 330 Blob 17 of 21, id: 5, sources: 1, size: 15x24, npix 239, brick X: 330,345, Y: 31,55, one pixel: 339 31 Blob 14 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156432 MB Blob 18 of 21, id: 4, sources: 1, size: 21x20, npix 238, brick X: 244,265, Y: 24,44, one pixel: 254 24 Blob 13 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 951 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 186 MB, maxrss: 0.15664 MB Blob 19 of 21, id: 10, sources: 1, size: 19x19, npix 217, brick X: 216,235, Y: 69,88, one pixel: 224 69 Blob 12 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 114 MB, VmData: 166 MB, maxrss: 0.117148 MB Blob 20 of 21, id: 14, sources: 1, size: 20x20, npix 209, brick X: 298,318, Y: 242,262, one pixel: 308 242 Blob 15 finished, total: Wall: 0.62 s, CPU: 0.50 s, VmPeak: 957 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 186 MB, maxrss: 0.1565 MB Blob 21 of 21, id: 6, sources: 1, size: 19x18, npix 198, brick X: 281,300, Y: 32,50, one pixel: 289 32 Blob 11 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096532 MB Measuring 1 iterative sources Blob 20 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 957 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 186 MB, maxrss: 0.156892 MB Blob 21 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 669 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.09668 MB Blob 7 finished, total: Wall: 1.15 s, CPU: 1.15 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.117216 MB Blob 16 finished, total: Wall: 1.27 s, CPU: 1.16 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 99 MB, VmData: 144 MB, maxrss: 0.1012 MB Blob 19 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.117288 MB Blob 18 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 951 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 186 MB, maxrss: 0.15664 MB Blob 10 finished, total: Wall: 1.50 s, CPU: 1.50 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.097132 MB Measuring 1 iterative sources Blob 17 finished, total: Wall: 1.66 s, CPU: 1.66 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156912 MB Blob 6 finished, total: Wall: 1.92 s, CPU: 1.91 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156656 MB Measuring 1 iterative sources Measuring 1 iterative sources Measuring 1 iterative sources Blob 9 finished, total: Wall: 2.51 s, CPU: 2.51 s, VmPeak: 1013 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 181 MB, maxrss: 0.152136 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 2.59 s, CPU: 2.59 s, VmPeak: 1016 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151232 MB Blob 5 finished, total: Wall: 2.85 s, CPU: 2.85 s, VmPeak: 953 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.15716 MB Blob 4 finished, total: Wall: 2.88 s, CPU: 2.88 s, VmPeak: 1013 MB, VmSize: 738 MB, VmRSS: 155 MB, VmData: 187 MB, maxrss: 0.15822 MB Blob 2 finished, total: Wall: 3.11 s, CPU: 3.11 s, VmPeak: 1011 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150816 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 4.60 s, CPU: 4.60 s, VmPeak: 955 MB, VmSize: 738 MB, VmRSS: 155 MB, VmData: 187 MB, maxrss: 0.158344 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.66749, -52.55434), pm (2.4, -13.9), parallax 0.965 with NanoMaggies: g=10.1, r=8.66, z=7.51 Reset brightness to NanoMaggies: g=10.1, r=8.66, z=7.51 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.55551, -52.67250), pm (-1.2, -5.2), parallax 0.415 with NanoMaggies: g=12.9, r=11.3, z=8.67 Reset brightness to NanoMaggies: g=12.9, r=11.3, z=8.67 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.55110, -52.66312), pm (0.2, -4.5), parallax 0.702 with NanoMaggies: g=15.3, r=14.9, z=14.8 Reset brightness to NanoMaggies: g=15.3, r=14.9, z=14.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.53893, -52.65879), pm (-9.2, -3.5), parallax 0.079 with NanoMaggies: g=15.2, r=15.5, z=15.9 Reset brightness to NanoMaggies: g=14.9, r=15.2, z=15.5 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=-4.60517, ee1=1.39054, ee2=0.420882 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.54598, -52.65930), pm (2.7, -7.6), parallax 0.210 with NanoMaggies: g=16.2, r=15.5, z=15.6 Reset brightness to NanoMaggies: g=19.2, r=18.7, z=18.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.54533, -52.66555), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=16.1, r=15.4, z=15.4 Reset brightness to NanoMaggies: g=19.9, r=18.9, z=18.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.54719, -52.66123), pm (-7.0, -2.4), parallax 0.182 with NanoMaggies: g=16.9, r=15.7, z=15.2 Reset brightness to NanoMaggies: g=19.7, r=19.2, z=19.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.54324, -52.65874), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=19.5, r=18.7, z=18.2 Reset brightness to NanoMaggies: g=21.8, r=20.7, z=20.1 Measuring 2 iterative sources Blob 1 finished, total: Wall: 42.31 s, CPU: 42.29 s, VmPeak: 749 MB, VmSize: 741 MB, VmRSS: 177 MB, VmData: 212 MB, maxrss: 0.18408 MB Old catalog: 82 New catalog: 75 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/metrics/cus/blobs-custom-299523m52671.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/metrics/cus/all-models-custom-299523m52671.fits Stage fitblobs : Wall: 42.87 s, CPU: 0.48 s, VmPeak: 1095 MB, VmSize: 1095 MB, VmRSS: 290 MB, VmData: 316 MB, maxrss: 0.296484 MB Stage fitblobs finished: 2020-08-05T21:48:07.568745 Resources for stage fitblobs : 73.213 s worker CPU, 73.604 s worker Wall, Wall: 42.871 s, Cores in use: 1.72, Total efficiency (on 16 cores): 10.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:48:07.590734 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-resid.jpg Stage coadds : Wall: 3.07 s, CPU: 0.88 s, VmPeak: 1095 MB, VmSize: 1095 MB, VmRSS: 290 MB, VmData: 316 MB, maxrss: 0.296808 MB Stage coadds finished: 2020-08-05T21:48:10.663406 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 11.888 s worker CPU, 16.849 s worker Wall, Wall: 3.074 s, Cores in use: 4.15, Total efficiency (on 16 cores): 26.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:48:10.681544 Cut to 2 unWISE tiles Reading WISE tile 2983m531 band 1 Reading WISE tile 2983m531 band 2 Reading WISE tile 2983m531 band 3 Reading WISE tile 2983m531 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.23 s, CPU: 0.65 s, VmPeak: 1020 MB, VmSize: 1020 MB, VmRSS: 159 MB, VmData: 194 MB, maxrss: 0.19598 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.19 s, CPU: 0.50 s, VmPeak: 1013 MB, VmSize: 1012 MB, VmRSS: 150 MB, VmData: 185 MB, maxrss: 0.210888 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.15 s, CPU: 0.35 s, VmPeak: 1076 MB, VmSize: 1012 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.20912 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.16 s, CPU: 0.36 s, VmPeak: 1074 MB, VmSize: 1010 MB, VmRSS: 147 MB, VmData: 186 MB, maxrss: 0.210348 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 11.01 s, CPU: 0.71 s, VmPeak: 1095 MB, VmSize: 1095 MB, VmRSS: 290 MB, VmData: 316 MB, maxrss: 0.29732 MB Stage wise_forced finished: 2020-08-05T21:48:21.694835 Resources for stage wise_forced : 7.598 s worker CPU, 16.699 s worker Wall, Wall: 11.015 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:48:21.714222 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/tractor-i/cus/tractor-custom-299523m52671.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/tractor/cus/tractor-custom-299523m52671.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/tractor/cus/brick-custom-299523m52671.sha256sum Stage writecat : Wall: 1.03 s, CPU: 0.69 s, VmPeak: 1227 MB, VmSize: 1099 MB, VmRSS: 292 MB, VmData: 316 MB, maxrss: 0.430196 MB Stage writecat finished: 2020-08-05T21:48:22.747423 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.035 s, Cores in use: 0.66, Total efficiency (on 16 cores): 4.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC440416/PGC440416-largegalaxy-writecat.p All done: 101.778 s worker CPU, 543.800 s worker Wall, Wall: 221.636 s, Cores in use: 0.53, Total efficiency (on 16 cores): 3.3 % Finished galaxy PGC440416 in 3.725 minutes. Started working on galaxy PGC440416 at Thu Aug 13 07:17:41 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.523846 -52.67175579999999 --width 345 --height 345 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-13T07:17:43.397316 legacypipe git version: DR9.5.11-watershed-9-g82106209 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '299.523846', '-52.67175579999999', '--width', '345', '--height', '345', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.523846 -52.67175579999999 --width 345 --height 345 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 299.523846 -52.67175579999999 Starting process 3983 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 3984 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 3985 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 3986 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 3987 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059468 MB Starting process 3988 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB Starting process 3989 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB Starting process 3990 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 3991 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 3992 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 3993 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 3994 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 3995 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 3996 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 3997 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 3998 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 3999 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 4000 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 4001 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 4002 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 4003 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 4004 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 4005 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 4006 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 4007 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 4008 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 4009 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 4010 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 4011 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 4012 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 4013 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 4014 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-13T07:17:45.418739 Keeping 10 CCDs: c4d_170912_005509_ooi_z_v1-S3 z expnum 676727 exptime 90.0 propid 2012B-0001 seeing 1.47 MJD 58008.038 object DES survey hex -611-532 tiling 9 decam/CP/V4.1/CP20170911/c4d_170912_005509_ooi_z_v1.fits.fz c4d_170912_005113_ooi_r_v1-S3 r expnum 676725 exptime 90.0 propid 2012B-0001 seeing 1.75 MJD 58008.036 object DES survey hex -611-532 tiling 9 decam/CP/V4.1/CP20170911/c4d_170912_005113_ooi_r_v1.fits.fz c4d_170923_000749_ooi_r_v1-S3 r expnum 680410 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 58019.005 object DES survey hex -611-532 tiling 9 decam/CP/V4.1/CP20170922/c4d_170923_000749_ooi_r_v1.fits.fz c4d_170923_001545_ooi_g_v1-S3 g expnum 680414 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 58019.011 object DES survey hex -611-532 tiling 9 decam/CP/V4.1/CP20170922/c4d_170923_001545_ooi_g_v1.fits.fz c4d_160909_235459_ooi_z_ls9-S2 z expnum 572890 exptime 90.0 propid 2012B-0001 seeing 1.54 MJD 57640.995 object DES survey hex -611-532 tiling 7 decam/CP/V4.8.2a/CP20160909/c4d_160909_235459_ooi_z_ls9.fits.fz c4d_160929_000425_ooi_r_ls9-S2 r expnum 578577 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57660.001 object DES survey hex -611-532 tiling 7 decam/CP/V4.8.2a/CP20160928/c4d_160929_000425_ooi_r_ls9.fits.fz c4d_160929_000621_ooi_g_ls9-S2 g expnum 578578 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57660.003 object DES survey hex -611-532 tiling 7 decam/CP/V4.8.2a/CP20160928/c4d_160929_000621_ooi_g_ls9.fits.fz c4d_160910_234044_ooi_z_ls9-S2 z expnum 573333 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57641.985 object DES survey hex -611-532 tiling 7 decam/CP/V4.8.2a/CP20160910/c4d_160910_234044_ooi_z_ls9.fits.fz c4d_130901_013104_ooi_r_ls9-S8 r expnum 229293 exptime 90.0 propid 2012B-0001 seeing 0.92 MJD 56536.063 object DES survey hex -582-521 tiling 3 decam/CP/V4.8.2a/CP20130831/c4d_130901_013104_ooi_r_ls9.fits.fz c4d_130831_235707_ooi_g_ls9-S8 g expnum 229251 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 56535.998 object DES survey hex -582-521 tiling 3 decam/CP/V4.8.2a/CP20130831/c4d_130831_235707_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S3,noinherit][2046,4094][real]: DES Zeroing out 11 weight-map pixels below quantization error (= median 0.000183) Clipping 1 pixels with anomalously large oow values: max 0.041241 vs median 0.0316017 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9632a12-r-20130901T013104_oi[S8,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d087-r-20160929T000201_oi[S2,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962fa53-g-20130831T235707_oi[S8,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160909T235241_oi[S2,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S3,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c605-g-20160929T000400_oi[S2,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S3,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160910T233824_oi[S2,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S3,noinherit][2046,4094][real]: DES Stage tims : Wall: 8.17 s, CPU: 1.15 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 182 MB, VmData: 216 MB, maxrss: 0.186712 MB Stage tims finished: 2020-08-13T07:17:53.591702 Zeroing out 124 weight-map pixels below quantization error (= median 4.29e-05) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9632a12-r-20130901T013104_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d087-r-20160929T000201_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160909T235241_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Resources for stage tims : 5.220 s worker CPU, 51.090 s worker Wall, Wall: 8.175 s, Cores in use: 0.78, Total efficiency (on 32 cores): 2.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962fa53-g-20130831T235707_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c605-g-20160929T000400_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160910T233824_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Running stage refs at 2020-08-13T07:17:53.622192 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11167.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10970.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11070.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11071.fits Matched 23 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/metrics/cus/reference-custom-299523m52671.fits Stage refs : Wall: 7.71 s, CPU: 6.43 s, VmPeak: 1083 MB, VmSize: 1079 MB, VmRSS: 259 MB, VmData: 290 MB, maxrss: 0.265096 MB Stage refs finished: 2020-08-13T07:18:01.332374 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Zeroing out 2 weight-map pixels below quantization error (= median 5.38e-05) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 7.712 s, Cores in use: 0.83, Total efficiency (on 32 cores): 2.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-refs.p Running stage outliers Zeroing out 5577 weight-map pixels below quantization error (= median 4.36e-06) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Running stage outliers at 2020-08-13T07:18:01.374022 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/metrics/cus/outlier-mask-custom-299523m52671.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/metrics/cus/outliers-pre-custom-299523m52671.jpg Image c4d_170923_001545_ooi_g_v1-S3 g : masking 1760 positive outlier pixels and 0 negative outlier pixels Image c4d_130901_013104_ooi_r_ls9-S8 r : masking 158 positive outlier pixels and 0 negative outlier pixels Image c4d_170923_000749_ooi_r_v1-S3 r : masking 383 positive outlier pixels and 0 negative outlier pixels Image c4d_170912_005113_ooi_r_v1-S3 r : masking 4378 positive outlier pixels and 0 negative outlier pixels Image c4d_160909_235459_ooi_z_ls9-S2 z : masking 1651 positive outlier pixels and 0 negative outlier pixels Image c4d_170912_005509_ooi_z_v1-S3 z : masking 440 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/metrics/cus/outlier-mask-custom-299523m52671.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/metrics/cus/outliers-post-custom-299523m52671.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/metrics/cus/outliers-masked-pos-custom-299523m52671.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/metrics/cus/outliers-masked-neg-custom-299523m52671.jpg Stage outliers : Wall: 1.89 s, CPU: 1.31 s, VmPeak: 1089 MB, VmSize: 1089 MB, VmRSS: 282 MB, VmData: 311 MB, maxrss: 0.28928 MB Stage outliers finished: 2020-08-13T07:18:03.262342 Resources for stage outliers : 1.742 s worker CPU, 2.130 s worker Wall, Wall: 1.891 s, Cores in use: 1.62, Total efficiency (on 32 cores): 5.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-13T07:18:03.595745 Stage halos : Wall: 0.83 s, CPU: 0.64 s, VmPeak: 1089 MB, VmSize: 1089 MB, VmRSS: 283 MB, VmData: 311 MB, maxrss: 0.289648 MB Stage halos finished: 2020-08-13T07:18:04.429108 Resources for stage halos : 0.956 s worker CPU, 1.512 s worker Wall, Wall: 0.836 s, Cores in use: 1.92, Total efficiency (on 32 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-13T07:18:04.471699 PSF sigmas in coadd pixels: ['1.83', '1.64', '1.93'] Using average PSF sigma 1.8003477478258425 Gaussian PSF norm 0.15668905749711123 vs pixelized 0.12962067 average tim pixel scale / coadd scale: 1.0010014547618062 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.83', '1.63', '1.59', '1.50'] Using average PSF sigma 1.8885905742548625 Gaussian PSF norm 0.14936789138915288 vs pixelized 0.12783392 average tim pixel scale / coadd scale: 1.0010218579910397 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.39', '2.50', '1.72'] Using average PSF sigma 2.202489994142972 Gaussian PSF norm 0.1280799424851173 vs pixelized 0.09743427 average tim pixel scale / coadd scale: 1.0009625311656534 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.28 s, CPU: 0.25 s, VmPeak: 1089 MB, VmSize: 1089 MB, VmRSS: 284 MB, VmData: 311 MB, maxrss: 0.291116 MB Stage fit_on_coadds finished: 2020-08-13T07:18:04.754322 Resources for stage fit_on_coadds : 0.387 s worker CPU, 0.387 s worker Wall, Wall: 0.285 s, Cores in use: 2.24, Total efficiency (on 32 cores): 7.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-13T07:18:04.777623 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 296 potential peaks Of 296 potential peaks: 263 in veto map, 9 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 80 potential peaks Of 80 potential peaks: 44 in veto map, 11 cut by saddle test, 0 cut by aper test, 25 kept SED r : 25 new peaks Found 59 potential peaks Of 59 potential peaks: 49 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 111 potential peaks Of 111 potential peaks: 95 in veto map, 10 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 112 potential peaks Of 112 potential peaks: 101 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 59 new sources Median coadd sky for g : -6.1582476e-05 Median coadd sky for r : -4.8994414e-05 Median coadd sky for z : 0.00081694033 Stage srcs : Wall: 1.32 s, CPU: 1.25 s, VmPeak: 1089 MB, VmSize: 1089 MB, VmRSS: 285 MB, VmData: 311 MB, maxrss: 0.291636 MB Stage srcs finished: 2020-08-13T07:18:06.101306 Resources for stage srcs : 0.144 s worker CPU, 0.144 s worker Wall, Wall: 1.326 s, Cores in use: 1.06, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-13T07:18:06.131450 Blob 1 of 21, id: 0, sources: 45, size: 345x345, npix 41841, brick X: 0,345, Y: 0,345, one pixel: 16 0 Blob 2 of 21, id: 8, sources: 5, size: 100x84, npix 5281, brick X: 234,334, Y: 54,138, one pixel: 259 54 Blob 3 of 21, id: 16, sources: 7, size: 91x72, npix 3592, brick X: 88,179, Y: 266,338, one pixel: 98 266 Blob 4 of 21, id: 7, sources: 2, size: 70x83, npix 3508, brick X: 147,217, Y: 36,119, one pixel: 165 36 Blob 5 of 21, id: 1, sources: 2, size: 38x47, npix 1198, brick X: 132,170, Y: 2,49, one pixel: 146 2 Blob 6 of 21, id: 18, sources: 2, size: 32x36, npix 791, brick X: 298,330, Y: 291,327, one pixel: 311 291 Blob 7 of 21, id: 3, sources: 1, size: 30x41, npix 755, brick X: 212,242, Y: 24,65, one pixel: 221 24 Blob 8 of 21, id: 15, sources: 1, size: 28x35, npix 657, brick X: 239,267, Y: 253,288, one pixel: 252 253 Blob 9 of 21, id: 12, sources: 1, size: 28x36, npix 645, brick X: 155,183, Y: 225,261, one pixel: 167 225 Blob 10 of 21, id: 19, sources: 1, size: 30x29, npix 558, brick X: 217,247, Y: 311,340, one pixel: 228 311 Blob 11 of 21, id: 2, sources: 1, size: 23x24, npix 349, brick X: 176,199, Y: 11,35, one pixel: 186 11 Blob 12 of 21, id: 13, sources: 1, size: 20x24, npix 340, brick X: 325,345, Y: 236,260, one pixel: 334 236 Blob 13 of 21, id: 9, sources: 1, size: 23x23, npix 317, brick X: 124,147, Y: 60,83, one pixel: 135 60 Blob 14 of 21, id: 11, sources: 1, size: 20x22, npix 258, brick X: 125,145, Y: 220,242, one pixel: 134 220 Blob 15 of 21, id: 17, sources: 1, size: 20x21, npix 249, brick X: 73,93, Y: 282,303, one pixel: 82 282 Blob 16 of 21, id: 20, sources: 1, size: 24x15, npix 246, brick X: 300,324, Y: 330,345, one pixel: 311 330 Blob 17 of 21, id: 5, sources: 1, size: 15x24, npix 239, brick X: 330,345, Y: 31,55, one pixel: 339 31 Blob 18 of 21, id: 4, sources: 1, size: 21x20, npix 238, brick X: 244,265, Y: 24,44, one pixel: 254 24 Blob 19 of 21, id: 10, sources: 1, size: 19x19, npix 217, brick X: 216,235, Y: 69,88, one pixel: 224 69 Blob 20 of 21, id: 14, sources: 1, size: 20x20, npix 209, brick X: 298,318, Y: 242,262, one pixel: 308 242 Blob 21 of 21, id: 6, sources: 1, size: 19x18, npix 198, brick X: 281,300, Y: 32,50, one pixel: 289 32 Blob 14 finished, total: Wall: 0.10 s, CPU: 0.08 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145668 MB Blob 21 finished, total: Wall: 0.11 s, CPU: 0.10 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 93 MB, VmData: 144 MB, maxrss: 0.095328 MB Blob 13 finished, total: Wall: 0.25 s, CPU: 0.23 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094084 MB Blob 20 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14466 MB Blob 12 finished, total: Wall: 0.27 s, CPU: 0.26 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 114 MB, VmData: 166 MB, maxrss: 0.116944 MB Blob 15 finished, total: Wall: 0.35 s, CPU: 0.34 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.09404 MB Blob 18 finished, total: Wall: 0.59 s, CPU: 0.58 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101432 MB Measuring 1 iterative sources Blob 19 finished, total: Wall: 0.74 s, CPU: 0.73 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.116432 MB Blob 7 finished, total: Wall: 0.77 s, CPU: 0.75 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.146996 MB Blob 11 finished, total: Wall: 0.78 s, CPU: 0.77 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 114 MB, VmData: 166 MB, maxrss: 0.116928 MB Blob 16 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 1011 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145656 MB Blob 10 finished, total: Wall: 1.03 s, CPU: 1.02 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099488 MB Measuring 1 iterative sources Blob 17 finished, total: Wall: 1.37 s, CPU: 1.36 s, VmPeak: 1013 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147116 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.54 s, CPU: 1.52 s, VmPeak: 1016 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147236 MB Measuring 1 iterative sources Blob 9 finished, total: Wall: 1.95 s, CPU: 1.93 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14576 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 2.36 s, CPU: 2.35 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.09488 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 2.41 s, CPU: 2.40 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 116 MB, VmData: 167 MB, maxrss: 0.118632 MB Blob 4 finished, total: Wall: 2.73 s, CPU: 2.72 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099292 MB Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.51166, -52.67772), pm (5.4, -17.1), parallax 0.860 with NanoMaggies: g=15.1, r=14.7, z=14.5 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.50710, -52.67757), pm (5.5, -5.6), parallax -0.011 with NanoMaggies: g=19.4, r=18.8, z=18.4 cat entry: tabledata object with 1 rows and 62 columns Blob 2 finished, total: Wall: 2.98 s, CPU: 2.98 s, VmPeak: 674 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.100692 MB Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.52565, -52.66340), pm (-0.7, -6.5), parallax -0.062 with NanoMaggies: g=20.1, r=19.4, z=19.1 cat entry: tabledata object with 1 rows and 62 columns Measuring 1 iterative sources Blob 3 finished, total: Wall: 4.56 s, CPU: 4.56 s, VmPeak: 674 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.100632 MB Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.66749, -52.55434), pm (2.4, -13.9), parallax 0.965 with NanoMaggies: g=10.1, r=8.66, z=7.51 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.55551, -52.67250), pm (-1.2, -5.2), parallax 0.415 with NanoMaggies: g=12.9, r=11.3, z=8.67 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.55110, -52.66312), pm (0.2, -4.5), parallax 0.702 with NanoMaggies: g=15.3, r=14.9, z=14.8 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.53893, -52.65879), pm (-9.2, -3.5), parallax 0.079 with NanoMaggies: g=15, r=15.2, z=15.8 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.52867, -52.67320), pm (8.8, -7.1), parallax 0.999 with NanoMaggies: g=19.1, r=18.2, z=17.6 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.53612, -52.66056), pm (5.1, -12.9), parallax 0.532 with NanoMaggies: g=19.1, r=18.7, z=18.5 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.54598, -52.65930), pm (2.7, -7.6), parallax 0.210 with NanoMaggies: g=16.4, r=15.7, z=15.7 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.53661, -52.67770), pm (-4.4, -7.8), parallax 0.001 with NanoMaggies: g=20.2, r=18.9, z=18 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.54533, -52.66555), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=16, r=15.4, z=15.3 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.53207, -52.67471), pm (6.0, -8.0), parallax 0.764 with NanoMaggies: g=19.7, r=18.9, z=18.5 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.54719, -52.66123), pm (-7.0, -2.4), parallax 0.182 with NanoMaggies: g=16.9, r=15.7, z=15.3 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.54112, -52.68358), pm (-7.5, 6.0), parallax 0.182 with NanoMaggies: g=20.7, r=19.3, z=18.4 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.51236, -52.67160), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=22.8, r=21.2, z=19.1 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.54324, -52.65874), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=19.4, r=18.6, z=17.9 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (299.52602, -52.67078), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=22.2, r=20.9, z=19.5 cat entry: tabledata object with 1 rows and 62 columns Reference source: ExpGalaxy at RaDecPos: RA, Dec = (299.52340, -52.67169) with NanoMaggies: g=17.3, r=16.4, z=15.8 and EllipseWithPriors(0.25): log r_e=1.01253, ee1=-0.419464, ee2=-0.429871 cat entry: tabledata object with 1 rows and 62 columns cat entry: tabledata object with 2 rows and 62 columns Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.66749, -52.55434), pm (2.4, -13.9), parallax 0.965 with NanoMaggies: g=10.1, r=8.66, z=7.51 Reset brightness to NanoMaggies: g=10.1, r=8.66, z=7.51 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.55551, -52.67250), pm (-1.2, -5.2), parallax 0.415 with NanoMaggies: g=12.9, r=11.3, z=8.67 Reset brightness to NanoMaggies: g=12.9, r=11.3, z=8.67 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.55110, -52.66312), pm (0.2, -4.5), parallax 0.702 with NanoMaggies: g=15.3, r=14.9, z=14.8 Reset brightness to NanoMaggies: g=15.3, r=14.9, z=14.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.53893, -52.65879), pm (-9.2, -3.5), parallax 0.079 with NanoMaggies: g=15, r=15.2, z=15.8 Reset brightness to NanoMaggies: g=14.9, r=15.2, z=15.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.54533, -52.66555), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=16, r=15.4, z=15.3 Reset brightness to NanoMaggies: g=19.9, r=18.9, z=18.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.54719, -52.66123), pm (-7.0, -2.4), parallax 0.182 with NanoMaggies: g=16.9, r=15.7, z=15.3 Reset brightness to NanoMaggies: g=19.7, r=19.2, z=19.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.54598, -52.65930), pm (2.7, -7.6), parallax 0.210 with NanoMaggies: g=16.4, r=15.7, z=15.7 Reset brightness to NanoMaggies: g=19.2, r=18.7, z=18.6 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.01253, ee1=-0.419464, ee2=-0.429871 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.54324, -52.65874), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=19.4, r=18.6, z=17.9 Reset brightness to NanoMaggies: g=21.8, r=20.7, z=20.1 Measuring 2 iterative sources Blob 1 finished, total: Wall: 29.30 s, CPU: 29.25 s, VmPeak: 729 MB, VmSize: 710 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.167684 MB Old catalog: 82 New catalog: 75 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/metrics/cus/blobs-custom-299523m52671.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/metrics/cus/all-models-custom-299523m52671.fits Stage fitblobs : Wall: 34.44 s, CPU: 1.67 s, VmPeak: 1089 MB, VmSize: 1089 MB, VmRSS: 292 MB, VmData: 318 MB, maxrss: 0.299012 MB Stage fitblobs finished: 2020-08-13T07:18:40.569172 Resources for stage fitblobs : 55.326 s worker CPU, 56.699 s worker Wall, Wall: 34.440 s, Cores in use: 1.66, Total efficiency (on 32 cores): 5.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-13T07:18:40.665404 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-resid.jpg Stage coadds : Wall: 3.14 s, CPU: 1.58 s, VmPeak: 1089 MB, VmSize: 1089 MB, VmRSS: 292 MB, VmData: 318 MB, maxrss: 0.299336 MB Stage coadds finished: 2020-08-13T07:18:43.804548 Resources for stage coadds : 29.203 s worker CPU, 30.901 s worker Wall, Wall: 3.141 s, Cores in use: 9.80, Total efficiency (on 32 cores): 30.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-13T07:18:43.833502 Cut to 2 unWISE tiles Reading WISE tile 2983m531 band 1 Reading WISE tile 2983m531 band 3 Reading WISE tile 2983m531 band 2 Reading WISE tile 2983m531 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2983m531/unwise-2983m531-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.25 s, CPU: 0.68 s, VmPeak: 1016 MB, VmSize: 1012 MB, VmRSS: 152 MB, VmData: 192 MB, maxrss: 0.189916 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.21 s, CPU: 0.54 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 195 MB, VmData: 242 MB, maxrss: 0.200124 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.15 s, CPU: 0.35 s, VmPeak: 1064 MB, VmSize: 1000 MB, VmRSS: 140 MB, VmData: 184 MB, maxrss: 0.201184 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.15 s, CPU: 0.33 s, VmPeak: 1072 MB, VmSize: 1008 MB, VmRSS: 152 MB, VmData: 188 MB, maxrss: 0.214736 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/tmp-legacysurvey-custom-299523m52671-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.24 s, CPU: 0.86 s, VmPeak: 1089 MB, VmSize: 1089 MB, VmRSS: 293 MB, VmData: 318 MB, maxrss: 0.299848 MB Stage wise_forced finished: 2020-08-13T07:18:48.068965 Resources for stage wise_forced : 7.738 s worker CPU, 10.259 s worker Wall, Wall: 4.238 s, Cores in use: 2.03, Total efficiency (on 32 cores): 6.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-13T07:18:48.113028 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/coadd/cus/custom-299523m52671/legacysurvey-custom-299523m52671-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/tractor-i/cus/tractor-custom-299523m52671.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/tractor/cus/tractor-custom-299523m52671.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/tractor/cus/brick-custom-299523m52671.sha256sum Stage writecat : Wall: 2.11 s, CPU: 1.51 s, VmPeak: 1221 MB, VmSize: 1093 MB, VmRSS: 295 MB, VmData: 318 MB, maxrss: 0.432708 MB Stage writecat finished: 2020-08-13T07:18:50.222606 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.112 s, Cores in use: 0.72, Total efficiency (on 32 cores): 2.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC440416/PGC440416-largegalaxy-writecat.p All done: 100.722 s worker CPU, 153.128 s worker Wall, Wall: 65.176 s, Cores in use: 1.81, Total efficiency (on 32 cores): 5.6 % Finished galaxy PGC440416 in 1.170 minutes.