Started working on galaxy PGC1000531 at Wed Aug 5 21:29:28 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.346464 -8.6824646 --width 301 --height 301 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:29:29.003574 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.346464', '-8.6824646', '--width', '301', '--height', '301', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.346464 -8.6824646 --width 301 --height 301 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 336.346464 -8.6824646 Starting process 45561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 45562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 45563 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 45564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 45565 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 45566 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05936 MB Starting process 45567 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05936 MB Starting process 45568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 45569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 45570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 45571 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 45572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 45573 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 45574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 45575 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 45576 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:29:30.897473 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 13 CCDs: c4d_180905_032400_ooi_g_ls9-S21 g expnum 769049 exptime 56.0 propid 2014B-0404 seeing 0.94 MJD 58366.142 object DECaLS_51501_g decam/CP/V4.8.2a/CP20180904/c4d_180905_032400_ooi_g_ls9.fits.fz c4d_180916_011157_ooi_z_ls9-S18 z expnum 774145 exptime 96.0 propid 2014B-0404 seeing 1.39 MJD 58377.050 object DECaLS_45728_z decam/CP/V4.8.2a/CP20180915/c4d_180916_011157_ooi_z_ls9.fits.fz c4d_170916_012021_ooi_g_ls9-S18 g expnum 677959 exptime 200.0 propid 2014B-0404 seeing 1.99 MJD 58012.056 object DECaLS_45728_g decam/CP/V4.8.2a/CP20170915/c4d_170916_012021_ooi_g_ls9.fits.fz c4d_170921_004508_ooi_g_ls9-S18 g expnum 679803 exptime 173.0 propid 2014B-0404 seeing 1.36 MJD 58017.031 object DECaLS_29856_g decam/CP/V4.8.2a/CP20170920/c4d_170921_004508_ooi_g_ls9.fits.fz c4d_160814_035342_ooi_z_ls9-S18 z expnum 563885 exptime 89.0 propid 2014B-0404 seeing 0.98 MJD 57614.161 object DECaLS_29856_z decam/CP/V4.8.2a/CP20160813/c4d_160814_035342_ooi_z_ls9.fits.fz c4d_180905_062833_ooi_r_ls9-S24 r expnum 769158 exptime 40.0 propid 2014B-0404 seeing 1.01 MJD 58366.270 object DECaLS_56373_r decam/CP/V4.8.2a/CP20180904/c4d_180905_062833_ooi_r_ls9.fits.fz c4d_170920_005702_ooi_r_ls9-S19 r expnum 679552 exptime 95.0 propid 2014B-0404 seeing 1.36 MJD 58016.040 object DECaLS_29856_r decam/CP/V4.8.2a/CP20170919/c4d_170920_005702_ooi_r_ls9.fits.fz c4d_170921_004508_ooi_g_ls9-S19 g expnum 679803 exptime 173.0 propid 2014B-0404 seeing 1.46 MJD 58017.031 object DECaLS_29856_g decam/CP/V4.8.2a/CP20170920/c4d_170921_004508_ooi_g_ls9.fits.fz c4d_160814_035342_ooi_z_ls9-S19 z expnum 563885 exptime 89.0 propid 2014B-0404 seeing 1.03 MJD 57614.161 object DECaLS_29856_z decam/CP/V4.8.2a/CP20160813/c4d_160814_035342_ooi_z_ls9.fits.fz c4d_180903_020419_ooi_r_ls9-S14 r expnum 768278 exptime 42.0 propid 2014B-0404 seeing 1.38 MJD 58364.086 object DECaLS_13997_r decam/CP/V4.8.2a/CP20180902/c4d_180903_020419_ooi_r_ls9.fits.fz c4d_180908_021355_ooi_g_ls9-S14 g expnum 770552 exptime 61.0 propid 2014B-0404 seeing 1.08 MJD 58369.093 object DECaLS_13997_g decam/CP/V4.8.2a/CP20180907/c4d_180908_021355_ooi_g_ls9.fits.fz c4d_180914_021232_ooi_z_ls9-S14 z expnum 773222 exptime 80.0 propid 2014B-0404 seeing 1.12 MJD 58375.092 object DECaLS_13997_z decam/CP/V4.8.2a/CP20180913/c4d_180914_021232_ooi_z_ls9.fits.fz c4d_180906_014106_ooi_g_ls9-N27 g expnum 769511 exptime 56.0 propid 2014B-0404 seeing 1.00 MJD 58367.070 object DECaLS_59208_g decam/CP/V4.8.2a/CP20180905/c4d_180906_014106_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T035122_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170921T004508_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T021355_oi[S14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170921T004508_oi[S19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T035122_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 679803 S19 CCD, decam/CP/V4.8.2a/CP20170920/c4d_170921_004508_ooi_g_ls9.fits.fz slice (slice(0, 107, None), slice(372, 673, None)) Masking 0 additional saturated pixels in DECam expnum 563885 S19 CCD, decam/CP/V4.8.2a/CP20160813/c4d_160814_035342_ooi_z_ls9.fits.fz slice (slice(0, 69, None), slice(449, 750, None)) Clipping 2 pixels with anomalously large oow values: max 0.0629325 vs median 0.0477822 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T020419_oi[S14,noinherit][2046,4094][real]: DECaLS_1399 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523d7d-r-20170920T005702_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 679552 S19 CCD, decam/CP/V4.8.2a/CP20170919/c4d_170920_005702_ooi_r_ls9.fits.fz slice (slice(0, 130, None), slice(381, 682, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533ab3-r-20180905T062833_oi[S24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T032400_oi[S21,noinherit][2046,4094][real]: DECaLS_ Clipping 1 pixels with anomalously large oow values: max 0.0661077 vs median 0.0506642 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T014106_oi[N27,noinherit][2046,4094][real]: DECaLS_ Clipping 1 pixels with anomalously large oow values: max 0.066908 vs median 0.0494989 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da7f-z-20180914T021232_oi[S14,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e102-z-20180916T011157_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T012021_oi[S18,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 34.74 s, CPU: 2.31 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 181 MB, VmData: 213 MB, maxrss: 0.185504 MB Stage tims finished: 2020-08-05T21:30:05.633120 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T035122_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T021355_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533ab3-r-20180905T062833_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170921T004508_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170921T004508_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523d7d-r-20170920T005702_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T020419_oi[S14,noinherit][2046,4094][real]: DECaLS_1399 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T014106_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T032400_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e102-z-20180916T011157_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T012021_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 8.702 s worker CPU, 206.379 s worker Wall, Wall: 34.737 s, Cores in use: 0.32, Total efficiency (on 16 cores): 2.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T035122_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da7f-z-20180914T021232_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:30:05.660125 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07096.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07095.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06967.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07223.fits Matched 12 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/metrics/cus/reference-custom-336346m08682.fits Stage refs : Wall: 6.17 s, CPU: 2.93 s, VmPeak: 1043 MB, VmSize: 1032 MB, VmRSS: 203 MB, VmData: 233 MB, maxrss: 0.207588 MB Stage refs finished: 2020-08-05T21:30:11.831973 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.173 s, Cores in use: 0.47, Total efficiency (on 16 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:30:11.861363 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/metrics/cus/outlier-mask-custom-336346m08682.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/metrics/cus/outliers-pre-custom-336346m08682.jpg Image c4d_180908_021355_ooi_g_ls9-S14 g : masking 146 positive outlier pixels and 156 negative outlier pixels Image c4d_180906_014106_ooi_g_ls9-N27 g : masking 396 positive outlier pixels and 0 negative outlier pixels Image c4d_170916_012021_ooi_g_ls9-S18 g : masking 508 positive outlier pixels and 0 negative outlier pixels Image c4d_170921_004508_ooi_g_ls9-S19 g : masking 242 positive outlier pixels and 0 negative outlier pixels Image c4d_170920_005702_ooi_r_ls9-S19 r : masking 0 positive outlier pixels and 76 negative outlier pixels Image c4d_180903_020419_ooi_r_ls9-S14 r : masking 473 positive outlier pixels and 0 negative outlier pixels Image c4d_160814_035342_ooi_z_ls9-S19 z : masking 334 positive outlier pixels and 0 negative outlier pixels Image c4d_180916_011157_ooi_z_ls9-S18 z : masking 146 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/metrics/cus/outlier-mask-custom-336346m08682.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/metrics/cus/outliers-post-custom-336346m08682.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/metrics/cus/outliers-masked-pos-custom-336346m08682.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/metrics/cus/outliers-masked-neg-custom-336346m08682.jpg Stage outliers : Wall: 1.99 s, CPU: 1.40 s, VmPeak: 1043 MB, VmSize: 1042 MB, VmRSS: 219 MB, VmData: 248 MB, maxrss: 0.224348 MB Stage outliers finished: 2020-08-05T21:30:13.853684 Resources for stage outliers : 1.232 s worker CPU, 1.306 s worker Wall, Wall: 1.994 s, Cores in use: 1.32, Total efficiency (on 16 cores): 8.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:30:13.890099 Stage halos : Wall: 2.93 s, CPU: 1.67 s, VmPeak: 1043 MB, VmSize: 1042 MB, VmRSS: 219 MB, VmData: 248 MB, maxrss: 0.224392 MB Stage halos finished: 2020-08-05T21:30:16.818157 Resources for stage halos : 0.356 s worker CPU, 2.568 s worker Wall, Wall: 2.930 s, Cores in use: 0.69, Total efficiency (on 16 cores): 4.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T21:30:17.176841 PSF sigmas in coadd pixels: ['1.52', '3.23', '2.22', '2.38', '1.76', '1.62'] Using average PSF sigma 2.119781158503691 Gaussian PSF norm 0.1330773182138306 vs pixelized 0.104532264 average tim pixel scale / coadd scale: 1.0010959811149633 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.64', '2.21', '2.25'] Using average PSF sigma 2.031662805200527 Gaussian PSF norm 0.13884921801579922 vs pixelized 0.117081024 average tim pixel scale / coadd scale: 1.0011115272259268 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.26', '1.59', '1.67', '1.81'] Using average PSF sigma 1.8334070732349124 Gaussian PSF norm 0.15386369775269962 vs pixelized 0.12315393 average tim pixel scale / coadd scale: 1.0010420029515485 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.20 s, VmPeak: 1043 MB, VmSize: 1042 MB, VmRSS: 223 MB, VmData: 250 MB, maxrss: 0.228344 MB Stage fit_on_coadds finished: 2020-08-05T21:30:17.417617 Resources for stage fit_on_coadds : 0.265 s worker CPU, 0.265 s worker Wall, Wall: 0.242 s, Cores in use: 1.91, Total efficiency (on 16 cores): 11.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:30:17.429187 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 14 in veto map, 4 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 36 potential peaks Of 36 potential peaks: 28 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 34 potential peaks Of 34 potential peaks: 27 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept SED g : 5 new peaks Found 43 potential peaks Of 43 potential peaks: 37 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 50 potential peaks Of 50 potential peaks: 46 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 28 new sources Median coadd sky for g : -2.2137629e-05 Median coadd sky for r : 2.677559e-05 Median coadd sky for z : -2.5239613e-05 Stage srcs : Wall: 2.49 s, CPU: 2.44 s, VmPeak: 1043 MB, VmSize: 1042 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.228952 MB Stage srcs finished: 2020-08-05T21:30:19.915016 Resources for stage srcs : 0.093 s worker CPU, 0.093 s worker Wall, Wall: 2.487 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:30:19.938782 Blob 1 of 24, id: 8, sources: 6, size: 142x151, npix 12312, brick X: 53,195, Y: 58,209, one pixel: 121 58 Blob 2 of 24, id: 14, sources: 4, size: 72x62, npix 2775, brick X: 205,277, Y: 152,214, one pixel: 243 152 Blob 3 of 24, id: 7, sources: 3, size: 56x54, npix 1457, brick X: 9,65, Y: 57,111, one pixel: 23 57 Blob 4 of 24, id: 16, sources: 1, size: 43x43, npix 1242, brick X: 66,109, Y: 198,241, one pixel: 84 198 Blob 5 of 24, id: 12, sources: 2, size: 25x56, npix 1039, brick X: 0,25, Y: 149,205, one pixel: 5 149 Blob 6 of 24, id: 4, sources: 2, size: 28x46, npix 897, brick X: 212,240, Y: 24,70, one pixel: 226 24 Blob 7 of 24, id: 0, sources: 1, size: 39x27, npix 804, brick X: 0,39, Y: 0,27, one pixel: 2 0 Blob 8 of 24, id: 18, sources: 1, size: 34x33, npix 786, brick X: 14,48, Y: 227,260, one pixel: 29 227 Blob 9 of 24, id: 20, sources: 1, size: 29x31, npix 584, brick X: 173,202, Y: 235,266, one pixel: 185 235 Blob 10 of 24, id: 2, sources: 1, size: 34x20, npix 527, brick X: 173,207, Y: 0,20, one pixel: 177 0 Blob 11 of 24, id: 6, sources: 1, size: 20x30, npix 451, brick X: 281,301, Y: 48,78, one pixel: 292 48 Blob 12 of 24, id: 10, sources: 1, size: 29x25, npix 445, brick X: 206,235, Y: 99,124, one pixel: 216 99 Blob 13 of 24, id: 1, sources: 1, size: 26x24, npix 442, brick X: 121,147, Y: 0,24, one pixel: 129 0 Blob 14 of 24, id: 19, sources: 1, size: 26x24, npix 386, brick X: 125,151, Y: 233,257, one pixel: 136 233 Blob 15 of 24, id: 23, sources: 1, size: 25x25, npix 357, brick X: 190,215, Y: 266,291, one pixel: 201 266 Blob 16 of 24, id: 22, sources: 1, size: 22x22, npix 312, brick X: 119,141, Y: 266,288, one pixel: 129 266 Blob 17 of 24, id: 11, sources: 1, size: 21x23, npix 291, brick X: 249,270, Y: 109,132, one pixel: 258 109 Blob 14 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149736 MB Blob 18 of 24, id: 3, sources: 1, size: 22x22, npix 282, brick X: 273,295, Y: 3,25, one pixel: 284 3 Measuring 1 iterative sources Blob 11 finished, total: Wall: 0.94 s, CPU: 0.92 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.1505 MB Blob 16 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.116616 MB Blob 19 of 24, id: 9, sources: 1, size: 20x22, npix 269, brick X: 65,85, Y: 72,94, one pixel: 74 72 Blob 20 of 24, id: 5, sources: 1, size: 20x21, npix 249, brick X: 169,189, Y: 25,46, one pixel: 178 25 Blob 15 finished, total: Wall: 1.09 s, CPU: 1.07 s, VmPeak: 939 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151788 MB Blob 21 of 24, id: 15, sources: 1, size: 20x19, npix 218, brick X: 25,45, Y: 196,215, one pixel: 33 196 Blob 13 finished, total: Wall: 1.19 s, CPU: 1.17 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149836 MB Blob 22 of 24, id: 17, sources: 1, size: 20x19, npix 208, brick X: 117,137, Y: 210,229, one pixel: 126 210 Blob 21 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150296 MB Blob 23 of 24, id: 13, sources: 1, size: 18x19, npix 189, brick X: 56,74, Y: 152,171, one pixel: 64 152 Blob 20 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 939 MB, VmSize: 733 MB, VmRSS: 149 MB, VmData: 182 MB, maxrss: 0.152248 MB Blob 24 of 24, id: 21, sources: 1, size: 19x18, npix 189, brick X: 58,77, Y: 264,282, one pixel: 67 264 Blob 23 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 939 MB, VmSize: 733 MB, VmRSS: 149 MB, VmData: 182 MB, maxrss: 0.152248 MB Blob 8 finished, total: Wall: 1.54 s, CPU: 1.53 s, VmPeak: 939 MB, VmSize: 734 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151548 MB Blob 17 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149736 MB Blob 12 finished, total: Wall: 1.57 s, CPU: 1.56 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.0972 MB Blob 22 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150296 MB Blob 18 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.1505 MB Blob 10 finished, total: Wall: 1.74 s, CPU: 1.71 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150076 MB Blob 19 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.11668 MB Blob 9 finished, total: Wall: 1.91 s, CPU: 1.90 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.115268 MB Blob 24 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 939 MB, VmSize: 733 MB, VmRSS: 149 MB, VmData: 182 MB, maxrss: 0.152248 MB Blob 7 finished, total: Wall: 2.00 s, CPU: 1.98 s, VmPeak: 939 MB, VmSize: 734 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.151036 MB Blob 6 finished, total: Wall: 2.25 s, CPU: 2.23 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150744 MB Blob 5 finished, total: Wall: 2.46 s, CPU: 2.44 s, VmPeak: 921 MB, VmSize: 737 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155928 MB Blob 4 finished, total: Wall: 2.63 s, CPU: 2.62 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151664 MB Blob 3 finished, total: Wall: 3.03 s, CPU: 3.03 s, VmPeak: 922 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151184 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 4.63 s, CPU: 4.62 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 181 MB, maxrss: 0.152136 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.57227, ee1=0.700257, ee2=-0.781579 Measuring 4 iterative sources Blob 1 finished, total: Wall: 10.92 s, CPU: 10.91 s, VmPeak: 939 MB, VmSize: 733 MB, VmRSS: 150 MB, VmData: 182 MB, maxrss: 0.153376 MB Old catalog: 40 New catalog: 40 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/metrics/cus/blobs-custom-336346m08682.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/metrics/cus/all-models-custom-336346m08682.fits Stage fitblobs : Wall: 14.46 s, CPU: 2.73 s, VmPeak: 1043 MB, VmSize: 1042 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.229372 MB Stage fitblobs finished: 2020-08-05T21:30:34.398661 Resources for stage fitblobs : 43.114 s worker CPU, 45.880 s worker Wall, Wall: 14.461 s, Cores in use: 3.17, Total efficiency (on 16 cores): 19.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:30:34.413104 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-resid.jpg Stage coadds : Wall: 3.88 s, CPU: 1.84 s, VmPeak: 1043 MB, VmSize: 1042 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.229824 MB Stage coadds finished: 2020-08-05T21:30:38.291822 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 9.563 s worker CPU, 14.227 s worker Wall, Wall: 3.880 s, Cores in use: 2.94, Total efficiency (on 16 cores): 18.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:30:38.307423 Cut to 1 unWISE tiles Reading WISE tile 3370m091 band 1 Reading WISE tile 3370m091 band 2 Reading WISE tile 3370m091 band 3 Reading WISE tile 3370m091 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 922 MB, VmSize: 810 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.212504 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 940 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.210052 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 959 MB, VmSize: 808 MB, VmRSS: 147 MB, VmData: 173 MB, maxrss: 0.21068 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 939 MB, VmSize: 810 MB, VmRSS: 153 MB, VmData: 175 MB, maxrss: 0.197276 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.17 s, CPU: 1.47 s, VmPeak: 1043 MB, VmSize: 1042 MB, VmRSS: 225 MB, VmData: 250 MB, maxrss: 0.230528 MB Stage wise_forced finished: 2020-08-05T21:30:43.476008 Resources for stage wise_forced : 3.105 s worker CPU, 8.498 s worker Wall, Wall: 5.170 s, Cores in use: 0.89, Total efficiency (on 16 cores): 5.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:30:43.491944 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/tractor-i/cus/tractor-custom-336346m08682.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/tractor/cus/tractor-custom-336346m08682.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/tractor/cus/brick-custom-336346m08682.sha256sum Stage writecat : Wall: 1.48 s, CPU: 1.27 s, VmPeak: 1174 MB, VmSize: 1046 MB, VmRSS: 227 MB, VmData: 250 MB, maxrss: 0.363208 MB Stage writecat finished: 2020-08-05T21:30:44.970558 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.480 s, Cores in use: 0.86, Total efficiency (on 16 cores): 5.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1000531/PGC1000531-largegalaxy-writecat.p All done: 66.432 s worker CPU, 279.219 s worker Wall, Wall: 74.173 s, Cores in use: 1.14, Total efficiency (on 16 cores): 7.2 % Finished galaxy PGC1000531 in 1.296 minutes. Started working on galaxy PGC1000531 at Mon Aug 10 10:43:10 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.3461756642844 -8.68222499138392 --width 301 --height 301 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T10:43:11.273937 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.3461756642844', '-8.68222499138392', '--width', '301', '--height', '301', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.3461756642844 -8.68222499138392 --width 301 --height 301 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 336.3461756642844 -8.68222499138392 Starting process 8203 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 8204 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 8205 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 8206 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 8207 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0594 MB Starting process 8208 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 8210 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 8209 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T10:43:11.877661 Keeping 14 CCDs: c4d_180905_032400_ooi_g_ls9-S21 g expnum 769049 exptime 56.0 propid 2014B-0404 seeing 0.94 MJD 58366.142 object DECaLS_51501_g decam/CP/V4.8.2a/CP20180904/c4d_180905_032400_ooi_g_ls9.fits.fz c4d_180916_011157_ooi_z_ls9-S18 z expnum 774145 exptime 96.0 propid 2014B-0404 seeing 1.39 MJD 58377.050 object DECaLS_45728_z decam/CP/V4.8.2a/CP20180915/c4d_180916_011157_ooi_z_ls9.fits.fz c4d_170916_012021_ooi_g_ls9-S18 g expnum 677959 exptime 200.0 propid 2014B-0404 seeing 1.99 MJD 58012.056 object DECaLS_45728_g decam/CP/V4.8.2a/CP20170915/c4d_170916_012021_ooi_g_ls9.fits.fz c4d_170921_004508_ooi_g_ls9-S18 g expnum 679803 exptime 173.0 propid 2014B-0404 seeing 1.36 MJD 58017.031 object DECaLS_29856_g decam/CP/V4.8.2a/CP20170920/c4d_170921_004508_ooi_g_ls9.fits.fz c4d_170920_005702_ooi_r_ls9-S18 r expnum 679552 exptime 95.0 propid 2014B-0404 seeing 1.32 MJD 58016.040 object DECaLS_29856_r decam/CP/V4.8.2a/CP20170919/c4d_170920_005702_ooi_r_ls9.fits.fz c4d_160814_035342_ooi_z_ls9-S18 z expnum 563885 exptime 89.0 propid 2014B-0404 seeing 0.98 MJD 57614.161 object DECaLS_29856_z decam/CP/V4.8.2a/CP20160813/c4d_160814_035342_ooi_z_ls9.fits.fz c4d_180905_062833_ooi_r_ls9-S24 r expnum 769158 exptime 40.0 propid 2014B-0404 seeing 1.01 MJD 58366.270 object DECaLS_56373_r decam/CP/V4.8.2a/CP20180904/c4d_180905_062833_ooi_r_ls9.fits.fz c4d_170920_005702_ooi_r_ls9-S19 r expnum 679552 exptime 95.0 propid 2014B-0404 seeing 1.36 MJD 58016.040 object DECaLS_29856_r decam/CP/V4.8.2a/CP20170919/c4d_170920_005702_ooi_r_ls9.fits.fz c4d_170921_004508_ooi_g_ls9-S19 g expnum 679803 exptime 173.0 propid 2014B-0404 seeing 1.46 MJD 58017.031 object DECaLS_29856_g decam/CP/V4.8.2a/CP20170920/c4d_170921_004508_ooi_g_ls9.fits.fz c4d_160814_035342_ooi_z_ls9-S19 z expnum 563885 exptime 89.0 propid 2014B-0404 seeing 1.03 MJD 57614.161 object DECaLS_29856_z decam/CP/V4.8.2a/CP20160813/c4d_160814_035342_ooi_z_ls9.fits.fz c4d_180903_020419_ooi_r_ls9-S14 r expnum 768278 exptime 42.0 propid 2014B-0404 seeing 1.38 MJD 58364.086 object DECaLS_13997_r decam/CP/V4.8.2a/CP20180902/c4d_180903_020419_ooi_r_ls9.fits.fz c4d_180908_021355_ooi_g_ls9-S14 g expnum 770552 exptime 61.0 propid 2014B-0404 seeing 1.08 MJD 58369.093 object DECaLS_13997_g decam/CP/V4.8.2a/CP20180907/c4d_180908_021355_ooi_g_ls9.fits.fz c4d_180914_021232_ooi_z_ls9-S14 z expnum 773222 exptime 80.0 propid 2014B-0404 seeing 1.12 MJD 58375.092 object DECaLS_13997_z decam/CP/V4.8.2a/CP20180913/c4d_180914_021232_ooi_z_ls9.fits.fz c4d_180906_014106_ooi_g_ls9-N27 g expnum 769511 exptime 56.0 propid 2014B-0404 seeing 1.00 MJD 58367.070 object DECaLS_59208_g decam/CP/V4.8.2a/CP20180905/c4d_180906_014106_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523d7d-r-20170920T005702_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523d7d-r-20170920T005702_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 679552 S19 CCD, decam/CP/V4.8.2a/CP20170919/c4d_170920_005702_ooi_r_ls9.fits.fz slice (slice(0, 126, None), slice(378, 679, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T035122_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533ab3-r-20180905T062833_oi[S24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170921T004508_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T032400_oi[S21,noinherit][2046,4094][real]: DECaLS_ Clipping 1 pixels with anomalously large oow values: max 0.0661077 vs median 0.0506642 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T035122_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 563885 S19 CCD, decam/CP/V4.8.2a/CP20160813/c4d_160814_035342_ooi_z_ls9.fits.fz slice (slice(0, 65, None), slice(446, 747, None)) Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170921T004508_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 679803 S19 CCD, decam/CP/V4.8.2a/CP20170920/c4d_170921_004508_ooi_g_ls9.fits.fz slice (slice(0, 103, None), slice(368, 669, None)) Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T021355_oi[S14,noinherit][2046,4094][real]: DECaLS_ Clipping 2 pixels with anomalously large oow values: max 0.0629325 vs median 0.0477822 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T020419_oi[S14,noinherit][2046,4094][real]: DECaLS_1399 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T014106_oi[N27,noinherit][2046,4094][real]: DECaLS_ Clipping 1 pixels with anomalously large oow values: max 0.066908 vs median 0.0494989 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da7f-z-20180914T021232_oi[S14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T012021_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e102-z-20180916T011157_oi[S18,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 46.76 s, CPU: 0.98 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 179 MB, VmData: 213 MB, maxrss: 0.1836 MB Stage tims finished: 2020-08-10T10:43:58.635187 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523d7d-r-20170920T005702_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T035122_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T032400_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170921T004508_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523d7d-r-20170920T005702_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T021355_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T035122_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T020419_oi[S14,noinherit][2046,4094][real]: DECaLS_1399 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533ab3-r-20180905T062833_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T014106_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170921T004508_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da7f-z-20180914T021232_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T012021_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 6.179 s worker CPU, 293.036 s worker Wall, Wall: 46.759 s, Cores in use: 0.15, Total efficiency (on 8 cores): 1.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e102-z-20180916T011157_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-10T10:43:58.661362 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07096.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07095.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06967.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07223.fits Matched 12 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/metrics/cus/reference-custom-336346m08682.fits Stage refs : Wall: 9.43 s, CPU: 2.02 s, VmPeak: 1036 MB, VmSize: 1026 MB, VmRSS: 200 MB, VmData: 233 MB, maxrss: 0.205248 MB Stage refs finished: 2020-08-10T10:44:08.091933 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.432 s, Cores in use: 0.21, Total efficiency (on 8 cores): 2.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T10:44:08.347565 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/metrics/cus/outlier-mask-custom-336346m08682.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/metrics/cus/outliers-pre-custom-336346m08682.jpg Image c4d_180905_032400_ooi_g_ls9-S21 g : masking 201 positive outlier pixels and 0 negative outlier pixels Image c4d_170916_012021_ooi_g_ls9-S18 g : masking 616 positive outlier pixels and 0 negative outlier pixels Image c4d_170920_005702_ooi_r_ls9-S19 r : masking 0 positive outlier pixels and 86 negative outlier pixels Image c4d_180903_020419_ooi_r_ls9-S14 r : masking 452 positive outlier pixels and 0 negative outlier pixels Image c4d_160814_035342_ooi_z_ls9-S19 z : masking 337 positive outlier pixels and 59 negative outlier pixels Image c4d_180916_011157_ooi_z_ls9-S18 z : masking 95 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/metrics/cus/outlier-mask-custom-336346m08682.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/metrics/cus/outliers-post-custom-336346m08682.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/metrics/cus/outliers-masked-pos-custom-336346m08682.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/metrics/cus/outliers-masked-neg-custom-336346m08682.jpg Stage outliers : Wall: 1.06 s, CPU: 0.79 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 218 MB, VmData: 249 MB, maxrss: 0.223244 MB Stage outliers finished: 2020-08-10T10:44:09.406834 Resources for stage outliers : 1.055 s worker CPU, 1.055 s worker Wall, Wall: 1.060 s, Cores in use: 1.74, Total efficiency (on 8 cores): 21.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T10:44:09.641584 Stage halos : Wall: 2.26 s, CPU: 0.29 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 218 MB, VmData: 249 MB, maxrss: 0.223624 MB Stage halos finished: 2020-08-10T10:44:11.902833 Resources for stage halos : 0.360 s worker CPU, 2.603 s worker Wall, Wall: 2.262 s, Cores in use: 0.29, Total efficiency (on 8 cores): 3.6 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T10:44:11.943472 PSF sigmas in coadd pixels: ['1.52', '3.23', '2.22', '2.38', '1.76', '1.62'] Using average PSF sigma 2.119781158503691 Gaussian PSF norm 0.1330773182138306 vs pixelized 0.10452978 average tim pixel scale / coadd scale: 1.0010959811149633 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.64', '2.21', '2.25'] Using average PSF sigma 2.031662805200527 Gaussian PSF norm 0.13884921801579922 vs pixelized 0.1170832 average tim pixel scale / coadd scale: 1.0011115272259268 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.26', '1.59', '1.67', '1.81'] Using average PSF sigma 1.8334070732349124 Gaussian PSF norm 0.15386369775269962 vs pixelized 0.123154424 average tim pixel scale / coadd scale: 1.0010420029515485 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.21 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 221 MB, VmData: 250 MB, maxrss: 0.226308 MB Stage fit_on_coadds finished: 2020-08-10T10:44:12.158434 Resources for stage fit_on_coadds : 0.250 s worker CPU, 0.251 s worker Wall, Wall: 0.216 s, Cores in use: 2.12, Total efficiency (on 8 cores): 26.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T10:44:12.169253 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 33 potential peaks Of 33 potential peaks: 15 in veto map, 3 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 37 potential peaks Of 37 potential peaks: 29 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 34 potential peaks Of 34 potential peaks: 27 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept SED g : 5 new peaks Found 43 potential peaks Of 43 potential peaks: 37 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 49 potential peaks Of 49 potential peaks: 45 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 27 new sources Median coadd sky for g : -2.4809131e-05 Median coadd sky for r : 1.0675577e-05 Median coadd sky for z : -6.73374e-05 Stage srcs : Wall: 0.60 s, CPU: 0.54 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.226904 MB Stage srcs finished: 2020-08-10T10:44:12.764672 Resources for stage srcs : 0.132 s worker CPU, 0.132 s worker Wall, Wall: 0.596 s, Cores in use: 1.13, Total efficiency (on 8 cores): 14.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T10:44:12.844691 Blob 1 of 24, id: 8, sources: 5, size: 142x152, npix 12298, brick X: 49,191, Y: 54,206, one pixel: 117 54 Blob 2 of 24, id: 13, sources: 4, size: 71x63, npix 2762, brick X: 202,273, Y: 148,211, one pixel: 240 148 Blob 3 of 24, id: 7, sources: 3, size: 56x54, npix 1466, brick X: 5,61, Y: 54,108, one pixel: 18 54 Blob 4 of 24, id: 16, sources: 1, size: 42x42, npix 1249, brick X: 63,105, Y: 195,237, one pixel: 79 195 Blob 5 of 24, id: 5, sources: 2, size: 28x46, npix 875, brick X: 208,236, Y: 21,67, one pixel: 221 21 Blob 6 of 24, id: 12, sources: 2, size: 21x53, npix 827, brick X: 0,21, Y: 148,201, one pixel: 3 148 Blob 7 of 24, id: 18, sources: 1, size: 34x33, npix 786, brick X: 10,44, Y: 224,257, one pixel: 24 224 Blob 8 of 24, id: 0, sources: 1, size: 34x24, npix 619, brick X: 0,34, Y: 0,24, one pixel: 0 0 Blob 9 of 24, id: 20, sources: 1, size: 29x30, npix 575, brick X: 169,198, Y: 232,262, one pixel: 181 232 Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.55 s, CPU: 1.55 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147308 MB Blob 10 of 24, id: 6, sources: 1, size: 24x30, npix 546, brick X: 277,301, Y: 45,75, one pixel: 288 45 Blob 7 finished, total: Wall: 1.69 s, CPU: 1.34 s, VmPeak: 966 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147188 MB Blob 11 of 24, id: 10, sources: 1, size: 29x25, npix 451, brick X: 202,231, Y: 96,121, one pixel: 211 96 Blob 8 finished, total: Wall: 1.79 s, CPU: 1.79 s, VmPeak: 973 MB, VmSize: 727 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147192 MB Blob 12 of 24, id: 19, sources: 1, size: 26x24, npix 382, brick X: 121,147, Y: 230,254, one pixel: 131 230 Blob 4 finished, total: Wall: 2.48 s, CPU: 2.48 s, VmPeak: 959 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148064 MB Blob 13 of 24, id: 1, sources: 1, size: 26x20, npix 372, brick X: 117,143, Y: 0,20, one pixel: 123 0 Blob 10 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 966 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147276 MB Blob 14 of 24, id: 23, sources: 1, size: 26x25, npix 368, brick X: 186,212, Y: 263,288, one pixel: 196 263 Blob 9 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147308 MB Blob 15 of 24, id: 2, sources: 1, size: 29x17, npix 364, brick X: 171,200, Y: 0,17, one pixel: 175 0 Blob 12 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 959 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148064 MB Blob 16 of 24, id: 22, sources: 1, size: 22x22, npix 312, brick X: 115,137, Y: 263,285, one pixel: 124 263 Blob 6 finished, total: Wall: 3.04 s, CPU: 2.62 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146756 MB Blob 17 of 24, id: 3, sources: 1, size: 22x22, npix 292, brick X: 269,291, Y: 0,22, one pixel: 279 0 Blob 11 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 973 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149868 MB Blob 18 of 24, id: 11, sources: 1, size: 21x23, npix 292, brick X: 245,266, Y: 106,129, one pixel: 253 106 Blob 3 finished, total: Wall: 3.23 s, CPU: 3.23 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148168 MB Blob 19 of 24, id: 4, sources: 1, size: 20x22, npix 259, brick X: 165,185, Y: 21,43, one pixel: 174 21 Blob 13 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 966 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147276 MB Blob 20 of 24, id: 9, sources: 1, size: 20x22, npix 259, brick X: 61,81, Y: 69,91, one pixel: 70 69 Blob 14 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147308 MB Blob 21 of 24, id: 15, sources: 1, size: 20x20, npix 229, brick X: 21,41, Y: 192,212, one pixel: 30 192 Blob 17 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 973 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149868 MB Blob 16 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14714 MB Blob 22 of 24, id: 17, sources: 1, size: 20x19, npix 218, brick X: 113,133, Y: 207,226, one pixel: 121 207 Blob 23 of 24, id: 21, sources: 1, size: 19x18, npix 189, brick X: 54,73, Y: 261,279, one pixel: 62 261 Blob 19 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 966 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147276 MB Blob 24 of 24, id: 14, sources: 1, size: 18x18, npix 180, brick X: 52,70, Y: 149,167, one pixel: 60 149 Blob 21 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 973 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149868 MB Measuring 2 iterative sources Blob 24 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 973 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149868 MB Blob 22 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.1473 MB Blob 18 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148168 MB Blob 15 finished, total: Wall: 1.49 s, CPU: 1.49 s, VmPeak: 959 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148064 MB Blob 23 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 966 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147276 MB Blob 20 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147308 MB Blob 2 finished, total: Wall: 5.43 s, CPU: 5.09 s, VmPeak: 944 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149972 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.54163, ee1=0.761652, ee2=-1.09768 Measuring 2 iterative sources Blob 1 finished, total: Wall: 9.09 s, CPU: 9.09 s, VmPeak: 966 MB, VmSize: 727 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150856 MB Old catalog: 39 New catalog: 38 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/metrics/cus/blobs-custom-336346m08682.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/metrics/cus/all-models-custom-336346m08682.fits Stage fitblobs : Wall: 9.43 s, CPU: 0.38 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.227324 MB Stage fitblobs finished: 2020-08-10T10:44:22.274301 Resources for stage fitblobs : 38.895 s worker CPU, 40.076 s worker Wall, Wall: 9.431 s, Cores in use: 4.16, Total efficiency (on 8 cores): 52.1 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T10:44:22.290813 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-resid.jpg Stage coadds : Wall: 1.86 s, CPU: 0.74 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.227772 MB Stage coadds finished: 2020-08-10T10:44:24.147412 Resources for stage coadds : 4.114 s worker CPU, 4.429 s worker Wall, Wall: 1.857 s, Cores in use: 2.61, Total efficiency (on 8 cores): 32.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T10:44:24.163511 Cut to 1 unWISE tiles Reading WISE tile 3370m091 band 1 Reading WISE tile 3370m091 band 3 Reading WISE tile 3370m091 band 2 Reading WISE tile 3370m091 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 966 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.20564 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 959 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.206372 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 944 MB, VmSize: 805 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.211252 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m091/unwise-3370m091-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 804 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.189872 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/tmp-legacysurvey-custom-336346m08682-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.85 s, CPU: 0.66 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 223 MB, VmData: 250 MB, maxrss: 0.22848 MB Stage wise_forced finished: 2020-08-10T10:44:28.011133 Resources for stage wise_forced : 3.248 s worker CPU, 6.613 s worker Wall, Wall: 3.849 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T10:44:28.093182 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/coadd/cus/custom-336346m08682/legacysurvey-custom-336346m08682-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/tractor-i/cus/tractor-custom-336346m08682.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/tractor/cus/tractor-custom-336346m08682.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/tractor/cus/brick-custom-336346m08682.sha256sum Stage writecat : Wall: 0.82 s, CPU: 0.59 s, VmPeak: 1168 MB, VmSize: 1040 MB, VmRSS: 225 MB, VmData: 250 MB, maxrss: 0.361356 MB Stage writecat finished: 2020-08-10T10:44:28.911726 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.820 s, Cores in use: 0.73, Total efficiency (on 8 cores): 9.1 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1000531/PGC1000531-largegalaxy-writecat.p All done: 54.235 s worker CPU, 348.197 s worker Wall, Wall: 77.055 s, Cores in use: 0.80, Total efficiency (on 8 cores): 10.0 % Finished galaxy PGC1000531 in 1.317 minutes.