Started working on galaxy PGC1379826 at Wed Aug 5 19:21:45 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.360865 10.4581 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:21:48.139541 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.360865', '10.4581', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.360865 10.4581 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 347.360865 10.4581 Starting process 31208 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 31209 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 31210 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 31211 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 31212 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB Starting process 31213 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05936 MB Starting process 31214 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05934 MB Starting process 31215 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 31216 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 31217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 31218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 31219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 31220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 31221 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 31222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 31223 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:21:48.845758 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: c4d_170721_064746_ooi_g_ls9-S4 g expnum 660491 exptime 131.0 propid 2014B-0404 seeing 1.34 MJD 57955.281 object DECaLS_39628_g decam/CP/V4.8.2/CP20170720/c4d_170721_064746_ooi_g_ls9.fits.fz c4d_170719_073302_ooi_r_ls9-S4 r expnum 660043 exptime 114.0 propid 2014B-0404 seeing 2.16 MJD 57953.313 object DECaLS_39628_r decam/CP/V4.8.2/CP20170718/c4d_170719_073302_ooi_r_ls9.fits.fz c4d_140815_075529_ooi_z_ls9-S4 z expnum 348047 exptime 138.0 propid 2014B-0404 seeing 0.95 MJD 56884.328 object DECaLS_39628_z decam/CP/V4.8.2a/CP20140814/c4d_140815_075529_ooi_z_ls9.fits.fz c4d_180910_023807_ooi_r_ls9-S4 r expnum 771443 exptime 46.0 propid 2014B-0404 seeing 1.35 MJD 58371.110 object DECaLS_39628_r decam/CP/V4.8.2a/CP20180909/c4d_180910_023807_ooi_r_ls9.fits.fz c4d_180910_023807_ooi_r_ls9-S3 r expnum 771443 exptime 46.0 propid 2014B-0404 seeing 1.36 MJD 58371.110 object DECaLS_39628_r decam/CP/V4.8.2a/CP20180909/c4d_180910_023807_ooi_r_ls9.fits.fz c4d_170917_035203_ooi_r_ls9-S12 r expnum 678354 exptime 48.0 propid 2014B-0404 seeing 0.93 MJD 58013.161 object DECaLS_7884_r decam/CP/V4.8.2a/CP20170916/c4d_170917_035203_ooi_r_ls9.fits.fz c4d_171113_005045_ooi_z_ls9-S12 z expnum 695607 exptime 161.0 propid 2014B-0404 seeing 0.80 MJD 58070.035 object DECaLS_7884_z decam/CP/V4.8.2a/CP20171112/c4d_171113_005045_ooi_z_ls9.fits.fz c4d_170922_022610_ooi_g_ls9-S12 g expnum 680110 exptime 154.0 propid 2014B-0404 seeing 1.38 MJD 58018.102 object DECaLS_7884_g decam/CP/V4.8.2a/CP20170921/c4d_170922_022610_ooi_g_ls9.fits.fz c4d_160813_055306_ooi_z_ls9-S11 z expnum 563588 exptime 90.0 propid 2014B-0404 seeing 0.94 MJD 57613.244 object DECaLS_23756_z decam/CP/V4.8.2a/CP20160812/c4d_160813_055306_ooi_z_ls9.fits.fz c4d_170916_044805_ooi_g_ls9-S11 g expnum 678025 exptime 127.0 propid 2014B-0404 seeing 1.43 MJD 58012.200 object DECaLS_23756_g decam/CP/V4.8.2a/CP20170915/c4d_170916_044805_ooi_g_ls9.fits.fz c4d_180619_084616_ooi_r_ls9-S11 r expnum 754111 exptime 90.0 propid 2014B-0404 seeing 1.46 MJD 58288.365 object DECaLS_23756_r decam/CP/V4.8.2a/CP20180618/c4d_180619_084616_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952303b-z-20171113T005045_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S3,noinherit][2046,4094][real]: DECaLS_39628 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S4,noinherit][2046,4094][real]: DECaLS_39628 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T075216_oi[S4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T035203_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T022610_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055045_oi[S11,noinherit][2046,4094][real]: DECaLS_ Clipping 43 pixels with anomalously large oow values: max 0.255371 vs median 0.00148698 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S11,noinherit][2046,4094][real]: DECaLS_ Clipping 751 pixels with anomalously large oow values: max 0.0105882 vs median 0.00646417 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S11,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 63.20 s, CPU: 1.02 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.181332 MB Stage tims finished: 2020-08-05T19:22:52.042872 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952303b-z-20171113T005045_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S3,noinherit][2046,4094][real]: DECaLS_39628 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055045_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T075216_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.749 s worker CPU, 287.988 s worker Wall, Wall: 63.199 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T035203_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S4,noinherit][2046,4094][real]: DECaLS_39628 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T022610_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:22:52.399319 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04923.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05179.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05052.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05051.fits Matched 1 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/reference-custom-347360p10458.fits Stage refs : Wall: 11.63 s, CPU: 1.94 s, VmPeak: 1042 MB, VmSize: 1030 MB, VmRSS: 196 MB, VmData: 227 MB, maxrss: 0.201016 MB Stage refs finished: 2020-08-05T19:23:04.025667 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.628 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:23:04.148607 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outlier-mask-custom-347360p10458.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outliers-pre-custom-347360p10458.jpg Image c4d_180619_084616_ooi_r_ls9-S11 r : masking 0 positive outlier pixels and 136 negative outlier pixels Image c4d_160813_055306_ooi_z_ls9-S11 z : masking 3403 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outlier-mask-custom-347360p10458.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outliers-post-custom-347360p10458.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outliers-masked-pos-custom-347360p10458.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outliers-masked-neg-custom-347360p10458.jpg Stage outliers : Wall: 2.34 s, CPU: 1.90 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.211728 MB Stage outliers finished: 2020-08-05T19:23:06.485020 Resources for stage outliers : 0.494 s worker CPU, 0.582 s worker Wall, Wall: 2.338 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:23:06.513366 Stage halos : Wall: 1.84 s, CPU: 1.63 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.2121 MB Stage halos finished: 2020-08-05T19:23:08.350782 Resources for stage halos : 0.291 s worker CPU, 1.535 s worker Wall, Wall: 1.839 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:23:08.424617 PSF sigmas in coadd pixels: ['2.18', '2.25', '2.32'] Using average PSF sigma 2.2488999758469252 Gaussian PSF norm 0.12543678900954347 vs pixelized 0.10286561 average tim pixel scale / coadd scale: 1.0011683130203142 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.51', '2.19', '2.21', '1.51', '2.38'] Using average PSF sigma 2.3577627077257493 Gaussian PSF norm 0.11964511562148727 vs pixelized 0.09413281 average tim pixel scale / coadd scale: 1.0012053570866528 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.54', '1.31', '1.53'] Using average PSF sigma 1.4618393101497709 Gaussian PSF norm 0.19297250375964817 vs pixelized 0.15863745 average tim pixel scale / coadd scale: 1.0011003966770269 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.12 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 209 MB, VmData: 236 MB, maxrss: 0.214436 MB Stage fit_on_coadds finished: 2020-08-05T19:23:08.603858 Resources for stage fit_on_coadds : 0.107 s worker CPU, 0.107 s worker Wall, Wall: 0.181 s, Cores in use: 1.27, Total efficiency (on 16 cores): 7.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:23:08.621673 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 14 potential peaks Of 14 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 10 kept SED z : 10 new peaks Found 9 potential peaks Of 9 potential peaks: 8 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 13 potential peaks Of 13 potential peaks: 9 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 16 potential peaks Of 16 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 18 potential peaks Of 18 potential peaks: 14 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 13 new sources Median coadd sky for g : -5.1744795e-05 Median coadd sky for r : 2.8463937e-05 Median coadd sky for z : 5.812713e-05 Stage srcs : Wall: 1.02 s, CPU: 0.97 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 210 MB, VmData: 236 MB, maxrss: 0.215008 MB Stage srcs finished: 2020-08-05T19:23:09.641548 Resources for stage srcs : 0.065 s worker CPU, 0.065 s worker Wall, Wall: 1.021 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:23:09.670708 Blob 1 of 10, id: 4, sources: 3, size: 98x110, npix 6255, brick X: 86,184, Y: 66,176, one pixel: 111 66 Blob 2 of 10, id: 5, sources: 2, size: 52x47, npix 1174, brick X: 179,231, Y: 97,144, one pixel: 192 97 Blob 3 of 10, id: 8, sources: 2, size: 33x42, npix 803, brick X: 202,235, Y: 161,203, one pixel: 225 161 Blob 4 of 10, id: 2, sources: 1, size: 30x28, npix 612, brick X: 156,186, Y: 0,28, one pixel: 163 0 Blob 5 of 10, id: 7, sources: 1, size: 30x31, npix 610, brick X: 184,214, Y: 141,172, one pixel: 197 141 Blob 6 of 10, id: 1, sources: 1, size: 29x26, npix 506, brick X: 119,148, Y: 0,26, one pixel: 128 0 Blob 7 of 10, id: 3, sources: 1, size: 27x25, npix 439, brick X: 86,113, Y: 42,67, one pixel: 100 42 Blob 8 of 10, id: 9, sources: 1, size: 18x23, npix 274, brick X: 0,18, Y: 192,215, one pixel: 5 192 Blob 9 of 10, id: 0, sources: 1, size: 22x19, npix 272, brick X: 22,44, Y: 0,19, one pixel: 29 0 Blob 10 of 10, id: 6, sources: 1, size: 20x21, npix 239, brick X: 28,48, Y: 106,127, one pixel: 38 106 Blob 10 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.11554 MB Blob 6 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 934 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.1505 MB Blob 5 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 937 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149748 MB Blob 8 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.09506 MB Blob 3 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09472 MB Blob 4 finished, total: Wall: 0.99 s, CPU: 0.98 s, VmPeak: 941 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149968 MB Blob 9 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149064 MB Blob 7 finished, total: Wall: 1.20 s, CPU: 1.20 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092148 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150704 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.43449, ee1=0.202735, ee2=-0.402014 Measuring 4 iterative sources Blob 1 finished, total: Wall: 5.00 s, CPU: 5.00 s, VmPeak: 941 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151136 MB Old catalog: 16 New catalog: 16 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/blobs-custom-347360p10458.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/all-models-custom-347360p10458.fits Stage fitblobs : Wall: 5.51 s, CPU: 0.43 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 210 MB, VmData: 236 MB, maxrss: 0.215176 MB Stage fitblobs finished: 2020-08-05T19:23:15.178059 Resources for stage fitblobs : 13.220 s worker CPU, 13.342 s worker Wall, Wall: 5.509 s, Cores in use: 2.48, Total efficiency (on 16 cores): 15.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:23:15.219051 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-resid.jpg Stage coadds : Wall: 3.87 s, CPU: 1.68 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 211 MB, VmData: 236 MB, maxrss: 0.215688 MB Stage coadds finished: 2020-08-05T19:23:19.092534 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 9.794 s worker CPU, 14.753 s worker Wall, Wall: 3.875 s, Cores in use: 2.96, Total efficiency (on 16 cores): 18.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:23:19.131856 Cut to 1 unWISE tiles Reading WISE tile 3476p106 band 4 Reading WISE tile 3476p106 band 1 Reading WISE tile 3476p106 band 2 Reading WISE tile 3476p106 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 941 MB, VmSize: 811 MB, VmRSS: 151 MB, VmData: 176 MB, maxrss: 0.19424 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.208956 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 941 MB, VmSize: 802 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205292 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 940 MB, VmSize: 808 MB, VmRSS: 147 MB, VmData: 173 MB, maxrss: 0.210024 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.81 s, CPU: 1.08 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 211 MB, VmData: 236 MB, maxrss: 0.216396 MB Stage wise_forced finished: 2020-08-05T19:23:21.943516 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.088 s worker CPU, 4.812 s worker Wall, Wall: 2.813 s, Cores in use: 1.48, Total efficiency (on 16 cores): 9.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:23:21.966206 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/tractor-i/cus/tractor-custom-347360p10458.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/tractor/cus/tractor-custom-347360p10458.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/tractor/cus/brick-custom-347360p10458.sha256sum Stage writecat : Wall: 1.21 s, CPU: 0.65 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 213 MB, VmData: 236 MB, maxrss: 0.349404 MB Stage writecat finished: 2020-08-05T19:23:23.180440 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.216 s, Cores in use: 0.54, Total efficiency (on 16 cores): 3.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-writecat.p All done: 33.811 s worker CPU, 323.188 s worker Wall, Wall: 94.360 s, Cores in use: 0.48, Total efficiency (on 16 cores): 3.0 % Finished galaxy PGC1379826 in 1.662 minutes. Started working on galaxy PGC1379826 at Wed Aug 5 20:07:56 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.360865 10.4581 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:07:57.182285 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.360865', '10.4581', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.360865 10.4581 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 347.360865 10.4581 Starting process 39553 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 39554 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 39555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 39556 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 39557 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 39558 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05956 MB Starting process 39559 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05956 MB Starting process 39560 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 39561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 39562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 39563 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 39564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 39565 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 39566 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 39567 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 39568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 39569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 39570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 39571 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 39572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 39573 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 39574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 39575 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 39576 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 39577 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 39578 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 39579 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 39580 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 39581 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 39582 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 39583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 39584 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05932 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:07:58.545523 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: c4d_170721_064746_ooi_g_ls9-S4 g expnum 660491 exptime 131.0 propid 2014B-0404 seeing 1.34 MJD 57955.281 object DECaLS_39628_g decam/CP/V4.8.2/CP20170720/c4d_170721_064746_ooi_g_ls9.fits.fz c4d_170719_073302_ooi_r_ls9-S4 r expnum 660043 exptime 114.0 propid 2014B-0404 seeing 2.16 MJD 57953.313 object DECaLS_39628_r decam/CP/V4.8.2/CP20170718/c4d_170719_073302_ooi_r_ls9.fits.fz c4d_140815_075529_ooi_z_ls9-S4 z expnum 348047 exptime 138.0 propid 2014B-0404 seeing 0.95 MJD 56884.328 object DECaLS_39628_z decam/CP/V4.8.2a/CP20140814/c4d_140815_075529_ooi_z_ls9.fits.fz c4d_180910_023807_ooi_r_ls9-S4 r expnum 771443 exptime 46.0 propid 2014B-0404 seeing 1.35 MJD 58371.110 object DECaLS_39628_r decam/CP/V4.8.2a/CP20180909/c4d_180910_023807_ooi_r_ls9.fits.fz c4d_180910_023807_ooi_r_ls9-S3 r expnum 771443 exptime 46.0 propid 2014B-0404 seeing 1.36 MJD 58371.110 object DECaLS_39628_r decam/CP/V4.8.2a/CP20180909/c4d_180910_023807_ooi_r_ls9.fits.fz c4d_170917_035203_ooi_r_ls9-S12 r expnum 678354 exptime 48.0 propid 2014B-0404 seeing 0.93 MJD 58013.161 object DECaLS_7884_r decam/CP/V4.8.2a/CP20170916/c4d_170917_035203_ooi_r_ls9.fits.fz c4d_171113_005045_ooi_z_ls9-S12 z expnum 695607 exptime 161.0 propid 2014B-0404 seeing 0.80 MJD 58070.035 object DECaLS_7884_z decam/CP/V4.8.2a/CP20171112/c4d_171113_005045_ooi_z_ls9.fits.fz c4d_170922_022610_ooi_g_ls9-S12 g expnum 680110 exptime 154.0 propid 2014B-0404 seeing 1.38 MJD 58018.102 object DECaLS_7884_g decam/CP/V4.8.2a/CP20170921/c4d_170922_022610_ooi_g_ls9.fits.fz c4d_160813_055306_ooi_z_ls9-S11 z expnum 563588 exptime 90.0 propid 2014B-0404 seeing 0.94 MJD 57613.244 object DECaLS_23756_z decam/CP/V4.8.2a/CP20160812/c4d_160813_055306_ooi_z_ls9.fits.fz c4d_170916_044805_ooi_g_ls9-S11 g expnum 678025 exptime 127.0 propid 2014B-0404 seeing 1.43 MJD 58012.200 object DECaLS_23756_g decam/CP/V4.8.2a/CP20170915/c4d_170916_044805_ooi_g_ls9.fits.fz c4d_180619_084616_ooi_r_ls9-S11 r expnum 754111 exptime 90.0 propid 2014B-0404 seeing 1.46 MJD 58288.365 object DECaLS_23756_r decam/CP/V4.8.2a/CP20180618/c4d_180619_084616_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S3,noinherit][2046,4094][real]: DECaLS_39628 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S4,noinherit][2046,4094][real]: DECaLS_39628 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055045_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T075216_oi[S4,noinherit][2046,4094][real]: DECaLS_3 Clipping 43 pixels with anomalously large oow values: max 0.255371 vs median 0.00148698 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952303b-z-20171113T005045_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S11,noinherit][2046,4094][real]: DECaLS_ Clipping 751 pixels with anomalously large oow values: max 0.0105882 vs median 0.00646417 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T035203_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T022610_oi[S12,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S11,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 45.56 s, CPU: 1.44 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.180504 MB Stage tims finished: 2020-08-05T20:08:44.101384 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S4,noinherit][2046,4094][real]: DECaLS_39628 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S3,noinherit][2046,4094][real]: DECaLS_39628 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952303b-z-20171113T005045_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055045_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T035203_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T022610_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.019 s worker CPU, 212.223 s worker Wall, Wall: 45.558 s, Cores in use: 0.16, Total efficiency (on 32 cores): 0.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:08:44.125885 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04923.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05179.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05052.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05051.fits Matched 1 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/reference-custom-347360p10458.fits Stage refs : Wall: 4.76 s, CPU: 2.02 s, VmPeak: 1042 MB, VmSize: 1030 MB, VmRSS: 196 MB, VmData: 227 MB, maxrss: 0.200244 MB Stage refs finished: 2020-08-05T20:08:48.887876 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T075216_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.764 s, Cores in use: 0.42, Total efficiency (on 32 cores): 1.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:08:48.981912 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outlier-mask-custom-347360p10458.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outliers-pre-custom-347360p10458.jpg Image c4d_180619_084616_ooi_r_ls9-S11 r : masking 0 positive outlier pixels and 136 negative outlier pixels Image c4d_160813_055306_ooi_z_ls9-S11 z : masking 3403 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outlier-mask-custom-347360p10458.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outliers-post-custom-347360p10458.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outliers-masked-pos-custom-347360p10458.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/outliers-masked-neg-custom-347360p10458.jpg Stage outliers : Wall: 1.47 s, CPU: 1.05 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.212792 MB Stage outliers finished: 2020-08-05T20:08:50.450164 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage outliers : 0.656 s worker CPU, 1.095 s worker Wall, Wall: 1.470 s, Cores in use: 1.16, Total efficiency (on 32 cores): 3.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:08:50.565434 Stage halos : Wall: 1.22 s, CPU: 0.91 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.2132 MB Stage halos finished: 2020-08-05T20:08:51.785194 Resources for stage halos : 0.376 s worker CPU, 2.067 s worker Wall, Wall: 1.222 s, Cores in use: 1.06, Total efficiency (on 32 cores): 3.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:08:52.583616 PSF sigmas in coadd pixels: ['2.18', '2.25', '2.32'] Using average PSF sigma 2.2488999758469252 Gaussian PSF norm 0.12543678900954347 vs pixelized 0.10286561 average tim pixel scale / coadd scale: 1.0011683130203142 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.51', '2.19', '2.21', '1.51', '2.38'] Using average PSF sigma 2.3577627077257493 Gaussian PSF norm 0.11964511562148727 vs pixelized 0.09413281 average tim pixel scale / coadd scale: 1.0012053570866528 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.54', '1.31', '1.53'] Using average PSF sigma 1.4618393101497709 Gaussian PSF norm 0.19297250375964817 vs pixelized 0.15863745 average tim pixel scale / coadd scale: 1.0011003966770269 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.12 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.214792 MB Stage fit_on_coadds finished: 2020-08-05T20:08:52.736483 Resources for stage fit_on_coadds : 0.110 s worker CPU, 0.110 s worker Wall, Wall: 0.155 s, Cores in use: 1.52, Total efficiency (on 32 cores): 4.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:08:52.750354 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 14 potential peaks Of 14 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 10 kept SED z : 10 new peaks Found 9 potential peaks Of 9 potential peaks: 8 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 13 potential peaks Of 13 potential peaks: 9 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 16 potential peaks Of 16 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 18 potential peaks Of 18 potential peaks: 14 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 13 new sources Median coadd sky for g : -5.1744795e-05 Median coadd sky for r : 2.8463937e-05 Median coadd sky for z : 5.812713e-05 Stage srcs : Wall: 1.46 s, CPU: 1.39 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.215196 MB Stage srcs finished: 2020-08-05T20:08:54.208287 Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 1.460 s, Cores in use: 1.01, Total efficiency (on 32 cores): 3.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:08:54.226608 Blob 1 of 10, id: 4, sources: 3, size: 98x110, npix 6255, brick X: 86,184, Y: 66,176, one pixel: 111 66 Blob 2 of 10, id: 5, sources: 2, size: 52x47, npix 1174, brick X: 179,231, Y: 97,144, one pixel: 192 97 Blob 3 of 10, id: 8, sources: 2, size: 33x42, npix 803, brick X: 202,235, Y: 161,203, one pixel: 225 161 Blob 4 of 10, id: 2, sources: 1, size: 30x28, npix 612, brick X: 156,186, Y: 0,28, one pixel: 163 0 Blob 5 of 10, id: 7, sources: 1, size: 30x31, npix 610, brick X: 184,214, Y: 141,172, one pixel: 197 141 Blob 6 of 10, id: 1, sources: 1, size: 29x26, npix 506, brick X: 119,148, Y: 0,26, one pixel: 128 0 Blob 7 of 10, id: 3, sources: 1, size: 27x25, npix 439, brick X: 86,113, Y: 42,67, one pixel: 100 42 Blob 8 of 10, id: 9, sources: 1, size: 18x23, npix 274, brick X: 0,18, Y: 192,215, one pixel: 5 192 Blob 9 of 10, id: 0, sources: 1, size: 22x19, npix 272, brick X: 22,44, Y: 0,19, one pixel: 29 0 Blob 10 of 10, id: 6, sources: 1, size: 20x21, npix 239, brick X: 28,48, Y: 106,127, one pixel: 38 106 Blob 10 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 941 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150572 MB Blob 8 finished, total: Wall: 0.59 s, CPU: 0.57 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147884 MB Blob 6 finished, total: Wall: 0.79 s, CPU: 0.78 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.095472 MB Blob 5 finished, total: Wall: 0.84 s, CPU: 0.83 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092472 MB Blob 9 finished, total: Wall: 0.93 s, CPU: 0.91 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114344 MB Blob 3 finished, total: Wall: 0.98 s, CPU: 0.97 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.113532 MB Blob 4 finished, total: Wall: 1.04 s, CPU: 1.02 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.114172 MB Blob 7 finished, total: Wall: 1.05 s, CPU: 1.04 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148504 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.27 s, CPU: 1.26 s, VmPeak: 937 MB, VmSize: 733 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150972 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.43449, ee1=0.202736, ee2=-0.402014 Measuring 4 iterative sources Blob 1 finished, total: Wall: 4.97 s, CPU: 4.96 s, VmPeak: 675 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.103124 MB Old catalog: 16 New catalog: 16 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/blobs-custom-347360p10458.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/metrics/cus/all-models-custom-347360p10458.fits Stage fitblobs : Wall: 6.42 s, CPU: 1.37 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.21536 MB Stage fitblobs finished: 2020-08-05T20:09:00.649125 Resources for stage fitblobs : 12.760 s worker CPU, 13.156 s worker Wall, Wall: 6.425 s, Cores in use: 2.20, Total efficiency (on 32 cores): 6.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:09:00.664689 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-resid.jpg Stage coadds : Wall: 3.85 s, CPU: 1.06 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.215876 MB Stage coadds finished: 2020-08-05T20:09:04.515165 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 26.090 s worker CPU, 49.996 s worker Wall, Wall: 3.853 s, Cores in use: 7.05, Total efficiency (on 32 cores): 22.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:09:04.534478 Cut to 1 unWISE tiles Reading WISE tile 3476p106 band 1 Reading WISE tile 3476p106 band 4 Reading WISE tile 3476p106 band 2 Reading WISE tile 3476p106 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 138 MB, VmData: 170 MB, maxrss: 0.20112 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 937 MB, VmSize: 810 MB, VmRSS: 150 MB, VmData: 179 MB, maxrss: 0.191548 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 934 MB, VmSize: 801 MB, VmRSS: 143 MB, VmData: 170 MB, maxrss: 0.20304 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 941 MB, VmSize: 802 MB, VmRSS: 142 MB, VmData: 172 MB, maxrss: 0.204764 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.74 s, CPU: 1.62 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 212 MB, VmData: 237 MB, maxrss: 0.216584 MB Stage wise_forced finished: 2020-08-05T20:09:08.274066 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.116 s worker CPU, 6.093 s worker Wall, Wall: 3.742 s, Cores in use: 1.27, Total efficiency (on 32 cores): 4.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:09:08.289092 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/tractor-i/cus/tractor-custom-347360p10458.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/tractor/cus/tractor-custom-347360p10458.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/tractor/cus/brick-custom-347360p10458.sha256sum Stage writecat : Wall: 1.63 s, CPU: 0.90 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 213 MB, VmData: 237 MB, maxrss: 0.349588 MB Stage writecat finished: 2020-08-05T20:09:09.917980 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.631 s, Cores in use: 0.55, Total efficiency (on 32 cores): 1.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1379826/PGC1379826-largegalaxy-writecat.p All done: 49.212 s worker CPU, 284.826 s worker Wall, Wall: 71.401 s, Cores in use: 0.86, Total efficiency (on 32 cores): 2.7 % Finished galaxy PGC1379826 in 1.239 minutes. Started working on galaxy PGC1379826 at Mon Aug 10 08:19:58 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.36047273576065 10.458052251153457 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T08:19:59.881576 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.36047273576065', '10.458052251153457', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.36047273576065 10.458052251153457 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 347.36047273576065 10.458052251153457 Starting process 13253 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 13256 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059396 MB Starting process 13259 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059396 MB Starting process 13262 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059396 MB Starting process 13265 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 13268 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 13274 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 13279 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05932 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T08:20:00.619241 Keeping 11 CCDs: c4d_170721_064746_ooi_g_ls9-S4 g expnum 660491 exptime 131.0 propid 2014B-0404 seeing 1.34 MJD 57955.281 object DECaLS_39628_g decam/CP/V4.8.2/CP20170720/c4d_170721_064746_ooi_g_ls9.fits.fz c4d_170719_073302_ooi_r_ls9-S4 r expnum 660043 exptime 114.0 propid 2014B-0404 seeing 2.16 MJD 57953.313 object DECaLS_39628_r decam/CP/V4.8.2/CP20170718/c4d_170719_073302_ooi_r_ls9.fits.fz c4d_140815_075529_ooi_z_ls9-S4 z expnum 348047 exptime 138.0 propid 2014B-0404 seeing 0.95 MJD 56884.328 object DECaLS_39628_z decam/CP/V4.8.2a/CP20140814/c4d_140815_075529_ooi_z_ls9.fits.fz c4d_180910_023807_ooi_r_ls9-S4 r expnum 771443 exptime 46.0 propid 2014B-0404 seeing 1.35 MJD 58371.110 object DECaLS_39628_r decam/CP/V4.8.2a/CP20180909/c4d_180910_023807_ooi_r_ls9.fits.fz c4d_180910_023807_ooi_r_ls9-S3 r expnum 771443 exptime 46.0 propid 2014B-0404 seeing 1.36 MJD 58371.110 object DECaLS_39628_r decam/CP/V4.8.2a/CP20180909/c4d_180910_023807_ooi_r_ls9.fits.fz c4d_170917_035203_ooi_r_ls9-S12 r expnum 678354 exptime 48.0 propid 2014B-0404 seeing 0.93 MJD 58013.161 object DECaLS_7884_r decam/CP/V4.8.2a/CP20170916/c4d_170917_035203_ooi_r_ls9.fits.fz c4d_171113_005045_ooi_z_ls9-S12 z expnum 695607 exptime 161.0 propid 2014B-0404 seeing 0.80 MJD 58070.035 object DECaLS_7884_z decam/CP/V4.8.2a/CP20171112/c4d_171113_005045_ooi_z_ls9.fits.fz c4d_170922_022610_ooi_g_ls9-S12 g expnum 680110 exptime 154.0 propid 2014B-0404 seeing 1.38 MJD 58018.102 object DECaLS_7884_g decam/CP/V4.8.2a/CP20170921/c4d_170922_022610_ooi_g_ls9.fits.fz c4d_160813_055306_ooi_z_ls9-S11 z expnum 563588 exptime 90.0 propid 2014B-0404 seeing 0.94 MJD 57613.244 object DECaLS_23756_z decam/CP/V4.8.2a/CP20160812/c4d_160813_055306_ooi_z_ls9.fits.fz c4d_170916_044805_ooi_g_ls9-S11 g expnum 678025 exptime 127.0 propid 2014B-0404 seeing 1.43 MJD 58012.200 object DECaLS_23756_g decam/CP/V4.8.2a/CP20170915/c4d_170916_044805_ooi_g_ls9.fits.fz c4d_180619_084616_ooi_r_ls9-S11 r expnum 754111 exptime 90.0 propid 2014B-0404 seeing 1.46 MJD 58288.365 object DECaLS_23756_r decam/CP/V4.8.2a/CP20180618/c4d_180619_084616_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T035203_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S3,noinherit][2046,4094][real]: DECaLS_39628 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S4,noinherit][2046,4094][real]: DECaLS_39628 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952303b-z-20171113T005045_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T075216_oi[S4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T022610_oi[S12,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055045_oi[S11,noinherit][2046,4094][real]: DECaLS_ Clipping 43 pixels with anomalously large oow values: max 0.255371 vs median 0.00148698 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S11,noinherit][2046,4094][real]: DECaLS_ Clipping 763 pixels with anomalously large oow values: max 0.0105882 vs median 0.00646417 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S11,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 77.59 s, CPU: 0.97 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.179036 MB Stage tims finished: 2020-08-10T08:21:18.210398 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S3,noinherit][2046,4094][real]: DECaLS_39628 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952303b-z-20171113T005045_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T075216_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T035203_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055045_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S4,noinherit][2046,4094][real]: DECaLS_39628 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T022610_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.889 s worker CPU, 358.098 s worker Wall, Wall: 77.592 s, Cores in use: 0.09, Total efficiency (on 8 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-10T08:21:18.268729 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04923.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05179.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05052.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05051.fits Matched 1 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/metrics/cus/reference-custom-347360p10458.fits Stage refs : Wall: 9.07 s, CPU: 1.88 s, VmPeak: 1036 MB, VmSize: 1023 MB, VmRSS: 194 MB, VmData: 227 MB, maxrss: 0.198924 MB Stage refs finished: 2020-08-10T08:21:27.342232 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.075 s, Cores in use: 0.21, Total efficiency (on 8 cores): 2.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T08:21:27.435797 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/metrics/cus/outlier-mask-custom-347360p10458.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/metrics/cus/outliers-pre-custom-347360p10458.jpg Image c4d_170719_073302_ooi_r_ls9-S4 r : masking 191 positive outlier pixels and 0 negative outlier pixels Image c4d_180619_084616_ooi_r_ls9-S11 r : masking 215 positive outlier pixels and 107 negative outlier pixels Image c4d_160813_055306_ooi_z_ls9-S11 z : masking 3379 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/metrics/cus/outlier-mask-custom-347360p10458.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/metrics/cus/outliers-post-custom-347360p10458.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/metrics/cus/outliers-masked-pos-custom-347360p10458.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/metrics/cus/outliers-masked-neg-custom-347360p10458.jpg Stage outliers : Wall: 1.26 s, CPU: 1.02 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.21072 MB Stage outliers finished: 2020-08-10T08:21:28.695301 Resources for stage outliers : 0.577 s worker CPU, 0.577 s worker Wall, Wall: 1.260 s, Cores in use: 1.27, Total efficiency (on 8 cores): 15.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T08:21:28.778894 Stage halos : Wall: 0.72 s, CPU: 0.59 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.211096 MB Stage halos finished: 2020-08-10T08:21:29.499523 Resources for stage halos : 0.281 s worker CPU, 0.721 s worker Wall, Wall: 0.722 s, Cores in use: 1.21, Total efficiency (on 8 cores): 15.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T08:21:30.756916 PSF sigmas in coadd pixels: ['2.18', '2.25', '2.32'] Using average PSF sigma 2.2488999758469252 Gaussian PSF norm 0.12543678900954347 vs pixelized 0.10286471 average tim pixel scale / coadd scale: 1.0011683130203142 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.51', '2.19', '2.21', '1.51', '2.38'] Using average PSF sigma 2.3577627077257493 Gaussian PSF norm 0.11964511562148727 vs pixelized 0.09413316 average tim pixel scale / coadd scale: 1.0012053570866528 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.54', '1.31', '1.53'] Using average PSF sigma 1.4618393101497709 Gaussian PSF norm 0.19297250375964817 vs pixelized 0.15864217 average tim pixel scale / coadd scale: 1.0011003966770269 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.13 s, CPU: 0.12 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.212696 MB Stage fit_on_coadds finished: 2020-08-10T08:21:30.884339 Resources for stage fit_on_coadds : 0.143 s worker CPU, 0.143 s worker Wall, Wall: 0.128 s, Cores in use: 2.04, Total efficiency (on 8 cores): 25.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T08:21:30.894236 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 13 potential peaks Of 13 potential peaks: 3 in veto map, 1 cut by saddle test, 0 cut by aper test, 9 kept SED z : 9 new peaks Found 9 potential peaks Of 9 potential peaks: 8 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 12 potential peaks Of 12 potential peaks: 8 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 13 potential peaks Of 13 potential peaks: 10 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 18 potential peaks Of 18 potential peaks: 14 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 11 new sources Median coadd sky for g : -6.93708e-05 Median coadd sky for r : 4.375539e-05 Median coadd sky for z : 0.0001564699 Stage srcs : Wall: 0.61 s, CPU: 0.57 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.213088 MB Stage srcs finished: 2020-08-10T08:21:31.502132 Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 0.609 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T08:21:31.511688 Blob 1 of 10, id: 4, sources: 2, size: 98x111, npix 6274, brick X: 81,179, Y: 66,177, one pixel: 108 66 Blob 2 of 10, id: 5, sources: 2, size: 53x47, npix 1175, brick X: 173,226, Y: 98,145, one pixel: 185 98 Blob 3 of 10, id: 9, sources: 1, size: 32x30, npix 635, brick X: 197,229, Y: 174,204, one pixel: 211 174 Blob 4 of 10, id: 2, sources: 1, size: 30x29, npix 631, brick X: 151,181, Y: 0,29, one pixel: 158 0 Blob 5 of 10, id: 7, sources: 1, size: 30x31, npix 618, brick X: 179,209, Y: 142,173, one pixel: 191 142 Blob 6 of 10, id: 1, sources: 1, size: 28x26, npix 506, brick X: 114,142, Y: 0,26, one pixel: 123 0 Blob 7 of 10, id: 3, sources: 1, size: 27x25, npix 433, brick X: 81,108, Y: 42,67, one pixel: 95 42 Blob 8 of 10, id: 0, sources: 1, size: 21x20, npix 273, brick X: 17,38, Y: 0,20, one pixel: 24 0 Blob 9 of 10, id: 6, sources: 1, size: 20x21, npix 240, brick X: 23,43, Y: 107,128, one pixel: 32 107 Blob 8 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145288 MB Blob 10 of 10, id: 8, sources: 1, size: 17x19, npix 195, brick X: 228,245, Y: 142,161, one pixel: 236 142 Blob 6 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.144992 MB Blob 5 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 959 MB, VmSize: 724 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143568 MB Blob 7 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 964 MB, VmSize: 723 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142996 MB Blob 3 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 937 MB, VmSize: 727 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147952 MB Blob 9 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145288 MB Blob 4 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 962 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146112 MB Measuring 1 iterative sources Blob 10 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.144992 MB Blob 2 finished, total: Wall: 1.84 s, CPU: 1.84 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.146984 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.23283, ee1=0.134456, ee2=-0.366917 Measuring 3 iterative sources Blob 1 finished, total: Wall: 4.37 s, CPU: 4.37 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14856 MB Old catalog: 14 New catalog: 15 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/metrics/cus/blobs-custom-347360p10458.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/metrics/cus/all-models-custom-347360p10458.fits Stage fitblobs : Wall: 4.69 s, CPU: 0.30 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.213256 MB Stage fitblobs finished: 2020-08-10T08:21:36.199636 Resources for stage fitblobs : 13.987 s worker CPU, 14.054 s worker Wall, Wall: 4.689 s, Cores in use: 3.05, Total efficiency (on 8 cores): 38.1 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T08:21:36.211902 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-resid.jpg Stage coadds : Wall: 1.46 s, CPU: 0.80 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 209 MB, VmData: 236 MB, maxrss: 0.213772 MB Stage coadds finished: 2020-08-10T08:21:37.671666 Resources for stage coadds : 3.563 s worker CPU, 4.038 s worker Wall, Wall: 1.461 s, Cores in use: 2.99, Total efficiency (on 8 cores): 37.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T08:21:37.682500 Cut to 1 unWISE tiles Reading WISE tile 3476p106 band 1 Reading WISE tile 3476p106 band 2 Reading WISE tile 3476p106 band 3 Reading WISE tile 3476p106 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 940 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.206848 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 959 MB, VmSize: 807 MB, VmRSS: 150 MB, VmData: 178 MB, maxrss: 0.192176 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 937 MB, VmSize: 804 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.210084 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 962 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208984 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/tmp-legacysurvey-custom-347360p10458-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.72 s, CPU: 0.38 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 209 MB, VmData: 236 MB, maxrss: 0.214476 MB Stage wise_forced finished: 2020-08-10T08:21:39.403594 Resources for stage wise_forced : 3.221 s worker CPU, 4.240 s worker Wall, Wall: 1.722 s, Cores in use: 2.09, Total efficiency (on 8 cores): 26.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T08:21:39.415492 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/coadd/cus/custom-347360p10458/legacysurvey-custom-347360p10458-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/tractor-i/cus/tractor-custom-347360p10458.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/tractor/cus/tractor-custom-347360p10458.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/tractor/cus/brick-custom-347360p10458.sha256sum Stage writecat : Wall: 0.86 s, CPU: 0.62 s, VmPeak: 1166 MB, VmSize: 1038 MB, VmRSS: 211 MB, VmData: 236 MB, maxrss: 0.347464 MB Stage writecat finished: 2020-08-10T08:21:40.272544 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.858 s, Cores in use: 0.73, Total efficiency (on 8 cores): 9.1 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1379826/PGC1379826-largegalaxy-writecat.p All done: 27.742 s worker CPU, 381.952 s worker Wall, Wall: 99.674 s, Cores in use: 0.35, Total efficiency (on 8 cores): 4.4 % Finished galaxy PGC1379826 in 1.699 minutes.