Started working on galaxy PGC1406896 at Wed Aug 5 18:56:03 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.5509 12.2894 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T18:56:03.771155 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '353.5509', '12.2894', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.5509 12.2894 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 353.5509 12.2894 Starting process 4212 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 4213 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 4214 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 4216 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 4217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059336 MB Starting process 4218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059324 MB Starting process 4219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059324 MB Starting process 4220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 4221 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 4222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 4223 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 4224 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 4226 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 4227 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 4225 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 4228 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T18:56:04.657936 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 14 CCDs: c4d_170722_074539_ooi_r_ls9-N14 r expnum 660980 exptime 49.0 propid 2014B-0404 seeing 1.08 MJD 57956.322 object DECaLS_7844_r decam/CP/V4.8.2a/CP20170721/c4d_170722_074539_ooi_r_ls9.fits.fz c4d_180902_054007_ooi_z_ls9-N14 z expnum 767946 exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 58363.236 object DECaLS_7844_z decam/CP/V4.8.2a/CP20180901/c4d_180902_054007_ooi_z_ls9.fits.fz c4d_170722_074752_ooi_g_ls9-N14 g expnum 660981 exptime 104.0 propid 2014B-0404 seeing 1.11 MJD 57956.323 object DECaLS_7844_g decam/CP/V4.8.2a/CP20170721/c4d_170722_074752_ooi_g_ls9.fits.fz c4d_140811_063436_ooi_z_ls9-N14 z expnum 346734 exptime 132.0 propid 2014B-0404 seeing 1.53 MJD 56880.272 object DECaLS_7844_z decam/CP/V4.8.2a/CP20140810/c4d_140811_063436_ooi_z_ls9.fits.fz c4d_170721_073122_ooi_g_ls9-S30 g expnum 660507 exptime 131.0 propid 2014B-0404 seeing 1.63 MJD 57955.311 object DECaLS_23737_g decam/CP/V4.8.2/CP20170720/c4d_170721_073122_ooi_g_ls9.fits.fz c4d_170724_073950_ooi_r_ls9-S30 r expnum 661628 exptime 89.0 propid 2014B-0404 seeing 1.79 MJD 57958.318 object DECaLS_23737_r decam/CP/V4.8.2a/CP20170723/c4d_170724_073950_ooi_r_ls9.fits.fz c4d_171023_001432_ooi_z_ls9-N24 z expnum 689987 exptime 250.0 propid 2014B-0404 seeing 1.04 MJD 58049.010 object DECaLS_39587_z decam/CP/V4.8.2a/CP20171022/c4d_171023_001432_ooi_z_ls9.fits.fz c4d_181016_020412_ooi_z_ls9-N24 z expnum 783853 exptime 110.0 propid 2014B-0404 seeing 1.12 MJD 58407.086 object DECaLS_39587_z decam/CP/V4.8.2a/CP20181015/c4d_181016_020412_ooi_z_ls9.fits.fz c4d_181005_010736_ooi_r_ls9-N24 r expnum 780623 exptime 175.0 propid 2014B-0404 seeing 1.41 MJD 58396.047 object DECaLS_39587_r decam/CP/V4.8.2a/CP20181004/c4d_181005_010736_ooi_r_ls9.fits.fz c4d_170801_073954_ooi_g_ls9-N24 g expnum 663759 exptime 200.0 propid 2014B-0404 seeing 2.07 MJD 57966.316 object DECaLS_39587_g decam/CP/V4.8.2a/CP20170731/c4d_170801_073954_ooi_g_ls9.fits.fz c4d_181006_012606_ooi_g_ls9-N24 g expnum 780949 exptime 126.0 propid 2014B-0404 seeing 1.41 MJD 58397.060 object DECaLS_39587_g decam/CP/V4.8.2a/CP20181005/c4d_181006_012606_ooi_g_ls9.fits.fz c4d_180901_075127_ooi_z_ls9-S29 z expnum 767621 exptime 80.0 propid 2014B-0404 seeing 1.27 MJD 58362.327 object DECaLS_39609_z decam/CP/V4.8.2a/CP20180831/c4d_180901_075127_ooi_z_ls9.fits.fz c4d_181005_011423_ooi_g_ls9-S29 g expnum 780625 exptime 200.0 propid 2014B-0404 seeing 1.75 MJD 58396.052 object DECaLS_39609_g decam/CP/V4.8.2a/CP20181004/c4d_181005_011423_ooi_g_ls9.fits.fz c4d_181006_012849_ooi_r_ls9-S29 r expnum 780950 exptime 60.0 propid 2014B-0404 seeing 1.37 MJD 58397.062 object DECaLS_39609_r decam/CP/V4.8.2a/CP20181005/c4d_181006_012849_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170722T074516_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181005T011423_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T075127_oi[S29,noinherit][2046,4094][real]: DECaLS_3960 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a245-z-20140811T063131_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T073726_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521352-g-20170801T073540_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e8b1-r-20170722T074357_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953704b-g-20181006T012606_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180902T054007_oi[N14,noinherit][2046,4094][real]: DECaLS_7844 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953651d-r-20181005T010736_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95202c1-z-20171023T001432_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95316b1-z-20181016T020412_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536893-r-20181006T012849_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T072819_oi[S30,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 79.70 s, CPU: 1.36 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 181 MB, VmData: 213 MB, maxrss: 0.18532 MB Stage tims finished: 2020-08-05T18:57:24.360866 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170722T074516_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e8b1-r-20170722T074357_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521352-g-20170801T073540_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953704b-g-20181006T012606_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181005T011423_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T073726_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180902T054007_oi[N14,noinherit][2046,4094][real]: DECaLS_7844 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95316b1-z-20181016T020412_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T072819_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 9.056 s worker CPU, 922.767 s worker Wall, Wall: 79.705 s, Cores in use: 0.13, Total efficiency (on 16 cores): 0.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T075127_oi[S29,noinherit][2046,4094][real]: DECaLS_3960 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953651d-r-20181005T010736_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95202c1-z-20171023T001432_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T18:57:24.510246 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04925.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04798.fits Matched 8 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/reference-custom-353550p12289.fits Stage refs : Wall: 16.42 s, CPU: 1.93 s, VmPeak: 1043 MB, VmSize: 1030 MB, VmRSS: 199 MB, VmData: 231 MB, maxrss: 0.20424 MB Stage refs finished: 2020-08-05T18:57:40.932617 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536893-r-20181006T012849_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a245-z-20140811T063131_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 16.424 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T18:57:41.170535 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outlier-mask-custom-353550p12289.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outliers-pre-custom-353550p12289.jpg Image c4d_170721_073122_ooi_g_ls9-S30 g : masking 548 positive outlier pixels and 0 negative outlier pixels Image c4d_181006_012849_ooi_r_ls9-S29 r : masking 366 positive outlier pixels and 248 negative outlier pixels Image c4d_170724_073950_ooi_r_ls9-S30 r : masking 54 positive outlier pixels and 0 negative outlier pixels Image c4d_140811_063436_ooi_z_ls9-N14 z : masking 857 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outlier-mask-custom-353550p12289.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outliers-post-custom-353550p12289.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outliers-masked-pos-custom-353550p12289.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outliers-masked-neg-custom-353550p12289.jpg Stage outliers : Wall: 1.06 s, CPU: 0.88 s, VmPeak: 1043 MB, VmSize: 1026 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.217848 MB Stage outliers finished: 2020-08-05T18:57:42.230766 Resources for stage outliers : 0.913 s worker CPU, 0.948 s worker Wall, Wall: 1.062 s, Cores in use: 1.69, Total efficiency (on 16 cores): 10.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T18:57:42.259753 Stage halos : Wall: 5.84 s, CPU: 0.25 s, VmPeak: 1043 MB, VmSize: 1026 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.217848 MB Stage halos finished: 2020-08-05T18:57:48.095507 Resources for stage halos : 0.454 s worker CPU, 6.253 s worker Wall, Wall: 5.838 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T18:57:48.240917 PSF sigmas in coadd pixels: ['1.81', '2.65', '3.36', '2.30', '2.85'] Using average PSF sigma 2.5921726167911343 Gaussian PSF norm 0.10882561984744865 vs pixelized 0.08847723 average tim pixel scale / coadd scale: 1.0012054970516389 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.75', '2.90', '2.29', '2.22'] Using average PSF sigma 2.2905926387357085 Gaussian PSF norm 0.12315362714584653 vs pixelized 0.104251035 average tim pixel scale / coadd scale: 1.0012166842530332 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.62', '2.49', '1.69', '1.81', '2.07'] Using average PSF sigma 1.9351461221639525 Gaussian PSF norm 0.14577441390236168 vs pixelized 0.12531433 average tim pixel scale / coadd scale: 1.0011420329279117 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.19 s, VmPeak: 1043 MB, VmSize: 1026 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.217848 MB Stage fit_on_coadds finished: 2020-08-05T18:57:48.441782 Resources for stage fit_on_coadds : 0.234 s worker CPU, 0.234 s worker Wall, Wall: 0.202 s, Cores in use: 2.09, Total efficiency (on 16 cores): 13.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T18:57:48.451268 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 18 potential peaks Of 18 potential peaks: 1 in veto map, 2 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 16 potential peaks Of 16 potential peaks: 13 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 14 potential peaks Of 14 potential peaks: 11 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 22 potential peaks Of 22 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 26 potential peaks Of 26 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 23 new sources Median coadd sky for g : -6.112145e-05 Median coadd sky for r : -0.0001272253 Median coadd sky for z : -8.409507e-05 Stage srcs : Wall: 0.49 s, CPU: 0.47 s, VmPeak: 1043 MB, VmSize: 1026 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.217848 MB Stage srcs finished: 2020-08-05T18:57:48.941589 Resources for stage srcs : 0.061 s worker CPU, 0.062 s worker Wall, Wall: 0.492 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T18:57:48.954362 Blob 1 of 11, id: 5, sources: 6, size: 64x139, npix 5933, brick X: 87,151, Y: 53,192, one pixel: 125 53 Blob 2 of 11, id: 2, sources: 6, size: 45x99, npix 2433, brick X: 0,45, Y: 13,112, one pixel: 5 13 Blob 3 of 11, id: 9, sources: 4, size: 44x56, npix 1708, brick X: 137,181, Y: 177,233, one pixel: 169 177 Blob 4 of 11, id: 3, sources: 1, size: 45x45, npix 1447, brick X: 175,220, Y: 13,58, one pixel: 197 13 Blob 5 of 11, id: 1, sources: 2, size: 44x52, npix 1406, brick X: 80,124, Y: 5,57, one pixel: 92 5 Blob 6 of 11, id: 10, sources: 1, size: 28x28, npix 522, brick X: 4,32, Y: 198,226, one pixel: 18 198 Blob 7 of 11, id: 6, sources: 1, size: 21x21, npix 260, brick X: 165,186, Y: 80,101, one pixel: 175 80 Blob 8 of 11, id: 4, sources: 1, size: 21x20, npix 258, brick X: 125,146, Y: 18,38, one pixel: 134 18 Blob 9 of 11, id: 8, sources: 1, size: 21x20, npix 229, brick X: 63,84, Y: 170,190, one pixel: 72 170 Blob 10 of 11, id: 7, sources: 1, size: 20x19, npix 209, brick X: 28,48, Y: 107,126, one pixel: 36 107 Blob 11 of 11, id: 0, sources: 1, size: 21x15, npix 204, brick X: 13,34, Y: 0,15, one pixel: 17 0 Blob 10 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149812 MB Blob 8 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150084 MB Blob 9 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149848 MB Blob 7 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14996 MB Blob 4 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 962 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149964 MB Blob 6 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150216 MB Blob 11 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147892 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 2.48 s, CPU: 2.47 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151204 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.82 s, CPU: 2.82 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115744 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 4.08 s, CPU: 4.08 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149888 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.58364, ee1=0.660016, ee2=-0.125767 Blob 1 finished, total: Wall: 6.49 s, CPU: 6.49 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 181 MB, maxrss: 0.152812 MB Old catalog: 27 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/blobs-custom-353550p12289.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/all-models-custom-353550p12289.fits Stage fitblobs : Wall: 6.83 s, CPU: 0.31 s, VmPeak: 1043 MB, VmSize: 1026 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.217848 MB Stage fitblobs finished: 2020-08-05T18:57:55.783556 Resources for stage fitblobs : 19.160 s worker CPU, 19.213 s worker Wall, Wall: 6.831 s, Cores in use: 2.85, Total efficiency (on 16 cores): 17.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T18:57:55.797718 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-resid.jpg Stage coadds : Wall: 2.74 s, CPU: 0.95 s, VmPeak: 1043 MB, VmSize: 1026 MB, VmRSS: 205 MB, VmData: 230 MB, maxrss: 0.217848 MB Stage coadds finished: 2020-08-05T18:57:58.537110 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.457 s worker CPU, 10.929 s worker Wall, Wall: 2.741 s, Cores in use: 3.43, Total efficiency (on 16 cores): 21.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T18:57:58.548574 Cut to 1 unWISE tiles Reading WISE tile 3538p121 band 1 Reading WISE tile 3538p121 band 3 Reading WISE tile 3538p121 band 4 Reading WISE tile 3538p121 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 957 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207232 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207216 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 812 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.19692 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 960 MB, VmSize: 874 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.2178 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.28 s, CPU: 0.45 s, VmPeak: 1043 MB, VmSize: 1026 MB, VmRSS: 206 MB, VmData: 230 MB, maxrss: 0.217848 MB Stage wise_forced finished: 2020-08-05T18:58:02.829826 Resources for stage wise_forced : 2.880 s worker CPU, 9.893 s worker Wall, Wall: 4.283 s, Cores in use: 0.78, Total efficiency (on 16 cores): 4.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T18:58:02.848861 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/tractor-i/cus/tractor-custom-353550p12289.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/tractor/cus/tractor-custom-353550p12289.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/tractor/cus/brick-custom-353550p12289.sha256sum Stage writecat : Wall: 1.90 s, CPU: 1.31 s, VmPeak: 1158 MB, VmSize: 1030 MB, VmRSS: 207 MB, VmData: 230 MB, maxrss: 0.343408 MB Stage writecat finished: 2020-08-05T18:58:04.751593 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.904 s, Cores in use: 0.69, Total efficiency (on 16 cores): 4.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-writecat.p All done: 41.219 s worker CPU, 970.304 s worker Wall, Wall: 120.113 s, Cores in use: 0.41, Total efficiency (on 16 cores): 2.6 % Finished galaxy PGC1406896 in 2.035 minutes. Started working on galaxy PGC1406896 at Wed Aug 5 19:01:57 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.5509 12.2894 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:02:02.711598 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '353.5509', '12.2894', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.5509 12.2894 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 353.5509 12.2894 Starting process 5137 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 5138 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 5139 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 5141 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 5143 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0594 MB Starting process 5145 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 5148 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 5150 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 5152 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 5154 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 5156 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 5158 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 5160 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 5162 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 5164 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 5166 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 5168 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 5170 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 5175 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 5176 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 5177 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 5179 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 5180 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 5181 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 5178 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 5182 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 5183 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 5184 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 5185 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 5187 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 5188 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 5190 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:02:04.475987 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 14 CCDs: c4d_170722_074539_ooi_r_ls9-N14 r expnum 660980 exptime 49.0 propid 2014B-0404 seeing 1.08 MJD 57956.322 object DECaLS_7844_r decam/CP/V4.8.2a/CP20170721/c4d_170722_074539_ooi_r_ls9.fits.fz c4d_180902_054007_ooi_z_ls9-N14 z expnum 767946 exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 58363.236 object DECaLS_7844_z decam/CP/V4.8.2a/CP20180901/c4d_180902_054007_ooi_z_ls9.fits.fz c4d_170722_074752_ooi_g_ls9-N14 g expnum 660981 exptime 104.0 propid 2014B-0404 seeing 1.11 MJD 57956.323 object DECaLS_7844_g decam/CP/V4.8.2a/CP20170721/c4d_170722_074752_ooi_g_ls9.fits.fz c4d_140811_063436_ooi_z_ls9-N14 z expnum 346734 exptime 132.0 propid 2014B-0404 seeing 1.53 MJD 56880.272 object DECaLS_7844_z decam/CP/V4.8.2a/CP20140810/c4d_140811_063436_ooi_z_ls9.fits.fz c4d_170721_073122_ooi_g_ls9-S30 g expnum 660507 exptime 131.0 propid 2014B-0404 seeing 1.63 MJD 57955.311 object DECaLS_23737_g decam/CP/V4.8.2/CP20170720/c4d_170721_073122_ooi_g_ls9.fits.fz c4d_170724_073950_ooi_r_ls9-S30 r expnum 661628 exptime 89.0 propid 2014B-0404 seeing 1.79 MJD 57958.318 object DECaLS_23737_r decam/CP/V4.8.2a/CP20170723/c4d_170724_073950_ooi_r_ls9.fits.fz c4d_171023_001432_ooi_z_ls9-N24 z expnum 689987 exptime 250.0 propid 2014B-0404 seeing 1.04 MJD 58049.010 object DECaLS_39587_z decam/CP/V4.8.2a/CP20171022/c4d_171023_001432_ooi_z_ls9.fits.fz c4d_181016_020412_ooi_z_ls9-N24 z expnum 783853 exptime 110.0 propid 2014B-0404 seeing 1.12 MJD 58407.086 object DECaLS_39587_z decam/CP/V4.8.2a/CP20181015/c4d_181016_020412_ooi_z_ls9.fits.fz c4d_181005_010736_ooi_r_ls9-N24 r expnum 780623 exptime 175.0 propid 2014B-0404 seeing 1.41 MJD 58396.047 object DECaLS_39587_r decam/CP/V4.8.2a/CP20181004/c4d_181005_010736_ooi_r_ls9.fits.fz c4d_170801_073954_ooi_g_ls9-N24 g expnum 663759 exptime 200.0 propid 2014B-0404 seeing 2.07 MJD 57966.316 object DECaLS_39587_g decam/CP/V4.8.2a/CP20170731/c4d_170801_073954_ooi_g_ls9.fits.fz c4d_181006_012606_ooi_g_ls9-N24 g expnum 780949 exptime 126.0 propid 2014B-0404 seeing 1.41 MJD 58397.060 object DECaLS_39587_g decam/CP/V4.8.2a/CP20181005/c4d_181006_012606_ooi_g_ls9.fits.fz c4d_180901_075127_ooi_z_ls9-S29 z expnum 767621 exptime 80.0 propid 2014B-0404 seeing 1.27 MJD 58362.327 object DECaLS_39609_z decam/CP/V4.8.2a/CP20180831/c4d_180901_075127_ooi_z_ls9.fits.fz c4d_181005_011423_ooi_g_ls9-S29 g expnum 780625 exptime 200.0 propid 2014B-0404 seeing 1.75 MJD 58396.052 object DECaLS_39609_g decam/CP/V4.8.2a/CP20181004/c4d_181005_011423_ooi_g_ls9.fits.fz c4d_181006_012849_ooi_r_ls9-S29 r expnum 780950 exptime 60.0 propid 2014B-0404 seeing 1.37 MJD 58397.062 object DECaLS_39609_r decam/CP/V4.8.2a/CP20181005/c4d_181006_012849_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953704b-g-20181006T012606_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T073726_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T075127_oi[S29,noinherit][2046,4094][real]: DECaLS_3960 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181005T011423_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536893-r-20181006T012849_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180902T054007_oi[N14,noinherit][2046,4094][real]: DECaLS_7844 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e8b1-r-20170722T074357_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95316b1-z-20181016T020412_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a245-z-20140811T063131_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521352-g-20170801T073540_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170722T074516_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953651d-r-20181005T010736_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T072819_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95202c1-z-20171023T001432_oi[N24,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 49.93 s, CPU: 2.89 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 181 MB, VmData: 213 MB, maxrss: 0.185396 MB Stage tims finished: 2020-08-05T19:02:54.404119 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953704b-g-20181006T012606_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T073726_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T075127_oi[S29,noinherit][2046,4094][real]: DECaLS_3960 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536893-r-20181006T012849_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180902T054007_oi[N14,noinherit][2046,4094][real]: DECaLS_7844 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95316b1-z-20181016T020412_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e8b1-r-20170722T074357_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170722T074516_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T072819_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953651d-r-20181005T010736_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95202c1-z-20171023T001432_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 8.269 s worker CPU, 521.949 s worker Wall, Wall: 49.931 s, Cores in use: 0.22, Total efficiency (on 32 cores): 0.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181005T011423_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521352-g-20170801T073540_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:02:54.440183 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04925.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04798.fits Matched 8 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/reference-custom-353550p12289.fits Stage refs : Wall: 17.22 s, CPU: 3.78 s, VmPeak: 1043 MB, VmSize: 1030 MB, VmRSS: 199 MB, VmData: 231 MB, maxrss: 0.204092 MB Stage refs finished: 2020-08-05T19:03:11.658966 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a245-z-20140811T063131_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 17.221 s, Cores in use: 0.22, Total efficiency (on 32 cores): 0.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:03:11.891668 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outlier-mask-custom-353550p12289.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outliers-pre-custom-353550p12289.jpg Image c4d_170721_073122_ooi_g_ls9-S30 g : masking 548 positive outlier pixels and 0 negative outlier pixels Image c4d_170724_073950_ooi_r_ls9-S30 r : masking 54 positive outlier pixels and 0 negative outlier pixels Image c4d_181006_012849_ooi_r_ls9-S29 r : masking 366 positive outlier pixels and 248 negative outlier pixels Image c4d_140811_063436_ooi_z_ls9-N14 z : masking 857 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outlier-mask-custom-353550p12289.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outliers-post-custom-353550p12289.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outliers-masked-pos-custom-353550p12289.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/outliers-masked-neg-custom-353550p12289.jpg Stage outliers : Wall: 1.10 s, CPU: 0.69 s, VmPeak: 1043 MB, VmSize: 1025 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.207024 MB Stage outliers finished: 2020-08-05T19:03:12.993534 Resources for stage outliers : 1.066 s worker CPU, 1.428 s worker Wall, Wall: 1.104 s, Cores in use: 1.59, Total efficiency (on 32 cores): 5.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:03:13.241182 Stage halos : Wall: 4.02 s, CPU: 1.75 s, VmPeak: 1043 MB, VmSize: 1025 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.20724 MB Stage halos finished: 2020-08-05T19:03:17.261622 Resources for stage halos : 0.488 s worker CPU, 4.287 s worker Wall, Wall: 4.023 s, Cores in use: 0.56, Total efficiency (on 32 cores): 1.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:03:17.296175 PSF sigmas in coadd pixels: ['1.81', '2.65', '3.36', '2.30', '2.85'] Using average PSF sigma 2.5921726167911343 Gaussian PSF norm 0.10882561984744865 vs pixelized 0.08847724 average tim pixel scale / coadd scale: 1.0012054970516389 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.75', '2.90', '2.29', '2.22'] Using average PSF sigma 2.2905926387357085 Gaussian PSF norm 0.12315362714584653 vs pixelized 0.104251035 average tim pixel scale / coadd scale: 1.0012166842530332 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.62', '2.49', '1.69', '1.81', '2.07'] Using average PSF sigma 1.9351461221639525 Gaussian PSF norm 0.14577441390236168 vs pixelized 0.12531433 average tim pixel scale / coadd scale: 1.0011420329279117 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.19 s, VmPeak: 1043 MB, VmSize: 1025 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.208832 MB Stage fit_on_coadds finished: 2020-08-05T19:03:17.539160 Resources for stage fit_on_coadds : 0.183 s worker CPU, 0.184 s worker Wall, Wall: 0.245 s, Cores in use: 1.52, Total efficiency (on 32 cores): 4.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:03:17.550603 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 18 potential peaks Of 18 potential peaks: 1 in veto map, 2 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 16 potential peaks Of 16 potential peaks: 13 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 14 potential peaks Of 14 potential peaks: 11 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 22 potential peaks Of 22 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 26 potential peaks Of 26 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 23 new sources Median coadd sky for g : -6.1121464e-05 Median coadd sky for r : -0.0001272253 Median coadd sky for z : -8.409517e-05 Stage srcs : Wall: 0.53 s, CPU: 0.50 s, VmPeak: 1043 MB, VmSize: 1025 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.209224 MB Stage srcs finished: 2020-08-05T19:03:18.076224 Resources for stage srcs : 0.063 s worker CPU, 0.063 s worker Wall, Wall: 0.528 s, Cores in use: 1.07, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:03:18.088575 Blob 1 of 11, id: 5, sources: 6, size: 64x139, npix 5933, brick X: 87,151, Y: 53,192, one pixel: 125 53 Blob 2 of 11, id: 2, sources: 6, size: 45x99, npix 2433, brick X: 0,45, Y: 13,112, one pixel: 5 13 Blob 3 of 11, id: 9, sources: 4, size: 44x56, npix 1708, brick X: 137,181, Y: 177,233, one pixel: 169 177 Blob 4 of 11, id: 3, sources: 1, size: 45x45, npix 1447, brick X: 175,220, Y: 13,58, one pixel: 197 13 Blob 5 of 11, id: 1, sources: 2, size: 44x52, npix 1406, brick X: 80,124, Y: 5,57, one pixel: 92 5 Blob 6 of 11, id: 10, sources: 1, size: 28x28, npix 522, brick X: 4,32, Y: 198,226, one pixel: 18 198 Blob 7 of 11, id: 6, sources: 1, size: 21x21, npix 260, brick X: 165,186, Y: 80,101, one pixel: 175 80 Blob 8 of 11, id: 4, sources: 1, size: 21x20, npix 258, brick X: 125,146, Y: 18,38, one pixel: 134 18 Blob 9 of 11, id: 8, sources: 1, size: 21x20, npix 229, brick X: 63,84, Y: 170,190, one pixel: 72 170 Blob 10 of 11, id: 7, sources: 1, size: 20x19, npix 209, brick X: 28,48, Y: 107,126, one pixel: 36 107 Blob 11 of 11, id: 0, sources: 1, size: 21x15, npix 204, brick X: 13,34, Y: 0,15, one pixel: 17 0 Blob 8 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148312 MB Blob 10 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 962 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148304 MB Blob 9 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149896 MB Blob 7 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147772 MB Blob 6 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115824 MB Blob 4 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 112 MB, VmData: 166 MB, maxrss: 0.114916 MB Blob 11 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147816 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 2.41 s, CPU: 2.41 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095064 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.94 s, CPU: 2.94 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148352 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 4.27 s, CPU: 4.27 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.116036 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.58364, ee1=0.660016, ee2=-0.125767 Blob 1 finished, total: Wall: 6.52 s, CPU: 6.52 s, VmPeak: 682 MB, VmSize: 677 MB, VmRSS: 103 MB, VmData: 148 MB, maxrss: 0.11004 MB Old catalog: 27 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/blobs-custom-353550p12289.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/metrics/cus/all-models-custom-353550p12289.fits Stage fitblobs : Wall: 13.68 s, CPU: 0.36 s, VmPeak: 1043 MB, VmSize: 1025 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.209388 MB Stage fitblobs finished: 2020-08-05T19:03:31.772088 Resources for stage fitblobs : 19.264 s worker CPU, 19.327 s worker Wall, Wall: 13.686 s, Cores in use: 1.43, Total efficiency (on 32 cores): 4.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:03:31.787402 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-resid.jpg Stage coadds : Wall: 3.34 s, CPU: 0.72 s, VmPeak: 1043 MB, VmSize: 1025 MB, VmRSS: 205 MB, VmData: 230 MB, maxrss: 0.20994 MB Stage coadds finished: 2020-08-05T19:03:35.125818 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 27.070 s worker CPU, 45.514 s worker Wall, Wall: 3.341 s, Cores in use: 8.32, Total efficiency (on 32 cores): 26.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:03:35.141981 Cut to 1 unWISE tiles Reading WISE tile 3538p121 band 1 Reading WISE tile 3538p121 band 4 Reading WISE tile 3538p121 band 3 Reading WISE tile 3538p121 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.191128 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 957 MB, VmSize: 810 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211444 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 957 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.2069 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 807 MB, VmSize: 807 MB, VmRSS: 147 MB, VmData: 179 MB, maxrss: 0.201668 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.39 s, CPU: 0.79 s, VmPeak: 1043 MB, VmSize: 1025 MB, VmRSS: 206 MB, VmData: 230 MB, maxrss: 0.210644 MB Stage wise_forced finished: 2020-08-05T19:03:37.528276 Resources for stage wise_forced : 3.626 s worker CPU, 4.675 s worker Wall, Wall: 2.389 s, Cores in use: 1.85, Total efficiency (on 32 cores): 5.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:03:37.543601 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/tractor-i/cus/tractor-custom-353550p12289.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/tractor/cus/tractor-custom-353550p12289.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/tractor/cus/brick-custom-353550p12289.sha256sum Stage writecat : Wall: 1.01 s, CPU: 0.64 s, VmPeak: 1158 MB, VmSize: 1030 MB, VmRSS: 208 MB, VmData: 230 MB, maxrss: 0.343648 MB Stage writecat finished: 2020-08-05T19:03:38.552589 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.011 s, Cores in use: 0.64, Total efficiency (on 32 cores): 2.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1406896/PGC1406896-largegalaxy-writecat.p All done: 60.036 s worker CPU, 597.433 s worker Wall, Wall: 94.113 s, Cores in use: 0.77, Total efficiency (on 32 cores): 2.4 % Finished galaxy PGC1406896 in 1.694 minutes. Started working on galaxy PGC1406896 at Mon Aug 10 07:29:26 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.5507350660776 12.289489348567404 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T07:29:27.620854 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '353.5507350660776', '12.289489348567404', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.5507350660776 12.289489348567404 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 353.5507350660776 12.289489348567404 Starting process 56405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 56406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 56407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 56408 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 56409 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0594 MB Starting process 56410 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 56411 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 56412 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T07:29:28.227704 Keeping 14 CCDs: c4d_170722_074539_ooi_r_ls9-N14 r expnum 660980 exptime 49.0 propid 2014B-0404 seeing 1.08 MJD 57956.322 object DECaLS_7844_r decam/CP/V4.8.2a/CP20170721/c4d_170722_074539_ooi_r_ls9.fits.fz c4d_180902_054007_ooi_z_ls9-N14 z expnum 767946 exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 58363.236 object DECaLS_7844_z decam/CP/V4.8.2a/CP20180901/c4d_180902_054007_ooi_z_ls9.fits.fz c4d_170722_074752_ooi_g_ls9-N14 g expnum 660981 exptime 104.0 propid 2014B-0404 seeing 1.11 MJD 57956.323 object DECaLS_7844_g decam/CP/V4.8.2a/CP20170721/c4d_170722_074752_ooi_g_ls9.fits.fz c4d_140811_063436_ooi_z_ls9-N14 z expnum 346734 exptime 132.0 propid 2014B-0404 seeing 1.53 MJD 56880.272 object DECaLS_7844_z decam/CP/V4.8.2a/CP20140810/c4d_140811_063436_ooi_z_ls9.fits.fz c4d_170721_073122_ooi_g_ls9-S30 g expnum 660507 exptime 131.0 propid 2014B-0404 seeing 1.63 MJD 57955.311 object DECaLS_23737_g decam/CP/V4.8.2/CP20170720/c4d_170721_073122_ooi_g_ls9.fits.fz c4d_170724_073950_ooi_r_ls9-S30 r expnum 661628 exptime 89.0 propid 2014B-0404 seeing 1.79 MJD 57958.318 object DECaLS_23737_r decam/CP/V4.8.2a/CP20170723/c4d_170724_073950_ooi_r_ls9.fits.fz c4d_171023_001432_ooi_z_ls9-N24 z expnum 689987 exptime 250.0 propid 2014B-0404 seeing 1.04 MJD 58049.010 object DECaLS_39587_z decam/CP/V4.8.2a/CP20171022/c4d_171023_001432_ooi_z_ls9.fits.fz c4d_181016_020412_ooi_z_ls9-N24 z expnum 783853 exptime 110.0 propid 2014B-0404 seeing 1.12 MJD 58407.086 object DECaLS_39587_z decam/CP/V4.8.2a/CP20181015/c4d_181016_020412_ooi_z_ls9.fits.fz c4d_181005_010736_ooi_r_ls9-N24 r expnum 780623 exptime 175.0 propid 2014B-0404 seeing 1.41 MJD 58396.047 object DECaLS_39587_r decam/CP/V4.8.2a/CP20181004/c4d_181005_010736_ooi_r_ls9.fits.fz c4d_170801_073954_ooi_g_ls9-N24 g expnum 663759 exptime 200.0 propid 2014B-0404 seeing 2.07 MJD 57966.316 object DECaLS_39587_g decam/CP/V4.8.2a/CP20170731/c4d_170801_073954_ooi_g_ls9.fits.fz c4d_181006_012606_ooi_g_ls9-N24 g expnum 780949 exptime 126.0 propid 2014B-0404 seeing 1.41 MJD 58397.060 object DECaLS_39587_g decam/CP/V4.8.2a/CP20181005/c4d_181006_012606_ooi_g_ls9.fits.fz c4d_180901_075127_ooi_z_ls9-S29 z expnum 767621 exptime 80.0 propid 2014B-0404 seeing 1.27 MJD 58362.327 object DECaLS_39609_z decam/CP/V4.8.2a/CP20180831/c4d_180901_075127_ooi_z_ls9.fits.fz c4d_181005_011423_ooi_g_ls9-S29 g expnum 780625 exptime 200.0 propid 2014B-0404 seeing 1.75 MJD 58396.052 object DECaLS_39609_g decam/CP/V4.8.2a/CP20181004/c4d_181005_011423_ooi_g_ls9.fits.fz c4d_181006_012849_ooi_r_ls9-S29 r expnum 780950 exptime 60.0 propid 2014B-0404 seeing 1.37 MJD 58397.062 object DECaLS_39609_r decam/CP/V4.8.2a/CP20181005/c4d_181006_012849_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T073726_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e8b1-r-20170722T074357_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95202c1-z-20171023T001432_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180902T054007_oi[N14,noinherit][2046,4094][real]: DECaLS_7844 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95316b1-z-20181016T020412_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a245-z-20140811T063131_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170722T074516_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T072819_oi[S30,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953704b-g-20181006T012606_oi[N24,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T075127_oi[S29,noinherit][2046,4094][real]: DECaLS_3960 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521352-g-20170801T073540_oi[N24,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953651d-r-20181005T010736_oi[N24,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181005T011423_oi[S29,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536893-r-20181006T012849_oi[S29,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 86.43 s, CPU: 0.93 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 179 MB, VmData: 213 MB, maxrss: 0.183332 MB Stage tims finished: 2020-08-10T07:30:54.657612 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95202c1-z-20171023T001432_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T072819_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180902T054007_oi[N14,noinherit][2046,4094][real]: DECaLS_7844 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521352-g-20170801T073540_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a245-z-20140811T063131_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953704b-g-20181006T012606_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170722T074516_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T075127_oi[S29,noinherit][2046,4094][real]: DECaLS_3960 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e8b1-r-20170722T074357_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181005T011423_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95316b1-z-20181016T020412_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953651d-r-20181005T010736_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T073726_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536893-r-20181006T012849_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 6.455 s worker CPU, 570.303 s worker Wall, Wall: 86.431 s, Cores in use: 0.09, Total efficiency (on 8 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-10T07:30:55.660901 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04925.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04798.fits Matched 8 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/metrics/cus/reference-custom-353550p12289.fits Stage refs : Wall: 11.34 s, CPU: 1.80 s, VmPeak: 1036 MB, VmSize: 1023 MB, VmRSS: 198 MB, VmData: 230 MB, maxrss: 0.202648 MB Stage refs finished: 2020-08-10T07:31:07.002002 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.342 s, Cores in use: 0.16, Total efficiency (on 8 cores): 2.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T07:31:07.032554 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/metrics/cus/outlier-mask-custom-353550p12289.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/metrics/cus/outliers-pre-custom-353550p12289.jpg Image c4d_170721_073122_ooi_g_ls9-S30 g : masking 547 positive outlier pixels and 0 negative outlier pixels Image c4d_181006_012849_ooi_r_ls9-S29 r : masking 348 positive outlier pixels and 227 negative outlier pixels Image c4d_140811_063436_ooi_z_ls9-N14 z : masking 861 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/metrics/cus/outlier-mask-custom-353550p12289.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/metrics/cus/outliers-post-custom-353550p12289.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/metrics/cus/outliers-masked-pos-custom-353550p12289.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/metrics/cus/outliers-masked-neg-custom-353550p12289.jpg Stage outliers : Wall: 0.87 s, CPU: 0.69 s, VmPeak: 1036 MB, VmSize: 1023 MB, VmRSS: 204 MB, VmData: 233 MB, maxrss: 0.21692 MB Stage outliers finished: 2020-08-10T07:31:07.900973 Resources for stage outliers : 0.984 s worker CPU, 0.986 s worker Wall, Wall: 0.869 s, Cores in use: 1.93, Total efficiency (on 8 cores): 24.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T07:31:08.033351 Stage halos : Wall: 3.07 s, CPU: 0.25 s, VmPeak: 1036 MB, VmSize: 1023 MB, VmRSS: 204 MB, VmData: 233 MB, maxrss: 0.21692 MB Stage halos finished: 2020-08-10T07:31:11.106597 Resources for stage halos : 0.391 s worker CPU, 3.480 s worker Wall, Wall: 3.075 s, Cores in use: 0.21, Total efficiency (on 8 cores): 2.6 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T07:31:12.070837 PSF sigmas in coadd pixels: ['1.81', '2.65', '3.36', '2.30', '2.85'] Using average PSF sigma 2.5921726167911343 Gaussian PSF norm 0.10882561984744865 vs pixelized 0.08847751 average tim pixel scale / coadd scale: 1.0012054970516389 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.75', '2.90', '2.29', '2.22'] Using average PSF sigma 2.2905926387357085 Gaussian PSF norm 0.12315362714584653 vs pixelized 0.104249984 average tim pixel scale / coadd scale: 1.0012166842530332 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.62', '2.49', '1.69', '1.81', '2.07'] Using average PSF sigma 1.9351461221639525 Gaussian PSF norm 0.14577441390236168 vs pixelized 0.12531446 average tim pixel scale / coadd scale: 1.0011420329279117 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.20 s, VmPeak: 1036 MB, VmSize: 1023 MB, VmRSS: 206 MB, VmData: 233 MB, maxrss: 0.21692 MB Stage fit_on_coadds finished: 2020-08-10T07:31:12.296633 Resources for stage fit_on_coadds : 0.265 s worker CPU, 0.265 s worker Wall, Wall: 0.227 s, Cores in use: 2.06, Total efficiency (on 8 cores): 25.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T07:31:12.347265 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 18 potential peaks Of 18 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 14 kept SED z : 14 new peaks Found 16 potential peaks Of 16 potential peaks: 13 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 13 potential peaks Of 13 potential peaks: 11 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 21 potential peaks Of 21 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 25 potential peaks Of 25 potential peaks: 21 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 21 new sources Median coadd sky for g : -4.4097043e-05 Median coadd sky for r : -0.00010271495 Median coadd sky for z : -4.853734e-05 Stage srcs : Wall: 0.49 s, CPU: 0.46 s, VmPeak: 1036 MB, VmSize: 1023 MB, VmRSS: 206 MB, VmData: 233 MB, maxrss: 0.21692 MB Stage srcs finished: 2020-08-10T07:31:12.838685 Resources for stage srcs : 0.060 s worker CPU, 0.060 s worker Wall, Wall: 0.492 s, Cores in use: 1.06, Total efficiency (on 8 cores): 13.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T07:31:12.850812 Blob 1 of 10, id: 4, sources: 5, size: 64x140, npix 5920, brick X: 85,149, Y: 51,191, one pixel: 124 51 Blob 2 of 10, id: 1, sources: 6, size: 43x99, npix 2252, brick X: 0,43, Y: 12,111, one pixel: 4 12 Blob 3 of 10, id: 8, sources: 4, size: 45x57, npix 1773, brick X: 134,179, Y: 176,233, one pixel: 167 176 Blob 4 of 10, id: 2, sources: 1, size: 45x45, npix 1454, brick X: 173,218, Y: 12,57, one pixel: 193 12 Blob 5 of 10, id: 0, sources: 2, size: 44x52, npix 1407, brick X: 78,122, Y: 4,56, one pixel: 89 4 Blob 6 of 10, id: 9, sources: 1, size: 28x28, npix 522, brick X: 2,30, Y: 197,225, one pixel: 15 197 Blob 7 of 10, id: 5, sources: 1, size: 21x21, npix 261, brick X: 163,184, Y: 79,100, one pixel: 172 79 Blob 8 of 10, id: 3, sources: 1, size: 22x20, npix 259, brick X: 122,144, Y: 17,37, one pixel: 131 17 Blob 9 of 10, id: 7, sources: 1, size: 20x19, npix 236, brick X: 61,81, Y: 169,188, one pixel: 69 169 Blob 8 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146344 MB Blob 10 of 10, id: 6, sources: 1, size: 19x19, npix 208, brick X: 26,45, Y: 106,125, one pixel: 34 106 Blob 9 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146344 MB Blob 10 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146344 MB Blob 7 finished, total: Wall: 0.60 s, CPU: 0.59 s, VmPeak: 967 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146616 MB Blob 6 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 969 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14548 MB Blob 4 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 969 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147692 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 5 finished, total: Wall: 2.85 s, CPU: 2.84 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148292 MB Blob 3 finished, total: Wall: 3.27 s, CPU: 3.26 s, VmPeak: 962 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146564 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 4.56 s, CPU: 4.55 s, VmPeak: 969 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14836 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.31336, ee1=0.56242, ee2=-0.107972 Blob 1 finished, total: Wall: 4.94 s, CPU: 4.92 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149492 MB Old catalog: 25 New catalog: 22 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/metrics/cus/blobs-custom-353550p12289.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/metrics/cus/all-models-custom-353550p12289.fits Stage fitblobs : Wall: 5.65 s, CPU: 0.63 s, VmPeak: 1036 MB, VmSize: 1023 MB, VmRSS: 206 MB, VmData: 233 MB, maxrss: 0.21692 MB Stage fitblobs finished: 2020-08-10T07:31:18.497637 Resources for stage fitblobs : 18.529 s worker CPU, 18.806 s worker Wall, Wall: 5.648 s, Cores in use: 3.39, Total efficiency (on 8 cores): 42.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T07:31:18.510175 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-resid.jpg Stage coadds : Wall: 1.70 s, CPU: 0.82 s, VmPeak: 1036 MB, VmSize: 1023 MB, VmRSS: 207 MB, VmData: 233 MB, maxrss: 0.21692 MB Stage coadds finished: 2020-08-10T07:31:20.214485 Resources for stage coadds : 3.740 s worker CPU, 4.723 s worker Wall, Wall: 1.705 s, Cores in use: 2.67, Total efficiency (on 8 cores): 33.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T07:31:20.227295 Cut to 1 unWISE tiles Reading WISE tile 3538p121 band 2 Reading WISE tile 3538p121 band 1 Reading WISE tile 3538p121 band 3 Reading WISE tile 3538p121 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 939 MB, VmSize: 805 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.191656 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 969 MB, VmSize: 803 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.20952 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 968 MB, VmSize: 865 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.212624 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p121/unwise-3538p121-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 969 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.207892 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/tmp-legacysurvey-custom-353550p12289-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.42 s, CPU: 0.70 s, VmPeak: 1036 MB, VmSize: 1023 MB, VmRSS: 207 MB, VmData: 233 MB, maxrss: 0.21692 MB Stage wise_forced finished: 2020-08-10T07:31:22.646615 Resources for stage wise_forced : 3.262 s worker CPU, 4.934 s worker Wall, Wall: 2.420 s, Cores in use: 1.64, Total efficiency (on 8 cores): 20.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T07:31:22.679189 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/coadd/cus/custom-353550p12289/legacysurvey-custom-353550p12289-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/tractor-i/cus/tractor-custom-353550p12289.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/tractor/cus/tractor-custom-353550p12289.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/tractor/cus/brick-custom-353550p12289.sha256sum Stage writecat : Wall: 0.73 s, CPU: 0.52 s, VmPeak: 1156 MB, VmSize: 1028 MB, VmRSS: 209 MB, VmData: 233 MB, maxrss: 0.345416 MB Stage writecat finished: 2020-08-10T07:31:23.405204 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.727 s, Cores in use: 0.72, Total efficiency (on 8 cores): 9.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1406896/PGC1406896-largegalaxy-writecat.p All done: 33.686 s worker CPU, 603.558 s worker Wall, Wall: 115.192 s, Cores in use: 0.35, Total efficiency (on 8 cores): 4.4 % Finished galaxy PGC1406896 in 1.954 minutes.