Started working on galaxy PGC1400724 at Wed Aug 5 19:43:17 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.1803035 11.911086099999999 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:43:19.895097 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.1803035', '11.911086099999999', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.1803035 11.911086099999999 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.1803035 11.911086099999999 Starting process 19162 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 19163 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 19164 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 19165 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 19166 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 19167 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 19168 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 19169 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 19170 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 19171 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 19172 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19173 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19174 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19175 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19176 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19177 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:43:20.607653 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 15 CCDs: c4d_160812_053816_ooi_z_ls9-S7 z expnum 563173 exptime 80.0 propid 2014B-0404 seeing 0.98 MJD 57612.233 object DECaLS_7859_z decam/CP/V4.8.2a/CP20160811/c4d_160812_053816_ooi_z_ls9.fits.fz c4d_170726_060416_ooi_g_ls9-S7 g expnum 662316 exptime 134.0 propid 2014B-0404 seeing 1.21 MJD 57960.251 object DECaLS_7859_g decam/CP/V4.8.2a/CP20170725/c4d_170726_060416_ooi_g_ls9.fits.fz c4d_170820_045557_ooi_r_ls9-S7 r expnum 669471 exptime 89.0 propid 2014B-0404 seeing 1.45 MJD 57985.206 object DECaLS_7859_r decam/CP/V4.8.2a/CP20170819/c4d_170820_045557_ooi_r_ls9.fits.fz c4d_170726_060416_ooi_g_ls9-N7 g expnum 662316 exptime 134.0 propid 2014B-0404 seeing 1.25 MJD 57960.251 object DECaLS_7859_g decam/CP/V4.8.2a/CP20170725/c4d_170726_060416_ooi_g_ls9.fits.fz c4d_170820_045557_ooi_r_ls9-N7 r expnum 669471 exptime 89.0 propid 2014B-0404 seeing 1.47 MJD 57985.206 object DECaLS_7859_r decam/CP/V4.8.2a/CP20170819/c4d_170820_045557_ooi_r_ls9.fits.fz c4d_170725_070230_ooi_r_ls9-N6 r expnum 661968 exptime 57.0 propid 2014B-0404 seeing 1.18 MJD 57959.292 object DECaLS_23731_r decam/CP/V4.8.2a/CP20170724/c4d_170725_070230_ooi_r_ls9.fits.fz c4d_170730_055547_ooi_g_ls9-N6 g expnum 663312 exptime 111.0 propid 2014B-0404 seeing 1.11 MJD 57964.245 object DECaLS_23731_g decam/CP/V4.8.2a/CP20170729/c4d_170730_055547_ooi_g_ls9.fits.fz c4d_160813_053103_ooi_z_ls9-N6 z expnum 563577 exptime 93.0 propid 2014B-0404 seeing 0.84 MJD 57613.228 object DECaLS_23731_z decam/CP/V4.8.2a/CP20160812/c4d_160813_053103_ooi_z_ls9.fits.fz c4d_170822_044759_ooi_g_ls9-S1 g expnum 670359 exptime 120.0 propid 2014B-0404 seeing 1.10 MJD 57987.200 object DECaLS_7860_g decam/CP/V4.8.2a/CP20170821/c4d_170822_044759_ooi_g_ls9.fits.fz c4d_180725_061048_ooi_z_ls9-S1 z expnum 758860 exptime 136.0 propid 2014B-0404 seeing 1.44 MJD 58324.258 object DECaLS_7860_z decam/CP/V4.8.2a/CP20180724/c4d_180725_061048_ooi_z_ls9.fits.fz c4d_160815_044236_ooi_z_ls9-S1 z expnum 564479 exptime 120.0 propid 2014B-0404 seeing 1.48 MJD 57615.194 object DECaLS_7860_z decam/CP/V4.8.2a/CP20160814/c4d_160815_044236_ooi_z_ls9.fits.fz c4d_170917_031723_ooi_r_ls9-S1 r expnum 678334 exptime 58.0 propid 2014B-0404 seeing 0.99 MJD 58013.137 object DECaLS_7860_r decam/CP/V4.8.2a/CP20170916/c4d_170917_031723_ooi_r_ls9.fits.fz c4d_171111_002107_ooi_z_ls9-N5 z expnum 694889 exptime 120.0 propid 2014B-0404 seeing 0.94 MJD 58068.015 object DECaLS_39603_z decam/CP/V4.8.2a/CP20171110/c4d_171111_002107_ooi_z_ls9.fits.fz c4d_170721_061834_ooi_r_ls9-N5 r expnum 660477 exptime 49.0 propid 2014B-0404 seeing 1.23 MJD 57955.262 object DECaLS_39603_r decam/CP/V4.8.2/CP20170720/c4d_170721_061834_ooi_r_ls9.fits.fz c4d_170728_061216_ooi_g_ls9-N5 g expnum 662882 exptime 200.0 propid 2014B-0404 seeing 1.01 MJD 57962.256 object DECaLS_39603_g decam/CP/V4.8.2a/CP20170727/c4d_170728_061216_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T061048_oi[S1,noinherit][2046,4094][real]: DECaLS_7 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T060110_oi[N7,noinherit][2046,4094][real]: DECaLS_7 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170820T045557_oi[N7,noinherit][2046,4094][real]: DECaLS_7 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170730T055303_oi[N6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T052834_oi[N6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521fe5-z-20171111T002107_oi[N5,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95478a4-z-20160815T043945_oi[S1,noinherit][2046,4094][real]: DECaLS_7 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522b69-g-20170822T044759_oi[S1,noinherit][2046,4094][real]: DECaLS_7 Clipping 1 pixels with anomalously large oow values: max 0.0025644 vs median 0.00156429 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170725T070041_oi[N6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T060805_oi[N5,noinherit][2046,4094][real]: DECaLS_3 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T031723_oi[S1,noinherit][2046,4094][real]: DECaLS_7 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951cf8e-r-20170721T061654_oi[N5,noinherit][2046,4094][real]: DECaLS_3 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 60.45 s, CPU: 1.04 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 178 MB, VmData: 210 MB, maxrss: 0.182528 MB Stage tims finished: 2020-08-05T19:44:21.062089 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T060110_oi[N7,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T061048_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T052834_oi[N6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521fe5-z-20171111T002107_oi[N5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95478a4-z-20160815T043945_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522b69-g-20170822T044759_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T060805_oi[N5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951cf8e-r-20170721T061654_oi[N5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 8.692 s worker CPU, 321.319 s worker Wall, Wall: 60.456 s, Cores in use: 0.16, Total efficiency (on 16 cores): 1.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170820T045557_oi[N7,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170725T070041_oi[N6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:44:21.088232 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04794.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04921.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05050.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04922.fits Matched 11 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/reference-custom-343180p11911.fits Stage refs : Wall: 9.53 s, CPU: 2.19 s, VmPeak: 1042 MB, VmSize: 1033 MB, VmRSS: 200 MB, VmData: 231 MB, maxrss: 0.205268 MB Stage refs finished: 2020-08-05T19:44:30.619927 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170730T055303_oi[N6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T031723_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.533 s, Cores in use: 0.23, Total efficiency (on 16 cores): 1.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:44:30.894997 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outlier-mask-custom-343180p11911.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outliers-pre-custom-343180p11911.jpg Image c4d_170730_055547_ooi_g_ls9-N6 g : masking 2405 positive outlier pixels and 0 negative outlier pixels Image c4d_160815_044236_ooi_z_ls9-S1 z : masking 64 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outlier-mask-custom-343180p11911.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outliers-post-custom-343180p11911.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outliers-masked-pos-custom-343180p11911.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outliers-masked-neg-custom-343180p11911.jpg Stage outliers : Wall: 1.32 s, CPU: 0.96 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.21908 MB Stage outliers finished: 2020-08-05T19:44:32.219532 Resources for stage outliers : 0.637 s worker CPU, 0.848 s worker Wall, Wall: 1.326 s, Cores in use: 1.21, Total efficiency (on 16 cores): 7.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:44:32.280155 Stage halos : Wall: 1.76 s, CPU: 1.51 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.219376 MB Stage halos finished: 2020-08-05T19:44:34.035968 Resources for stage halos : 0.469 s worker CPU, 1.668 s worker Wall, Wall: 1.757 s, Cores in use: 1.13, Total efficiency (on 16 cores): 7.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:44:34.156247 PSF sigmas in coadd pixels: ['1.81', '1.79', '1.64'] Using average PSF sigma 1.747639802427953 Gaussian PSF norm 0.1614147213756352 vs pixelized 0.14308918 average tim pixel scale / coadd scale: 1.001200904867093 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.39', '1.92', '1.61', '1.99'] Using average PSF sigma 1.9778620556127755 Gaussian PSF norm 0.1426261204482637 vs pixelized 0.11820109 average tim pixel scale / coadd scale: 1.0012038624605504 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.36', '2.33', '2.40', '1.52'] Using average PSF sigma 1.9060284223788517 Gaussian PSF norm 0.14800135636057563 vs pixelized 0.11989471 average tim pixel scale / coadd scale: 1.0011204583250441 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.14 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.220968 MB Stage fit_on_coadds finished: 2020-08-05T19:44:34.328443 Resources for stage fit_on_coadds : 0.181 s worker CPU, 0.181 s worker Wall, Wall: 0.174 s, Cores in use: 1.88, Total efficiency (on 16 cores): 11.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:44:34.341086 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 28 potential peaks Of 28 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 14 kept SED z : 14 new peaks Found 27 potential peaks Of 27 potential peaks: 21 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 37 potential peaks Of 37 potential peaks: 27 in veto map, 6 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 51 potential peaks Of 51 potential peaks: 40 in veto map, 6 cut by saddle test, 1 cut by aper test, 4 kept SED Flat : 4 new peaks Found 52 potential peaks Of 52 potential peaks: 47 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 25 new sources Median coadd sky for g : 0.00013703911 Median coadd sky for r : 0.0003948029 Median coadd sky for z : 0.00080880953 Stage srcs : Wall: 0.99 s, CPU: 0.95 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.221372 MB Stage srcs finished: 2020-08-05T19:44:35.329759 Resources for stage srcs : 0.061 s worker CPU, 0.061 s worker Wall, Wall: 0.990 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:44:35.340338 Blob 1 of 15, id: 6, sources: 10, size: 190x149, npix 17380, brick X: 7,197, Y: 51,200, one pixel: 125 51 Blob 2 of 15, id: 0, sources: 2, size: 39x41, npix 924, brick X: 120,159, Y: 0,41, one pixel: 137 0 Blob 3 of 15, id: 11, sources: 1, size: 35x33, npix 800, brick X: 190,225, Y: 191,224, one pixel: 203 191 Blob 4 of 15, id: 12, sources: 2, size: 38x43, npix 767, brick X: 150,188, Y: 192,235, one pixel: 173 192 Blob 5 of 15, id: 5, sources: 1, size: 32x33, npix 678, brick X: 189,221, Y: 37,70, one pixel: 204 37 Blob 6 of 15, id: 13, sources: 1, size: 26x28, npix 454, brick X: 53,79, Y: 196,224, one pixel: 63 196 Blob 7 of 15, id: 1, sources: 1, size: 25x26, npix 412, brick X: 196,221, Y: 8,34, one pixel: 205 8 Blob 8 of 15, id: 7, sources: 1, size: 26x24, npix 406, brick X: 203,229, Y: 85,109, one pixel: 215 85 Blob 9 of 15, id: 2, sources: 1, size: 21x22, npix 280, brick X: 6,27, Y: 16,38, one pixel: 14 16 Blob 10 of 15, id: 8, sources: 1, size: 16x23, npix 261, brick X: 0,16, Y: 102,125, one pixel: 5 102 Blob 11 of 15, id: 10, sources: 1, size: 15x22, npix 236, brick X: 0,15, Y: 146,168, one pixel: 3 146 Blob 12 of 15, id: 3, sources: 1, size: 21x19, npix 228, brick X: 164,185, Y: 24,43, one pixel: 173 24 Blob 13 of 15, id: 4, sources: 1, size: 16x20, npix 199, brick X: 0,16, Y: 36,56, one pixel: 5 36 Blob 14 of 15, id: 9, sources: 1, size: 19x19, npix 199, brick X: 186,205, Y: 137,156, one pixel: 194 137 Blob 15 of 15, id: 14, sources: 1, size: 21x13, npix 181, brick X: 125,146, Y: 226,239, one pixel: 134 226 Blob 12 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147056 MB Blob 15 finished, total: Wall: 0.12 s, CPU: 0.12 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150044 MB Blob 13 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147392 MB Blob 9 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 940 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149184 MB Blob 14 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149964 MB Blob 8 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 704 MB, VmSize: 704 MB, VmRSS: 131 MB, VmData: 173 MB, maxrss: 0.13438 MB Blob 7 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 707 MB, VmSize: 707 MB, VmRSS: 134 MB, VmData: 176 MB, maxrss: 0.137632 MB Blob 11 finished, total: Wall: 0.80 s, CPU: 0.79 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114664 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148136 MB Blob 10 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 960 MB, VmSize: 737 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155672 MB Blob 6 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 940 MB, VmSize: 721 MB, VmRSS: 139 MB, VmData: 179 MB, maxrss: 0.142684 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148084 MB Blob 5 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150612 MB Blob 2 finished, total: Wall: 1.80 s, CPU: 1.80 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148876 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.32768, ee1=0.147928, ee2=0.0430198 Measuring 7 iterative sources Blob 1 finished, total: Wall: 12.76 s, CPU: 12.76 s, VmPeak: 707 MB, VmSize: 707 MB, VmRSS: 138 MB, VmData: 175 MB, maxrss: 0.14112 MB Old catalog: 31 New catalog: 32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/blobs-custom-343180p11911.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/all-models-custom-343180p11911.fits Stage fitblobs : Wall: 13.18 s, CPU: 0.38 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.221544 MB Stage fitblobs finished: 2020-08-05T19:44:48.523470 Resources for stage fitblobs : 23.817 s worker CPU, 23.891 s worker Wall, Wall: 13.185 s, Cores in use: 1.84, Total efficiency (on 16 cores): 11.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:44:48.546336 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-resid.jpg Stage coadds : Wall: 4.61 s, CPU: 1.99 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 217 MB, VmData: 242 MB, maxrss: 0.22206 MB Stage coadds finished: 2020-08-05T19:44:53.154282 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.986 s worker CPU, 14.433 s worker Wall, Wall: 4.609 s, Cores in use: 2.38, Total efficiency (on 16 cores): 14.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:44:53.175908 Cut to 1 unWISE tiles Reading WISE tile 3430p121 band 2 Reading WISE tile 3430p121 band 1 Reading WISE tile 3430p121 band 4 Reading WISE tile 3430p121 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 809 MB, VmRSS: 150 MB, VmData: 174 MB, maxrss: 0.21386 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211436 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 955 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.197816 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206816 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.06 s, CPU: 1.41 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 218 MB, VmData: 242 MB, maxrss: 0.222764 MB Stage wise_forced finished: 2020-08-05T19:44:57.238892 Resources for stage wise_forced : 3.265 s worker CPU, 9.059 s worker Wall, Wall: 4.064 s, Cores in use: 1.15, Total efficiency (on 16 cores): 7.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:44:57.258256 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/tractor-i/cus/tractor-custom-343180p11911.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/tractor/cus/tractor-custom-343180p11911.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/tractor/cus/brick-custom-343180p11911.sha256sum Stage writecat : Wall: 2.92 s, CPU: 1.41 s, VmPeak: 1175 MB, VmSize: 1047 MB, VmRSS: 219 MB, VmData: 242 MB, maxrss: 0.355768 MB Stage writecat finished: 2020-08-05T19:45:00.175058 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.919 s, Cores in use: 0.48, Total efficiency (on 16 cores): 3.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-writecat.p All done: 46.112 s worker CPU, 371.464 s worker Wall, Wall: 99.596 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.7 % Finished galaxy PGC1400724 in 1.715 minutes. Started working on galaxy PGC1400724 at Wed Aug 5 19:48:41 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.1803035 11.911086099999999 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:48:43.364737 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.1803035', '11.911086099999999', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.1803035 11.911086099999999 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.1803035 11.911086099999999 Starting process 20472 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 20473 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 20474 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 20475 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 20476 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB Starting process 20477 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 20478 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 20480 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 20481 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 20483 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 20484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 20485 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 20486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 20487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20489 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20490 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 20491 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 20492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 20493 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 20494 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 20495 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 20496 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 20497 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 20498 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 20499 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 20500 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 20501 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 20502 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 20503 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 20504 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 20505 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:48:45.068747 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 15 CCDs: c4d_160812_053816_ooi_z_ls9-S7 z expnum 563173 exptime 80.0 propid 2014B-0404 seeing 0.98 MJD 57612.233 object DECaLS_7859_z decam/CP/V4.8.2a/CP20160811/c4d_160812_053816_ooi_z_ls9.fits.fz c4d_170726_060416_ooi_g_ls9-S7 g expnum 662316 exptime 134.0 propid 2014B-0404 seeing 1.21 MJD 57960.251 object DECaLS_7859_g decam/CP/V4.8.2a/CP20170725/c4d_170726_060416_ooi_g_ls9.fits.fz c4d_170820_045557_ooi_r_ls9-S7 r expnum 669471 exptime 89.0 propid 2014B-0404 seeing 1.45 MJD 57985.206 object DECaLS_7859_r decam/CP/V4.8.2a/CP20170819/c4d_170820_045557_ooi_r_ls9.fits.fz c4d_170726_060416_ooi_g_ls9-N7 g expnum 662316 exptime 134.0 propid 2014B-0404 seeing 1.25 MJD 57960.251 object DECaLS_7859_g decam/CP/V4.8.2a/CP20170725/c4d_170726_060416_ooi_g_ls9.fits.fz c4d_170820_045557_ooi_r_ls9-N7 r expnum 669471 exptime 89.0 propid 2014B-0404 seeing 1.47 MJD 57985.206 object DECaLS_7859_r decam/CP/V4.8.2a/CP20170819/c4d_170820_045557_ooi_r_ls9.fits.fz c4d_170725_070230_ooi_r_ls9-N6 r expnum 661968 exptime 57.0 propid 2014B-0404 seeing 1.18 MJD 57959.292 object DECaLS_23731_r decam/CP/V4.8.2a/CP20170724/c4d_170725_070230_ooi_r_ls9.fits.fz c4d_170730_055547_ooi_g_ls9-N6 g expnum 663312 exptime 111.0 propid 2014B-0404 seeing 1.11 MJD 57964.245 object DECaLS_23731_g decam/CP/V4.8.2a/CP20170729/c4d_170730_055547_ooi_g_ls9.fits.fz c4d_160813_053103_ooi_z_ls9-N6 z expnum 563577 exptime 93.0 propid 2014B-0404 seeing 0.84 MJD 57613.228 object DECaLS_23731_z decam/CP/V4.8.2a/CP20160812/c4d_160813_053103_ooi_z_ls9.fits.fz c4d_170822_044759_ooi_g_ls9-S1 g expnum 670359 exptime 120.0 propid 2014B-0404 seeing 1.10 MJD 57987.200 object DECaLS_7860_g decam/CP/V4.8.2a/CP20170821/c4d_170822_044759_ooi_g_ls9.fits.fz c4d_180725_061048_ooi_z_ls9-S1 z expnum 758860 exptime 136.0 propid 2014B-0404 seeing 1.44 MJD 58324.258 object DECaLS_7860_z decam/CP/V4.8.2a/CP20180724/c4d_180725_061048_ooi_z_ls9.fits.fz c4d_160815_044236_ooi_z_ls9-S1 z expnum 564479 exptime 120.0 propid 2014B-0404 seeing 1.48 MJD 57615.194 object DECaLS_7860_z decam/CP/V4.8.2a/CP20160814/c4d_160815_044236_ooi_z_ls9.fits.fz c4d_170917_031723_ooi_r_ls9-S1 r expnum 678334 exptime 58.0 propid 2014B-0404 seeing 0.99 MJD 58013.137 object DECaLS_7860_r decam/CP/V4.8.2a/CP20170916/c4d_170917_031723_ooi_r_ls9.fits.fz c4d_171111_002107_ooi_z_ls9-N5 z expnum 694889 exptime 120.0 propid 2014B-0404 seeing 0.94 MJD 58068.015 object DECaLS_39603_z decam/CP/V4.8.2a/CP20171110/c4d_171111_002107_ooi_z_ls9.fits.fz c4d_170721_061834_ooi_r_ls9-N5 r expnum 660477 exptime 49.0 propid 2014B-0404 seeing 1.23 MJD 57955.262 object DECaLS_39603_r decam/CP/V4.8.2/CP20170720/c4d_170721_061834_ooi_r_ls9.fits.fz c4d_170728_061216_ooi_g_ls9-N5 g expnum 662882 exptime 200.0 propid 2014B-0404 seeing 1.01 MJD 57962.256 object DECaLS_39603_g decam/CP/V4.8.2a/CP20170727/c4d_170728_061216_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522b69-g-20170822T044759_oi[S1,noinherit][2046,4094][real]: DECaLS_7 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170820T045557_oi[N7,noinherit][2046,4094][real]: DECaLS_7 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521fe5-z-20171111T002107_oi[N5,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95478a4-z-20160815T043945_oi[S1,noinherit][2046,4094][real]: DECaLS_7 Clipping 1 pixels with anomalously large oow values: max 0.0025644 vs median 0.00156429 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170730T055303_oi[N6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170725T070041_oi[N6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T060110_oi[N7,noinherit][2046,4094][real]: DECaLS_7 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T060805_oi[N5,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T052834_oi[N6,noinherit][2046,4094][real]: DECaLS_2 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T061048_oi[S1,noinherit][2046,4094][real]: DECaLS_7 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T031723_oi[S1,noinherit][2046,4094][real]: DECaLS_7 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951cf8e-r-20170721T061654_oi[N5,noinherit][2046,4094][real]: DECaLS_3 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 42.83 s, CPU: 1.54 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 178 MB, VmData: 210 MB, maxrss: 0.18246 MB Stage tims finished: 2020-08-05T19:49:27.899411 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T060110_oi[N7,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522b69-g-20170822T044759_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521fe5-z-20171111T002107_oi[N5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95478a4-z-20160815T043945_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170725T070041_oi[N6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T061048_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T060805_oi[N5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T052834_oi[N6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T031723_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951cf8e-r-20170721T061654_oi[N5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 8.076 s worker CPU, 214.379 s worker Wall, Wall: 42.833 s, Cores in use: 0.22, Total efficiency (on 32 cores): 0.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170820T045557_oi[N7,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170730T055303_oi[N6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:49:27.928065 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04794.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04921.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05050.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04922.fits Matched 11 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/reference-custom-343180p11911.fits Stage refs : Wall: 6.39 s, CPU: 2.57 s, VmPeak: 1042 MB, VmSize: 1033 MB, VmRSS: 201 MB, VmData: 232 MB, maxrss: 0.20554 MB Stage refs finished: 2020-08-05T19:49:34.316089 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.390 s, Cores in use: 0.40, Total efficiency (on 32 cores): 1.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:49:34.491186 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outlier-mask-custom-343180p11911.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outliers-pre-custom-343180p11911.jpg Image c4d_170730_055547_ooi_g_ls9-N6 g : masking 2405 positive outlier pixels and 0 negative outlier pixels Image c4d_160815_044236_ooi_z_ls9-S1 z : masking 64 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outlier-mask-custom-343180p11911.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outliers-post-custom-343180p11911.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outliers-masked-pos-custom-343180p11911.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/outliers-masked-neg-custom-343180p11911.jpg Stage outliers : Wall: 1.43 s, CPU: 0.88 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.21896 MB Stage outliers finished: 2020-08-05T19:49:35.923177 Resources for stage outliers : 0.816 s worker CPU, 1.599 s worker Wall, Wall: 1.434 s, Cores in use: 1.18, Total efficiency (on 32 cores): 3.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:49:35.950560 Stage halos : Wall: 0.67 s, CPU: 0.32 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.219264 MB Stage halos finished: 2020-08-05T19:49:36.615706 Resources for stage halos : 0.434 s worker CPU, 1.622 s worker Wall, Wall: 0.668 s, Cores in use: 1.13, Total efficiency (on 32 cores): 3.5 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:49:36.648412 PSF sigmas in coadd pixels: ['1.81', '1.79', '1.64'] Using average PSF sigma 1.747639802427953 Gaussian PSF norm 0.1614147213756352 vs pixelized 0.14308918 average tim pixel scale / coadd scale: 1.001200904867093 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.39', '1.92', '1.61', '1.99'] Using average PSF sigma 1.9778620556127755 Gaussian PSF norm 0.1426261204482637 vs pixelized 0.11820109 average tim pixel scale / coadd scale: 1.0012038624605504 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.36', '2.33', '2.40', '1.52'] Using average PSF sigma 1.9060284223788517 Gaussian PSF norm 0.14800135636057563 vs pixelized 0.11989471 average tim pixel scale / coadd scale: 1.0011204583250441 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.47 s, CPU: 0.16 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.220856 MB Stage fit_on_coadds finished: 2020-08-05T19:49:37.118562 Resources for stage fit_on_coadds : 0.145 s worker CPU, 0.146 s worker Wall, Wall: 0.472 s, Cores in use: 0.65, Total efficiency (on 32 cores): 2.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:49:37.131809 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 28 potential peaks Of 28 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 14 kept SED z : 14 new peaks Found 27 potential peaks Of 27 potential peaks: 21 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 37 potential peaks Of 37 potential peaks: 27 in veto map, 6 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 51 potential peaks Of 51 potential peaks: 40 in veto map, 6 cut by saddle test, 1 cut by aper test, 4 kept SED Flat : 4 new peaks Found 52 potential peaks Of 52 potential peaks: 47 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 25 new sources Median coadd sky for g : 0.00013703911 Median coadd sky for r : 0.0003948029 Median coadd sky for z : 0.00080880977 Stage srcs : Wall: 1.13 s, CPU: 1.08 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.22126 MB Stage srcs finished: 2020-08-05T19:49:38.259116 Resources for stage srcs : 0.088 s worker CPU, 0.088 s worker Wall, Wall: 1.129 s, Cores in use: 1.03, Total efficiency (on 32 cores): 3.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:49:38.274881 Blob 1 of 15, id: 6, sources: 10, size: 190x149, npix 17380, brick X: 7,197, Y: 51,200, one pixel: 125 51 Blob 2 of 15, id: 0, sources: 2, size: 39x41, npix 924, brick X: 120,159, Y: 0,41, one pixel: 137 0 Blob 3 of 15, id: 11, sources: 1, size: 35x33, npix 800, brick X: 190,225, Y: 191,224, one pixel: 203 191 Blob 4 of 15, id: 12, sources: 2, size: 38x43, npix 767, brick X: 150,188, Y: 192,235, one pixel: 173 192 Blob 5 of 15, id: 5, sources: 1, size: 32x33, npix 678, brick X: 189,221, Y: 37,70, one pixel: 204 37 Blob 6 of 15, id: 13, sources: 1, size: 26x28, npix 454, brick X: 53,79, Y: 196,224, one pixel: 63 196 Blob 7 of 15, id: 1, sources: 1, size: 25x26, npix 412, brick X: 196,221, Y: 8,34, one pixel: 205 8 Blob 8 of 15, id: 7, sources: 1, size: 26x24, npix 406, brick X: 203,229, Y: 85,109, one pixel: 215 85 Blob 9 of 15, id: 2, sources: 1, size: 21x22, npix 280, brick X: 6,27, Y: 16,38, one pixel: 14 16 Blob 10 of 15, id: 8, sources: 1, size: 16x23, npix 261, brick X: 0,16, Y: 102,125, one pixel: 5 102 Blob 11 of 15, id: 10, sources: 1, size: 15x22, npix 236, brick X: 0,15, Y: 146,168, one pixel: 3 146 Blob 12 of 15, id: 3, sources: 1, size: 21x19, npix 228, brick X: 164,185, Y: 24,43, one pixel: 173 24 Blob 13 of 15, id: 4, sources: 1, size: 16x20, npix 199, brick X: 0,16, Y: 36,56, one pixel: 5 36 Blob 14 of 15, id: 9, sources: 1, size: 19x19, npix 199, brick X: 186,205, Y: 137,156, one pixel: 194 137 Blob 15 of 15, id: 14, sources: 1, size: 21x13, npix 181, brick X: 125,146, Y: 226,239, one pixel: 134 226 Blob 12 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 108 MB, VmData: 166 MB, maxrss: 0.110476 MB Blob 15 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 940 MB, VmSize: 721 MB, VmRSS: 134 MB, VmData: 179 MB, maxrss: 0.137128 MB Blob 9 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.113244 MB Blob 13 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145856 MB Blob 14 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.14648 MB Blob 7 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 706 MB, VmSize: 706 MB, VmRSS: 133 MB, VmData: 174 MB, maxrss: 0.136064 MB Blob 11 finished, total: Wall: 0.54 s, CPU: 0.53 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09466 MB Blob 8 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 706 MB, VmSize: 706 MB, VmRSS: 133 MB, VmData: 175 MB, maxrss: 0.136436 MB Measuring 1 iterative sources Blob 10 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14758 MB Blob 3 finished, total: Wall: 0.93 s, CPU: 0.92 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.095996 MB Blob 6 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149476 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147548 MB Blob 4 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150496 MB Blob 2 finished, total: Wall: 1.71 s, CPU: 1.71 s, VmPeak: 940 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151864 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.32768, ee1=0.147928, ee2=0.0430197 Measuring 7 iterative sources Blob 1 finished, total: Wall: 13.74 s, CPU: 13.74 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 181 MB, maxrss: 0.15286 MB Old catalog: 31 New catalog: 32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/blobs-custom-343180p11911.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/metrics/cus/all-models-custom-343180p11911.fits Stage fitblobs : Wall: 14.64 s, CPU: 0.85 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.221432 MB Stage fitblobs finished: 2020-08-05T19:49:52.917696 Resources for stage fitblobs : 23.352 s worker CPU, 23.886 s worker Wall, Wall: 14.645 s, Cores in use: 1.65, Total efficiency (on 32 cores): 5.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:49:52.933125 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-resid.jpg Stage coadds : Wall: 3.27 s, CPU: 0.74 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 217 MB, VmData: 242 MB, maxrss: 0.221948 MB Stage coadds finished: 2020-08-05T19:49:56.203698 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 25.678 s worker CPU, 48.986 s worker Wall, Wall: 3.273 s, Cores in use: 8.07, Total efficiency (on 32 cores): 25.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:49:56.218069 Cut to 1 unWISE tiles Reading WISE tile 3430p121 band 1 Reading WISE tile 3430p121 band 2 Reading WISE tile 3430p121 band 3 Reading WISE tile 3430p121 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 955 MB, VmSize: 809 MB, VmRSS: 150 MB, VmData: 174 MB, maxrss: 0.2139 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 961 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211088 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 799 MB, VmSize: 799 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.198744 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.19744 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.73 s, CPU: 0.48 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 217 MB, VmData: 242 MB, maxrss: 0.222652 MB Stage wise_forced finished: 2020-08-05T19:49:58.947018 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.210 s worker CPU, 7.151 s worker Wall, Wall: 2.731 s, Cores in use: 1.35, Total efficiency (on 32 cores): 4.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-wise_forced.p Running stage writecat WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage writecat at 2020-08-05T19:49:58.967474 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/tractor-i/cus/tractor-custom-343180p11911.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/tractor/cus/tractor-custom-343180p11911.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/tractor/cus/brick-custom-343180p11911.sha256sum Stage writecat : Wall: 2.55 s, CPU: 1.34 s, VmPeak: 1175 MB, VmSize: 1047 MB, VmRSS: 219 MB, VmData: 242 MB, maxrss: 0.355656 MB Stage writecat finished: 2020-08-05T19:50:01.513571 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.549 s, Cores in use: 0.53, Total efficiency (on 32 cores): 1.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1400724/PGC1400724-largegalaxy-writecat.p All done: 61.805 s worker CPU, 297.864 s worker Wall, Wall: 76.541 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 % Finished galaxy PGC1400724 in 1.341 minutes. Started working on galaxy PGC1400724 at Mon Aug 10 08:18:26 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.1800889945339 11.911281583469375 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T08:18:27.216971 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.1800889945339', '11.911281583469375', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.1800889945339 11.911281583469375 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.1800889945339 11.911281583469375 Starting process 65269 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 65270 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 65271 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 65272 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 65273 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB Starting process 65274 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 65275 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 65276 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T08:18:27.706308 Keeping 15 CCDs: c4d_160812_053816_ooi_z_ls9-S7 z expnum 563173 exptime 80.0 propid 2014B-0404 seeing 0.98 MJD 57612.233 object DECaLS_7859_z decam/CP/V4.8.2a/CP20160811/c4d_160812_053816_ooi_z_ls9.fits.fz c4d_170726_060416_ooi_g_ls9-S7 g expnum 662316 exptime 134.0 propid 2014B-0404 seeing 1.21 MJD 57960.251 object DECaLS_7859_g decam/CP/V4.8.2a/CP20170725/c4d_170726_060416_ooi_g_ls9.fits.fz c4d_170820_045557_ooi_r_ls9-S7 r expnum 669471 exptime 89.0 propid 2014B-0404 seeing 1.45 MJD 57985.206 object DECaLS_7859_r decam/CP/V4.8.2a/CP20170819/c4d_170820_045557_ooi_r_ls9.fits.fz c4d_170726_060416_ooi_g_ls9-N7 g expnum 662316 exptime 134.0 propid 2014B-0404 seeing 1.25 MJD 57960.251 object DECaLS_7859_g decam/CP/V4.8.2a/CP20170725/c4d_170726_060416_ooi_g_ls9.fits.fz c4d_170820_045557_ooi_r_ls9-N7 r expnum 669471 exptime 89.0 propid 2014B-0404 seeing 1.47 MJD 57985.206 object DECaLS_7859_r decam/CP/V4.8.2a/CP20170819/c4d_170820_045557_ooi_r_ls9.fits.fz c4d_170725_070230_ooi_r_ls9-N6 r expnum 661968 exptime 57.0 propid 2014B-0404 seeing 1.18 MJD 57959.292 object DECaLS_23731_r decam/CP/V4.8.2a/CP20170724/c4d_170725_070230_ooi_r_ls9.fits.fz c4d_170730_055547_ooi_g_ls9-N6 g expnum 663312 exptime 111.0 propid 2014B-0404 seeing 1.11 MJD 57964.245 object DECaLS_23731_g decam/CP/V4.8.2a/CP20170729/c4d_170730_055547_ooi_g_ls9.fits.fz c4d_160813_053103_ooi_z_ls9-N6 z expnum 563577 exptime 93.0 propid 2014B-0404 seeing 0.84 MJD 57613.228 object DECaLS_23731_z decam/CP/V4.8.2a/CP20160812/c4d_160813_053103_ooi_z_ls9.fits.fz c4d_170822_044759_ooi_g_ls9-S1 g expnum 670359 exptime 120.0 propid 2014B-0404 seeing 1.10 MJD 57987.200 object DECaLS_7860_g decam/CP/V4.8.2a/CP20170821/c4d_170822_044759_ooi_g_ls9.fits.fz c4d_180725_061048_ooi_z_ls9-S1 z expnum 758860 exptime 136.0 propid 2014B-0404 seeing 1.44 MJD 58324.258 object DECaLS_7860_z decam/CP/V4.8.2a/CP20180724/c4d_180725_061048_ooi_z_ls9.fits.fz c4d_160815_044236_ooi_z_ls9-S1 z expnum 564479 exptime 120.0 propid 2014B-0404 seeing 1.48 MJD 57615.194 object DECaLS_7860_z decam/CP/V4.8.2a/CP20160814/c4d_160815_044236_ooi_z_ls9.fits.fz c4d_170917_031723_ooi_r_ls9-S1 r expnum 678334 exptime 58.0 propid 2014B-0404 seeing 0.99 MJD 58013.137 object DECaLS_7860_r decam/CP/V4.8.2a/CP20170916/c4d_170917_031723_ooi_r_ls9.fits.fz c4d_171111_002107_ooi_z_ls9-N5 z expnum 694889 exptime 120.0 propid 2014B-0404 seeing 0.94 MJD 58068.015 object DECaLS_39603_z decam/CP/V4.8.2a/CP20171110/c4d_171111_002107_ooi_z_ls9.fits.fz c4d_170721_061834_ooi_r_ls9-N5 r expnum 660477 exptime 49.0 propid 2014B-0404 seeing 1.23 MJD 57955.262 object DECaLS_39603_r decam/CP/V4.8.2/CP20170720/c4d_170721_061834_ooi_r_ls9.fits.fz c4d_170728_061216_ooi_g_ls9-N5 g expnum 662882 exptime 200.0 propid 2014B-0404 seeing 1.01 MJD 57962.256 object DECaLS_39603_g decam/CP/V4.8.2a/CP20170727/c4d_170728_061216_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170725T070041_oi[N6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170820T045557_oi[N7,noinherit][2046,4094][real]: DECaLS_7 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T052834_oi[N6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170730T055303_oi[N6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522b69-g-20170822T044759_oi[S1,noinherit][2046,4094][real]: DECaLS_7 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95478a4-z-20160815T043945_oi[S1,noinherit][2046,4094][real]: DECaLS_7 Clipping 1 pixels with anomalously large oow values: max 0.0025644 vs median 0.00156429 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T061048_oi[S1,noinherit][2046,4094][real]: DECaLS_7 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521fe5-z-20171111T002107_oi[N5,noinherit][2046,4094][real]: DECaLS_3 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T060805_oi[N5,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T031723_oi[S1,noinherit][2046,4094][real]: DECaLS_7 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951cf8e-r-20170721T061654_oi[N5,noinherit][2046,4094][real]: DECaLS_3 Stage tims : Wall: 112.02 s, CPU: 0.86 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.18044 MB Stage tims finished: 2020-08-10T08:20:19.724636 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522b69-g-20170822T044759_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170820T045557_oi[N7,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95478a4-z-20160815T043945_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T061048_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170725T070041_oi[N6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521fe5-z-20171111T002107_oi[N5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T052834_oi[N6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T060805_oi[N5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T031723_oi[S1,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170730T055303_oi[N6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951cf8e-r-20170721T061654_oi[N5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Resources for stage tims : 5.933 s worker CPU, 331.918 s worker Wall, Wall: 112.020 s, Cores in use: 0.06, Total efficiency (on 8 cores): 0.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-10T08:20:19.983163 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04794.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04921.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05050.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04922.fits Matched 11 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/metrics/cus/reference-custom-343180p11911.fits Stage refs : Wall: 8.23 s, CPU: 2.00 s, VmPeak: 1036 MB, VmSize: 1026 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.20324 MB Stage refs finished: 2020-08-10T08:20:28.212713 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.231 s, Cores in use: 0.24, Total efficiency (on 8 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T08:20:28.235394 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/metrics/cus/outlier-mask-custom-343180p11911.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/metrics/cus/outliers-pre-custom-343180p11911.jpg Image c4d_170730_055547_ooi_g_ls9-N6 g : masking 2452 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/metrics/cus/outlier-mask-custom-343180p11911.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/metrics/cus/outliers-post-custom-343180p11911.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/metrics/cus/outliers-masked-pos-custom-343180p11911.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/metrics/cus/outliers-masked-neg-custom-343180p11911.jpg Stage outliers : Wall: 0.83 s, CPU: 0.63 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 211 MB, VmData: 241 MB, maxrss: 0.216132 MB Stage outliers finished: 2020-08-10T08:20:29.066872 Resources for stage outliers : 0.625 s worker CPU, 0.625 s worker Wall, Wall: 0.833 s, Cores in use: 1.51, Total efficiency (on 8 cores): 18.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T08:20:29.219448 Stage halos : Wall: 0.37 s, CPU: 0.22 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 212 MB, VmData: 241 MB, maxrss: 0.216608 MB Stage halos finished: 2020-08-10T08:20:29.587828 Resources for stage halos : 0.419 s worker CPU, 0.900 s worker Wall, Wall: 0.369 s, Cores in use: 1.73, Total efficiency (on 8 cores): 21.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T08:20:29.613970 PSF sigmas in coadd pixels: ['1.81', '1.79', '1.64'] Using average PSF sigma 1.747639802427953 Gaussian PSF norm 0.1614147213756352 vs pixelized 0.14308636 average tim pixel scale / coadd scale: 1.001200904867093 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.39', '1.92', '1.61', '1.99'] Using average PSF sigma 1.9778620556127755 Gaussian PSF norm 0.1426261204482637 vs pixelized 0.118201226 average tim pixel scale / coadd scale: 1.0012038624605504 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.36', '2.33', '2.40', '1.52'] Using average PSF sigma 1.9060284223788517 Gaussian PSF norm 0.14800135636057563 vs pixelized 0.11989477 average tim pixel scale / coadd scale: 1.0011204583250441 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.15 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.218912 MB Stage fit_on_coadds finished: 2020-08-10T08:20:29.825903 Resources for stage fit_on_coadds : 0.178 s worker CPU, 0.178 s worker Wall, Wall: 0.213 s, Cores in use: 1.56, Total efficiency (on 8 cores): 19.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T08:20:29.834885 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 28 potential peaks Of 28 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 13 kept SED z : 13 new peaks Found 25 potential peaks Of 25 potential peaks: 21 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 34 potential peaks Of 34 potential peaks: 26 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 47 potential peaks Of 47 potential peaks: 37 in veto map, 5 cut by saddle test, 1 cut by aper test, 4 kept SED Flat : 4 new peaks Found 50 potential peaks Of 50 potential peaks: 44 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 21 new sources Median coadd sky for g : 0.0001535556 Median coadd sky for r : 0.00042945961 Median coadd sky for z : 0.00082079833 Stage srcs : Wall: 0.44 s, CPU: 0.40 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.219388 MB Stage srcs finished: 2020-08-10T08:20:30.270199 Resources for stage srcs : 0.076 s worker CPU, 0.076 s worker Wall, Wall: 0.436 s, Cores in use: 1.10, Total efficiency (on 8 cores): 13.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T08:20:30.280449 Blob 1 of 12, id: 5, sources: 9, size: 190x148, npix 17437, brick X: 4,194, Y: 49,197, one pixel: 121 49 Blob 2 of 12, id: 0, sources: 2, size: 40x39, npix 870, brick X: 117,157, Y: 0,39, one pixel: 132 0 Blob 3 of 12, id: 8, sources: 1, size: 35x34, npix 809, brick X: 187,222, Y: 188,222, one pixel: 201 188 Blob 4 of 12, id: 9, sources: 2, size: 38x43, npix 753, brick X: 147,185, Y: 189,232, one pixel: 171 189 Blob 5 of 12, id: 4, sources: 1, size: 32x32, npix 668, brick X: 186,218, Y: 35,67, one pixel: 200 35 Blob 6 of 12, id: 10, sources: 1, size: 26x28, npix 458, brick X: 50,76, Y: 193,221, one pixel: 60 193 Blob 7 of 12, id: 1, sources: 1, size: 25x26, npix 412, brick X: 193,218, Y: 5,31, one pixel: 202 5 Blob 8 of 12, id: 6, sources: 1, size: 26x25, npix 407, brick X: 200,226, Y: 82,107, one pixel: 212 82 Blob 9 of 12, id: 11, sources: 1, size: 26x17, npix 303, brick X: 120,146, Y: 222,239, one pixel: 133 222 Blob 8 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145688 MB Blob 10 of 12, id: 2, sources: 1, size: 21x22, npix 290, brick X: 3,24, Y: 13,35, one pixel: 12 13 Blob 7 finished, total: Wall: 0.82 s, CPU: 0.72 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146704 MB Blob 11 of 12, id: 3, sources: 1, size: 21x20, npix 239, brick X: 161,182, Y: 21,41, one pixel: 170 21 Blob 10 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146704 MB Blob 12 of 12, id: 7, sources: 1, size: 19x19, npix 199, brick X: 183,202, Y: 134,153, one pixel: 192 134 Blob 11 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146704 MB Blob 3 finished, total: Wall: 1.32 s, CPU: 1.32 s, VmPeak: 973 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145344 MB Blob 4 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14728 MB Blob 6 finished, total: Wall: 1.36 s, CPU: 1.13 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146396 MB Blob 12 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146704 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.67 s, CPU: 1.51 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.14694 MB Blob 9 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147576 MB Blob 2 finished, total: Wall: 2.11 s, CPU: 2.11 s, VmPeak: 961 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147036 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.962731, ee1=0.128773, ee2=0.0395807 Measuring 5 iterative sources Blob 1 finished, total: Wall: 12.88 s, CPU: 12.88 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149668 MB Old catalog: 26 New catalog: 26 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/metrics/cus/blobs-custom-343180p11911.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/metrics/cus/all-models-custom-343180p11911.fits Stage fitblobs : Wall: 13.31 s, CPU: 0.37 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.219556 MB Stage fitblobs finished: 2020-08-10T08:20:43.594301 Resources for stage fitblobs : 23.489 s worker CPU, 24.045 s worker Wall, Wall: 13.315 s, Cores in use: 1.79, Total efficiency (on 8 cores): 22.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T08:20:43.666363 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-resid.jpg Stage coadds : Wall: 1.60 s, CPU: 0.86 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.220072 MB Stage coadds finished: 2020-08-10T08:20:45.270427 Resources for stage coadds : 3.782 s worker CPU, 4.469 s worker Wall, Wall: 1.605 s, Cores in use: 2.89, Total efficiency (on 8 cores): 36.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T08:20:45.283445 Cut to 1 unWISE tiles Reading WISE tile 3430p121 band 3 Reading WISE tile 3430p121 band 1 Reading WISE tile 3430p121 band 2 Reading WISE tile 3430p121 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 973 MB, VmSize: 803 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21006 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 968 MB, VmSize: 803 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210824 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 968 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208472 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3430p121/unwise-3430p121-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 940 MB, VmSize: 807 MB, VmRSS: 150 MB, VmData: 178 MB, maxrss: 0.191504 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/tmp-legacysurvey-custom-343180p11911-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.36 s, CPU: 0.63 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.220776 MB Stage wise_forced finished: 2020-08-10T08:20:48.640104 Resources for stage wise_forced : 3.301 s worker CPU, 6.116 s worker Wall, Wall: 3.358 s, Cores in use: 1.17, Total efficiency (on 8 cores): 14.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T08:20:48.651920 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/coadd/cus/custom-343180p11911/legacysurvey-custom-343180p11911-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/tractor-i/cus/tractor-custom-343180p11911.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/tractor/cus/tractor-custom-343180p11911.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/tractor/cus/brick-custom-343180p11911.sha256sum Stage writecat : Wall: 0.75 s, CPU: 0.52 s, VmPeak: 1168 MB, VmSize: 1040 MB, VmRSS: 217 MB, VmData: 242 MB, maxrss: 0.353776 MB Stage writecat finished: 2020-08-10T08:20:49.405102 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.754 s, Cores in use: 0.69, Total efficiency (on 8 cores): 8.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1400724/PGC1400724-largegalaxy-writecat.p All done: 37.805 s worker CPU, 368.329 s worker Wall, Wall: 141.716 s, Cores in use: 0.31, Total efficiency (on 8 cores): 3.9 % Finished galaxy PGC1400724 in 2.394 minutes.