Started working on galaxy PGC1318650 at Wed Aug 5 19:09:59 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.1293584999999 7.305368400000001 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:10:01.079003 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '318.1293584999999', '7.305368400000001', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.1293584999999 7.305368400000001 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 318.1293584999999 7.305368400000001 Starting process 35631 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 35632 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 35633 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 35634 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 35635 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 35636 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 35637 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 35638 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 35639 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 35640 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 35641 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 35642 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 35643 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 35644 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 35645 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 35646 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:10:01.955700 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 12 CCDs: c4d_140816_025604_ooi_r_ls9-N27 r expnum 348308 exptime 88.0 propid 2014B-0404 seeing 0.96 MJD 56885.121 object DECaLS_11785_r decam/CP/V4.8.2a/CP20140815/c4d_140816_025604_ooi_r_ls9.fits.fz c4d_140816_023848_ooi_g_ls9-N27 g expnum 348300 exptime 122.0 propid 2014B-0404 seeing 1.02 MJD 56885.108 object DECaLS_11785_g decam/CP/V4.8.2a/CP20140815/c4d_140816_023848_ooi_g_ls9.fits.fz c4d_140816_040042_ooi_z_ls9-N27 z expnum 348340 exptime 132.0 propid 2014B-0404 seeing 0.81 MJD 56885.165 object DECaLS_11785_z decam/CP/V4.8.2a/CP20140815/c4d_140816_040042_ooi_z_ls9.fits.fz c4d_140818_024809_ooi_r_ls9-N26 r expnum 349224 exptime 83.0 propid 2014B-0404 seeing 1.21 MJD 56887.115 object DECaLS_27657_r decam/CP/V4.8.2a/CP20140817/c4d_140818_024809_ooi_r_ls9.fits.fz c4d_180725_050100_ooi_z_ls9-N26 z expnum 758827 exptime 80.0 propid 2014B-0404 seeing 0.95 MJD 58324.209 object DECaLS_27657_z decam/CP/V4.8.2a/CP20180724/c4d_180725_050100_ooi_z_ls9.fits.fz c4d_140818_021028_ooi_g_ls9-N26 g expnum 349206 exptime 112.0 propid 2014B-0404 seeing 1.74 MJD 56887.089 object DECaLS_27657_g decam/CP/V4.8.2a/CP20140817/c4d_140818_021028_ooi_g_ls9.fits.fz c4d_170723_042220_ooi_g_ls9-N29 g expnum 661247 exptime 200.0 propid 2014B-0404 seeing 1.81 MJD 57957.179 object DECaLS_43529_g decam/CP/V4.8.2a/CP20170722/c4d_170723_042220_ooi_g_ls9.fits.fz c4d_140814_032326_ooi_z_ls9-N29 z expnum 347693 exptime 250.0 propid 2014B-0404 seeing 1.05 MJD 56883.138 object DECaLS_43529_z decam/CP/V4.8.2a/CP20140813/c4d_140814_032326_ooi_z_ls9.fits.fz c4d_140815_022529_ooi_r_ls9-S28 r expnum 347941 exptime 85.0 propid 2014B-0404 seeing 1.25 MJD 56884.099 object DECaLS_43510_r decam/CP/V4.8.2a/CP20140814/c4d_140815_022529_ooi_r_ls9.fits.fz c4d_180901_052159_ooi_z_ls9-S28 z expnum 767577 exptime 156.0 propid 2014B-0404 seeing 1.66 MJD 58362.224 object DECaLS_43510_z decam/CP/V4.8.2a/CP20180831/c4d_180901_052159_ooi_z_ls9.fits.fz c4d_170723_040610_ooi_g_ls9-S28 g expnum 661243 exptime 200.0 propid 2014B-0404 seeing 1.78 MJD 57957.168 object DECaLS_43510_g decam/CP/V4.8.2a/CP20170722/c4d_170723_040610_ooi_g_ls9.fits.fz c4d_180908_020624_ooi_g_ls9-S28 g expnum 770548 exptime 89.0 propid 2014B-0404 seeing 1.21 MJD 58369.088 object DECaLS_43510_g decam/CP/V4.8.2a/CP20180907/c4d_180908_020624_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954793b-r-20140815T022313_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140816T023552_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T020624_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T024553_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T052159_oi[S28,noinherit][2046,4094][real]: DECaLS_4351 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T041805_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T020740_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T035740_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T025342_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T050100_oi[N26,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T031823_oi[N29,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T040156_oi[S28,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 24.43 s, CPU: 1.07 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 178 MB, VmData: 210 MB, maxrss: 0.18214 MB Stage tims finished: 2020-08-05T19:10:26.389935 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T020624_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140816T023552_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T024553_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T041805_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T025342_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T020740_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T050100_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T031823_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T040156_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 7.637 s worker CPU, 195.202 s worker Wall, Wall: 24.436 s, Cores in use: 0.36, Total efficiency (on 16 cores): 2.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954793b-r-20140815T022313_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:10:26.673964 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05424.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05425.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05553.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05297.fits Matched 2 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/reference-custom-318129p07305.fits Stage refs : Wall: 11.91 s, CPU: 5.86 s, VmPeak: 1074 MB, VmSize: 1068 MB, VmRSS: 237 MB, VmData: 267 MB, maxrss: 0.242608 MB Stage refs finished: 2020-08-05T19:10:38.588303 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T052159_oi[S28,noinherit][2046,4094][real]: DECaLS_4351 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T035740_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.916 s, Cores in use: 0.49, Total efficiency (on 16 cores): 3.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:10:38.629461 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outlier-mask-custom-318129p07305.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outliers-pre-custom-318129p07305.jpg Image c4d_140816_023848_ooi_g_ls9-N27 g : masking 968 positive outlier pixels and 0 negative outlier pixels Image c4d_170723_040610_ooi_g_ls9-S28 g : masking 2563 positive outlier pixels and 0 negative outlier pixels Image c4d_180908_020624_ooi_g_ls9-S28 g : masking 311 positive outlier pixels and 0 negative outlier pixels Image c4d_140818_024809_ooi_r_ls9-N26 r : masking 1397 positive outlier pixels and 0 negative outlier pixels Image c4d_140816_025604_ooi_r_ls9-N27 r : masking 137 positive outlier pixels and 0 negative outlier pixels Image c4d_140814_032326_ooi_z_ls9-N29 z : masking 1907 positive outlier pixels and 0 negative outlier pixels Image c4d_180901_052159_ooi_z_ls9-S28 z : masking 11252 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outlier-mask-custom-318129p07305.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outliers-post-custom-318129p07305.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outliers-masked-pos-custom-318129p07305.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outliers-masked-neg-custom-318129p07305.jpg Stage outliers : Wall: 1.66 s, CPU: 1.41 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.255664 MB Stage outliers finished: 2020-08-05T19:10:40.286951 Resources for stage outliers : 0.913 s worker CPU, 0.999 s worker Wall, Wall: 1.659 s, Cores in use: 1.40, Total efficiency (on 16 cores): 8.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:10:40.317116 Stage halos : Wall: 2.89 s, CPU: 2.42 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 250 MB, VmData: 278 MB, maxrss: 0.25618 MB Stage halos finished: 2020-08-05T19:10:43.211372 Resources for stage halos : 0.698 s worker CPU, 3.072 s worker Wall, Wall: 2.896 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:10:44.152831 PSF sigmas in coadd pixels: ['1.65', '2.82', '2.93', '2.90', '1.96'] Using average PSF sigma 2.453299222857567 Gaussian PSF norm 0.11498588885757616 vs pixelized 0.090807 average tim pixel scale / coadd scale: 1.0011569491964374 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.56', '1.97', '2.04'] Using average PSF sigma 1.853231704197164 Gaussian PSF norm 0.1522177670147749 vs pixelized 0.12657814 average tim pixel scale / coadd scale: 1.0011824428189176 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.32', '1.54', '1.70', '2.70'] Using average PSF sigma 1.814215732275854 Gaussian PSF norm 0.15549131602998648 vs pixelized 0.123009495 average tim pixel scale / coadd scale: 1.0011036125392092 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.15 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.257864 MB Stage fit_on_coadds finished: 2020-08-05T19:10:44.330820 Resources for stage fit_on_coadds : 0.272 s worker CPU, 0.272 s worker Wall, Wall: 0.179 s, Cores in use: 2.34, Total efficiency (on 16 cores): 14.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:10:44.348149 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 102 potential peaks Of 102 potential peaks: 77 in veto map, 10 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 145 potential peaks Of 145 potential peaks: 134 in veto map, 8 cut by saddle test, 1 cut by aper test, 2 kept SED r : 2 new peaks Found 119 potential peaks Of 119 potential peaks: 111 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 167 potential peaks Of 167 potential peaks: 155 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 204 potential peaks Of 204 potential peaks: 192 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 23 new sources Median coadd sky for g : 0.00021153827 Median coadd sky for r : 0.0003509881 Median coadd sky for z : 0.0005980584 Stage srcs : Wall: 1.61 s, CPU: 1.55 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.2584 MB Stage srcs finished: 2020-08-05T19:10:45.960412 Resources for stage srcs : 0.074 s worker CPU, 0.074 s worker Wall, Wall: 1.614 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:10:53.269439 Blob 1 of 4, id: 0, sources: 24, size: 233x239, npix 41893, brick X: 0,233, Y: 0,239, one pixel: 7 0 Blob 2 of 4, id: 2, sources: 1, size: 38x22, npix 539, brick X: 1,39, Y: 217,239, one pixel: 9 217 Blob 3 of 4, id: 1, sources: 1, size: 18x35, npix 495, brick X: 221,239, Y: 193,228, one pixel: 230 193 Blob 4 of 4, id: 3, sources: 1, size: 23x20, npix 295, brick X: 184,207, Y: 219,239, one pixel: 193 219 Measuring 1 iterative sources Blob 2 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 943 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 180 MB, maxrss: 0.149112 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 936 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150272 MB Blob 4 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114896 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (318.15971, 7.30919), pm (-0.2, -6.5), parallax 0.116 with NanoMaggies: g=14.2, r=12.8, z=11.7 Reset brightness to NanoMaggies: g=14.2, r=12.8, z=11.7 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.28069, ee1=-0.184426, ee2=-0.086948 Measuring 27 iterative sources Blob 1 finished, total: Wall: 39.54 s, CPU: 39.53 s, VmPeak: 957 MB, VmSize: 746 MB, VmRSS: 166 MB, VmData: 195 MB, maxrss: 0.170424 MB Old catalog: 36 New catalog: 51 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/blobs-custom-318129p07305.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/all-models-custom-318129p07305.fits Stage fitblobs : Wall: 40.07 s, CPU: 0.47 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 253 MB, VmData: 278 MB, maxrss: 0.259272 MB Stage fitblobs finished: 2020-08-05T19:11:33.342101 Resources for stage fitblobs : 41.144 s worker CPU, 41.184 s worker Wall, Wall: 40.074 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:11:33.355773 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-resid.jpg Stage coadds : Wall: 2.63 s, CPU: 0.74 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 254 MB, VmData: 278 MB, maxrss: 0.259616 MB Stage coadds finished: 2020-08-05T19:11:35.986941 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 10.227 s worker CPU, 13.413 s worker Wall, Wall: 2.633 s, Cores in use: 4.16, Total efficiency (on 16 cores): 26.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T19:11:36.014587 Cut to 1 unWISE tiles Reading WISE tile 3188p075 band 1 Reading WISE tile 3188p075 band 2 Reading WISE tile 3188p075 band 4 Reading WISE tile 3188p075 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 952 MB, VmSize: 809 MB, VmRSS: 150 MB, VmData: 178 MB, maxrss: 0.194164 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 959 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207672 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 951 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.20672 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207156 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.28 s, CPU: 0.69 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 254 MB, VmData: 278 MB, maxrss: 0.260128 MB Stage wise_forced finished: 2020-08-05T19:11:38.297046 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.252 s worker CPU, 4.925 s worker Wall, Wall: 2.284 s, Cores in use: 1.73, Total efficiency (on 16 cores): 10.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:11:38.311230 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/tractor-i/cus/tractor-custom-318129p07305.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/tractor/cus/tractor-custom-318129p07305.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/tractor/cus/brick-custom-318129p07305.sha256sum Stage writecat : Wall: 0.83 s, CPU: 0.69 s, VmPeak: 1211 MB, VmSize: 1083 MB, VmRSS: 256 MB, VmData: 278 MB, maxrss: 0.393004 MB Stage writecat finished: 2020-08-05T19:11:39.141421 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.832 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-writecat.p All done: 64.219 s worker CPU, 259.143 s worker Wall, Wall: 97.205 s, Cores in use: 0.82, Total efficiency (on 16 cores): 5.1 % Finished galaxy PGC1318650 in 1.668 minutes. Started working on galaxy PGC1318650 at Wed Aug 5 19:52:47 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.1293584999999 7.305368400000001 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:52:50.979191 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '318.1293584999999', '7.305368400000001', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.1293584999999 7.305368400000001 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 318.1293584999999 7.305368400000001 Starting process 44594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 44595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 44596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 44597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 44598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0594 MB Starting process 44599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB Starting process 44600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB Starting process 44601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 44602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 44603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 44604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 44605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 44606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 44607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 44608 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 44609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 44610 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 44611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 44612 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 44613 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 44614 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 44615 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 44616 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 44617 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 44618 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 44619 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 44620 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 44621 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 44622 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 44623 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 44624 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 44625 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:52:51.968715 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 12 CCDs: c4d_140816_025604_ooi_r_ls9-N27 r expnum 348308 exptime 88.0 propid 2014B-0404 seeing 0.96 MJD 56885.121 object DECaLS_11785_r decam/CP/V4.8.2a/CP20140815/c4d_140816_025604_ooi_r_ls9.fits.fz c4d_140816_023848_ooi_g_ls9-N27 g expnum 348300 exptime 122.0 propid 2014B-0404 seeing 1.02 MJD 56885.108 object DECaLS_11785_g decam/CP/V4.8.2a/CP20140815/c4d_140816_023848_ooi_g_ls9.fits.fz c4d_140816_040042_ooi_z_ls9-N27 z expnum 348340 exptime 132.0 propid 2014B-0404 seeing 0.81 MJD 56885.165 object DECaLS_11785_z decam/CP/V4.8.2a/CP20140815/c4d_140816_040042_ooi_z_ls9.fits.fz c4d_140818_024809_ooi_r_ls9-N26 r expnum 349224 exptime 83.0 propid 2014B-0404 seeing 1.21 MJD 56887.115 object DECaLS_27657_r decam/CP/V4.8.2a/CP20140817/c4d_140818_024809_ooi_r_ls9.fits.fz c4d_180725_050100_ooi_z_ls9-N26 z expnum 758827 exptime 80.0 propid 2014B-0404 seeing 0.95 MJD 58324.209 object DECaLS_27657_z decam/CP/V4.8.2a/CP20180724/c4d_180725_050100_ooi_z_ls9.fits.fz c4d_140818_021028_ooi_g_ls9-N26 g expnum 349206 exptime 112.0 propid 2014B-0404 seeing 1.74 MJD 56887.089 object DECaLS_27657_g decam/CP/V4.8.2a/CP20140817/c4d_140818_021028_ooi_g_ls9.fits.fz c4d_170723_042220_ooi_g_ls9-N29 g expnum 661247 exptime 200.0 propid 2014B-0404 seeing 1.81 MJD 57957.179 object DECaLS_43529_g decam/CP/V4.8.2a/CP20170722/c4d_170723_042220_ooi_g_ls9.fits.fz c4d_140814_032326_ooi_z_ls9-N29 z expnum 347693 exptime 250.0 propid 2014B-0404 seeing 1.05 MJD 56883.138 object DECaLS_43529_z decam/CP/V4.8.2a/CP20140813/c4d_140814_032326_ooi_z_ls9.fits.fz c4d_140815_022529_ooi_r_ls9-S28 r expnum 347941 exptime 85.0 propid 2014B-0404 seeing 1.25 MJD 56884.099 object DECaLS_43510_r decam/CP/V4.8.2a/CP20140814/c4d_140815_022529_ooi_r_ls9.fits.fz c4d_180901_052159_ooi_z_ls9-S28 z expnum 767577 exptime 156.0 propid 2014B-0404 seeing 1.66 MJD 58362.224 object DECaLS_43510_z decam/CP/V4.8.2a/CP20180831/c4d_180901_052159_ooi_z_ls9.fits.fz c4d_170723_040610_ooi_g_ls9-S28 g expnum 661243 exptime 200.0 propid 2014B-0404 seeing 1.78 MJD 57957.168 object DECaLS_43510_g decam/CP/V4.8.2a/CP20170722/c4d_170723_040610_ooi_g_ls9.fits.fz c4d_180908_020624_ooi_g_ls9-S28 g expnum 770548 exptime 89.0 propid 2014B-0404 seeing 1.21 MJD 58369.088 object DECaLS_43510_g decam/CP/V4.8.2a/CP20180907/c4d_180908_020624_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954793b-r-20140815T022313_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T020624_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T024553_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T041805_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T020740_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T031823_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T025342_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T052159_oi[S28,noinherit][2046,4094][real]: DECaLS_4351 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T035740_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140816T023552_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T050100_oi[N26,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T040156_oi[S28,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 68.82 s, CPU: 1.26 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 178 MB, VmData: 210 MB, maxrss: 0.182484 MB Stage tims finished: 2020-08-05T19:54:00.791683 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T020624_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T024553_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T031823_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140816T023552_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T052159_oi[S28,noinherit][2046,4094][real]: DECaLS_4351 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T035740_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T020740_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T050100_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 7.199 s worker CPU, 451.629 s worker Wall, Wall: 68.826 s, Cores in use: 0.12, Total efficiency (on 32 cores): 0.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T025342_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T040156_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:54:00.831228 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05424.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05425.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05553.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05297.fits Matched 2 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/reference-custom-318129p07305.fits Stage refs : Wall: 10.71 s, CPU: 5.71 s, VmPeak: 1074 MB, VmSize: 1068 MB, VmRSS: 237 MB, VmData: 267 MB, maxrss: 0.24274 MB Stage refs finished: 2020-08-05T19:54:11.536431 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954793b-r-20140815T022313_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T041805_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 10.707 s, Cores in use: 0.53, Total efficiency (on 32 cores): 1.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:54:11.565695 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outlier-mask-custom-318129p07305.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outliers-pre-custom-318129p07305.jpg Image c4d_180908_020624_ooi_g_ls9-S28 g : masking 311 positive outlier pixels and 0 negative outlier pixels Image c4d_170723_040610_ooi_g_ls9-S28 g : masking 2563 positive outlier pixels and 0 negative outlier pixels Image c4d_140816_023848_ooi_g_ls9-N27 g : masking 968 positive outlier pixels and 0 negative outlier pixels Image c4d_140816_025604_ooi_r_ls9-N27 r : masking 137 positive outlier pixels and 0 negative outlier pixels Image c4d_140818_024809_ooi_r_ls9-N26 r : masking 1397 positive outlier pixels and 0 negative outlier pixels Image c4d_140814_032326_ooi_z_ls9-N29 z : masking 1907 positive outlier pixels and 0 negative outlier pixels Image c4d_180901_052159_ooi_z_ls9-S28 z : masking 11252 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outlier-mask-custom-318129p07305.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outliers-post-custom-318129p07305.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outliers-masked-pos-custom-318129p07305.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/outliers-masked-neg-custom-318129p07305.jpg Stage outliers : Wall: 1.34 s, CPU: 0.92 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.255508 MB Stage outliers finished: 2020-08-05T19:54:12.905134 Resources for stage outliers : 1.059 s worker CPU, 1.517 s worker Wall, Wall: 1.341 s, Cores in use: 1.47, Total efficiency (on 32 cores): 4.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:54:13.060671 Stage halos : Wall: 1.02 s, CPU: 0.83 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.255928 MB Stage halos finished: 2020-08-05T19:54:14.084671 Resources for stage halos : 0.821 s worker CPU, 1.716 s worker Wall, Wall: 1.026 s, Cores in use: 1.61, Total efficiency (on 32 cores): 5.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:54:14.115698 PSF sigmas in coadd pixels: ['1.65', '2.82', '2.93', '2.90', '1.96'] Using average PSF sigma 2.453299222857567 Gaussian PSF norm 0.11498588885757616 vs pixelized 0.090807 average tim pixel scale / coadd scale: 1.0011569491964374 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.56', '1.97', '2.04'] Using average PSF sigma 1.853231704197164 Gaussian PSF norm 0.1522177670147749 vs pixelized 0.12657814 average tim pixel scale / coadd scale: 1.0011824428189176 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.32', '1.54', '1.70', '2.70'] Using average PSF sigma 1.814215732275854 Gaussian PSF norm 0.15549131602998648 vs pixelized 0.123009495 average tim pixel scale / coadd scale: 1.0011036125392092 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.15 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.25782 MB Stage fit_on_coadds finished: 2020-08-05T19:54:14.280275 Resources for stage fit_on_coadds : 0.250 s worker CPU, 0.250 s worker Wall, Wall: 0.167 s, Cores in use: 2.41, Total efficiency (on 32 cores): 7.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:54:14.291539 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 102 potential peaks Of 102 potential peaks: 77 in veto map, 10 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 145 potential peaks Of 145 potential peaks: 134 in veto map, 8 cut by saddle test, 1 cut by aper test, 2 kept SED r : 2 new peaks Found 119 potential peaks Of 119 potential peaks: 111 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 167 potential peaks Of 167 potential peaks: 155 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 204 potential peaks Of 204 potential peaks: 192 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 23 new sources Median coadd sky for g : 0.00021153827 Median coadd sky for r : 0.0003509881 Median coadd sky for z : 0.0005980584 Stage srcs : Wall: 0.68 s, CPU: 0.64 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.258356 MB Stage srcs finished: 2020-08-05T19:54:14.974821 Resources for stage srcs : 0.087 s worker CPU, 0.087 s worker Wall, Wall: 0.686 s, Cores in use: 1.07, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:54:15.004430 Blob 1 of 4, id: 0, sources: 24, size: 233x239, npix 41893, brick X: 0,233, Y: 0,239, one pixel: 7 0 Blob 2 of 4, id: 2, sources: 1, size: 38x22, npix 539, brick X: 1,39, Y: 217,239, one pixel: 9 217 Blob 3 of 4, id: 1, sources: 1, size: 18x35, npix 495, brick X: 221,239, Y: 193,228, one pixel: 230 193 Blob 4 of 4, id: 3, sources: 1, size: 23x20, npix 295, brick X: 184,207, Y: 219,239, one pixel: 193 219 Measuring 1 iterative sources Blob 2 finished, total: Wall: 0.36 s, CPU: 0.35 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093912 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 0.55 s, CPU: 0.54 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09246 MB Blob 4 finished, total: Wall: 0.72 s, CPU: 0.70 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093128 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (318.15971, 7.30919), pm (-0.2, -6.5), parallax 0.116 with NanoMaggies: g=14.2, r=12.8, z=11.7 Reset brightness to NanoMaggies: g=14.2, r=12.8, z=11.7 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.28069, ee1=-0.184426, ee2=-0.086948 Measuring 27 iterative sources Blob 1 finished, total: Wall: 42.44 s, CPU: 42.43 s, VmPeak: 708 MB, VmSize: 698 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.140696 MB Old catalog: 36 New catalog: 51 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/blobs-custom-318129p07305.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/metrics/cus/all-models-custom-318129p07305.fits Stage fitblobs : Wall: 44.71 s, CPU: 1.72 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 253 MB, VmData: 278 MB, maxrss: 0.259104 MB Stage fitblobs finished: 2020-08-05T19:54:59.716493 Resources for stage fitblobs : 44.087 s worker CPU, 44.331 s worker Wall, Wall: 44.714 s, Cores in use: 1.02, Total efficiency (on 32 cores): 3.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:54:59.738231 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-resid.jpg Stage coadds : Wall: 3.74 s, CPU: 1.20 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 253 MB, VmData: 278 MB, maxrss: 0.259572 MB Stage coadds finished: 2020-08-05T19:55:03.478001 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 28.364 s worker CPU, 46.714 s worker Wall, Wall: 3.742 s, Cores in use: 7.90, Total efficiency (on 32 cores): 24.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:55:03.496232 Cut to 1 unWISE tiles Reading WISE tile 3188p075 band 2 Reading WISE tile 3188p075 band 3 Reading WISE tile 3188p075 band 1 Reading WISE tile 3188p075 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 943 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.208104 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 957 MB, VmSize: 807 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.191576 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 945 MB, VmSize: 802 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.203768 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 941 MB, VmSize: 802 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.206172 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.10 s, CPU: 1.28 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 254 MB, VmData: 278 MB, maxrss: 0.260084 MB Stage wise_forced finished: 2020-08-05T19:55:06.597804 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.473 s worker CPU, 5.239 s worker Wall, Wall: 3.104 s, Cores in use: 1.53, Total efficiency (on 32 cores): 4.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-wise_forced.p Running stage writecat WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage writecat at 2020-08-05T19:55:06.627710 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/tractor-i/cus/tractor-custom-318129p07305.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/tractor/cus/tractor-custom-318129p07305.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/tractor/cus/brick-custom-318129p07305.sha256sum Stage writecat : Wall: 2.50 s, CPU: 1.54 s, VmPeak: 1211 MB, VmSize: 1083 MB, VmRSS: 256 MB, VmData: 278 MB, maxrss: 0.39296 MB Stage writecat finished: 2020-08-05T19:55:09.126623 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 2.501 s, Cores in use: 0.62, Total efficiency (on 32 cores): 1.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC1318650/PGC1318650-largegalaxy-writecat.p All done: 85.347 s worker CPU, 551.491 s worker Wall, Wall: 137.187 s, Cores in use: 0.73, Total efficiency (on 32 cores): 2.3 % Finished galaxy PGC1318650 in 2.373 minutes. Started working on galaxy PGC1318650 at Mon Aug 10 07:55:39 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.1290742271466 7.305356474356857 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T07:55:40.800995 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '318.1290742271466', '7.305356474356857', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.1290742271466 7.305356474356857 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 318.1290742271466 7.305356474356857 Starting process 41022 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 41023 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 41024 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 41025 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 41026 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 41027 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 41028 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 41029 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T07:55:41.505302 Keeping 12 CCDs: c4d_140816_025604_ooi_r_ls9-N27 r expnum 348308 exptime 88.0 propid 2014B-0404 seeing 0.96 MJD 56885.121 object DECaLS_11785_r decam/CP/V4.8.2a/CP20140815/c4d_140816_025604_ooi_r_ls9.fits.fz c4d_140816_023848_ooi_g_ls9-N27 g expnum 348300 exptime 122.0 propid 2014B-0404 seeing 1.02 MJD 56885.108 object DECaLS_11785_g decam/CP/V4.8.2a/CP20140815/c4d_140816_023848_ooi_g_ls9.fits.fz c4d_140816_040042_ooi_z_ls9-N27 z expnum 348340 exptime 132.0 propid 2014B-0404 seeing 0.81 MJD 56885.165 object DECaLS_11785_z decam/CP/V4.8.2a/CP20140815/c4d_140816_040042_ooi_z_ls9.fits.fz c4d_140818_024809_ooi_r_ls9-N26 r expnum 349224 exptime 83.0 propid 2014B-0404 seeing 1.21 MJD 56887.115 object DECaLS_27657_r decam/CP/V4.8.2a/CP20140817/c4d_140818_024809_ooi_r_ls9.fits.fz c4d_180725_050100_ooi_z_ls9-N26 z expnum 758827 exptime 80.0 propid 2014B-0404 seeing 0.95 MJD 58324.209 object DECaLS_27657_z decam/CP/V4.8.2a/CP20180724/c4d_180725_050100_ooi_z_ls9.fits.fz c4d_140818_021028_ooi_g_ls9-N26 g expnum 349206 exptime 112.0 propid 2014B-0404 seeing 1.74 MJD 56887.089 object DECaLS_27657_g decam/CP/V4.8.2a/CP20140817/c4d_140818_021028_ooi_g_ls9.fits.fz c4d_170723_042220_ooi_g_ls9-N29 g expnum 661247 exptime 200.0 propid 2014B-0404 seeing 1.81 MJD 57957.179 object DECaLS_43529_g decam/CP/V4.8.2a/CP20170722/c4d_170723_042220_ooi_g_ls9.fits.fz c4d_140814_032326_ooi_z_ls9-N29 z expnum 347693 exptime 250.0 propid 2014B-0404 seeing 1.05 MJD 56883.138 object DECaLS_43529_z decam/CP/V4.8.2a/CP20140813/c4d_140814_032326_ooi_z_ls9.fits.fz c4d_140815_022529_ooi_r_ls9-S28 r expnum 347941 exptime 85.0 propid 2014B-0404 seeing 1.25 MJD 56884.099 object DECaLS_43510_r decam/CP/V4.8.2a/CP20140814/c4d_140815_022529_ooi_r_ls9.fits.fz c4d_180901_052159_ooi_z_ls9-S28 z expnum 767577 exptime 156.0 propid 2014B-0404 seeing 1.66 MJD 58362.224 object DECaLS_43510_z decam/CP/V4.8.2a/CP20180831/c4d_180901_052159_ooi_z_ls9.fits.fz c4d_170723_040610_ooi_g_ls9-S28 g expnum 661243 exptime 200.0 propid 2014B-0404 seeing 1.78 MJD 57957.168 object DECaLS_43510_g decam/CP/V4.8.2a/CP20170722/c4d_170723_040610_ooi_g_ls9.fits.fz c4d_180908_020624_ooi_g_ls9-S28 g expnum 770548 exptime 89.0 propid 2014B-0404 seeing 1.21 MJD 58369.088 object DECaLS_43510_g decam/CP/V4.8.2a/CP20180907/c4d_180908_020624_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T025342_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T020740_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T035740_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T024553_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T031823_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T041805_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T050100_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140816T023552_oi[N27,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954793b-r-20140815T022313_oi[S28,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T020624_oi[S28,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T052159_oi[S28,noinherit][2046,4094][real]: DECaLS_4351 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T040156_oi[S28,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 83.53 s, CPU: 0.96 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.180476 MB Stage tims finished: 2020-08-10T07:57:05.038528 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T050100_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T031823_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T041805_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140816T023552_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T025342_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T020624_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T035740_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170723T040156_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T020740_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T052159_oi[S28,noinherit][2046,4094][real]: DECaLS_4351 [astropy.io.fits.card] Resources for stage tims : 6.222 s worker CPU, 390.051 s worker Wall, Wall: 83.535 s, Cores in use: 0.09, Total efficiency (on 8 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T024553_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954793b-r-20140815T022313_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-10T07:57:05.062913 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05424.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05425.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05553.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05297.fits Matched 2 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/metrics/cus/reference-custom-318129p07305.fits Stage refs : Wall: 13.75 s, CPU: 5.03 s, VmPeak: 1068 MB, VmSize: 1062 MB, VmRSS: 235 MB, VmData: 267 MB, maxrss: 0.240944 MB Stage refs finished: 2020-08-10T07:57:18.815053 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.753 s, Cores in use: 0.37, Total efficiency (on 8 cores): 4.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T07:57:19.128704 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/metrics/cus/outlier-mask-custom-318129p07305.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/metrics/cus/outliers-pre-custom-318129p07305.jpg Image c4d_180908_020624_ooi_g_ls9-S28 g : masking 404 positive outlier pixels and 0 negative outlier pixels Image c4d_170723_040610_ooi_g_ls9-S28 g : masking 2609 positive outlier pixels and 147 negative outlier pixels Image c4d_140816_023848_ooi_g_ls9-N27 g : masking 1049 positive outlier pixels and 0 negative outlier pixels Image c4d_140818_024809_ooi_r_ls9-N26 r : masking 1362 positive outlier pixels and 0 negative outlier pixels Image c4d_140816_025604_ooi_r_ls9-N27 r : masking 205 positive outlier pixels and 0 negative outlier pixels Image c4d_140814_032326_ooi_z_ls9-N29 z : masking 1880 positive outlier pixels and 0 negative outlier pixels Image c4d_180901_052159_ooi_z_ls9-S28 z : masking 11047 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/metrics/cus/outlier-mask-custom-318129p07305.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/metrics/cus/outliers-post-custom-318129p07305.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/metrics/cus/outliers-masked-pos-custom-318129p07305.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/metrics/cus/outliers-masked-neg-custom-318129p07305.jpg Stage outliers : Wall: 2.01 s, CPU: 0.73 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 248 MB, VmData: 277 MB, maxrss: 0.2542 MB Stage outliers finished: 2020-08-10T07:57:21.139729 Resources for stage outliers : 0.951 s worker CPU, 0.951 s worker Wall, Wall: 2.012 s, Cores in use: 0.83, Total efficiency (on 8 cores): 10.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T07:57:21.164794 Stage halos : Wall: 0.48 s, CPU: 0.31 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 249 MB, VmData: 277 MB, maxrss: 0.254548 MB Stage halos finished: 2020-08-10T07:57:21.646509 Resources for stage halos : 0.762 s worker CPU, 1.191 s worker Wall, Wall: 0.483 s, Cores in use: 2.21, Total efficiency (on 8 cores): 27.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T07:57:21.701367 PSF sigmas in coadd pixels: ['1.65', '2.82', '2.93', '2.90', '1.96'] Using average PSF sigma 2.453299222857567 Gaussian PSF norm 0.11498588885757616 vs pixelized 0.09080807 average tim pixel scale / coadd scale: 1.0011569491964374 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.56', '1.97', '2.04'] Using average PSF sigma 1.853231704197164 Gaussian PSF norm 0.1522177670147749 vs pixelized 0.12658045 average tim pixel scale / coadd scale: 1.0011824428189176 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.32', '1.54', '1.70', '2.70'] Using average PSF sigma 1.814215732275854 Gaussian PSF norm 0.15549131602998648 vs pixelized 0.123009324 average tim pixel scale / coadd scale: 1.0011036125392092 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.16 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.256016 MB Stage fit_on_coadds finished: 2020-08-10T07:57:21.881588 Resources for stage fit_on_coadds : 0.293 s worker CPU, 0.293 s worker Wall, Wall: 0.181 s, Cores in use: 2.50, Total efficiency (on 8 cores): 31.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T07:57:21.891530 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 105 potential peaks Of 105 potential peaks: 82 in veto map, 10 cut by saddle test, 0 cut by aper test, 13 kept SED z : 13 new peaks Found 138 potential peaks Of 138 potential peaks: 126 in veto map, 8 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 120 potential peaks Of 120 potential peaks: 111 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 164 potential peaks Of 164 potential peaks: 152 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 201 potential peaks Of 201 potential peaks: 191 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 21 new sources Median coadd sky for g : 0.00020595307 Median coadd sky for r : 0.00033700414 Median coadd sky for z : 0.00067870045 Stage srcs : Wall: 0.58 s, CPU: 0.54 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 251 MB, VmData: 277 MB, maxrss: 0.25654 MB Stage srcs finished: 2020-08-10T07:57:22.470580 Resources for stage srcs : 0.100 s worker CPU, 0.100 s worker Wall, Wall: 0.580 s, Cores in use: 1.11, Total efficiency (on 8 cores): 13.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T07:57:22.481575 Blob 1 of 4, id: 0, sources: 22, size: 229x239, npix 41120, brick X: 0,229, Y: 0,239, one pixel: 5 0 Blob 2 of 4, id: 2, sources: 1, size: 22x36, npix 628, brick X: 217,239, Y: 193,229, one pixel: 225 193 Blob 3 of 4, id: 3, sources: 1, size: 23x20, npix 295, brick X: 180,203, Y: 219,239, one pixel: 189 219 Blob 4 of 4, id: 1, sources: 1, size: 18x18, npix 171, brick X: 220,238, Y: 24,42, one pixel: 229 24 Blob 4 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 941 MB, VmSize: 723 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142336 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145044 MB Blob 2 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 966 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144484 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (318.15971, 7.30919), pm (-0.2, -6.5), parallax 0.116 with NanoMaggies: g=14.2, r=12.8, z=11.7 Reset brightness to NanoMaggies: g=14.2, r=12.8, z=11.7 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.944394, ee1=-0.153966, ee2=-0.0687386 Measuring 22 iterative sources Blob 1 finished, total: Wall: 34.57 s, CPU: 34.56 s, VmPeak: 945 MB, VmSize: 729 MB, VmRSS: 154 MB, VmData: 184 MB, maxrss: 0.157312 MB Old catalog: 34 New catalog: 45 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/metrics/cus/blobs-custom-318129p07305.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/metrics/cus/all-models-custom-318129p07305.fits Stage fitblobs : Wall: 34.91 s, CPU: 0.30 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 251 MB, VmData: 277 MB, maxrss: 0.257192 MB Stage fitblobs finished: 2020-08-10T07:57:57.394514 Resources for stage fitblobs : 35.995 s worker CPU, 36.018 s worker Wall, Wall: 34.914 s, Cores in use: 1.04, Total efficiency (on 8 cores): 13.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T07:57:57.407406 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-resid.jpg Stage coadds : Wall: 2.58 s, CPU: 0.80 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 252 MB, VmData: 277 MB, maxrss: 0.257552 MB Stage coadds finished: 2020-08-10T07:57:59.983237 Resources for stage coadds : 4.489 s worker CPU, 4.736 s worker Wall, Wall: 2.577 s, Cores in use: 2.05, Total efficiency (on 8 cores): 25.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T07:57:59.996467 Cut to 1 unWISE tiles Reading WISE tile 3188p075 band 1 Reading WISE tile 3188p075 band 2 Reading WISE tile 3188p075 band 3 Reading WISE tile 3188p075 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 945 MB, VmSize: 812 MB, VmRSS: 159 MB, VmData: 183 MB, maxrss: 0.22388 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 966 MB, VmSize: 805 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.192464 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 964 MB, VmSize: 796 MB, VmRSS: 138 MB, VmData: 171 MB, maxrss: 0.200524 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/318/3188p075/unwise-3188p075-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 968 MB, VmSize: 803 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210508 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/tmp-legacysurvey-custom-318129p07305-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.01 s, CPU: 0.49 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 252 MB, VmData: 277 MB, maxrss: 0.258064 MB Stage wise_forced finished: 2020-08-10T07:58:02.010824 Resources for stage wise_forced : 3.601 s worker CPU, 4.634 s worker Wall, Wall: 2.015 s, Cores in use: 2.03, Total efficiency (on 8 cores): 25.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T07:58:02.027508 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/coadd/cus/custom-318129p07305/legacysurvey-custom-318129p07305-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/tractor-i/cus/tractor-custom-318129p07305.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/tractor/cus/tractor-custom-318129p07305.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/tractor/cus/brick-custom-318129p07305.sha256sum Stage writecat : Wall: 1.38 s, CPU: 0.90 s, VmPeak: 1204 MB, VmSize: 1076 MB, VmRSS: 254 MB, VmData: 277 MB, maxrss: 0.390948 MB Stage writecat finished: 2020-08-10T07:58:03.409588 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.383 s, Cores in use: 0.65, Total efficiency (on 8 cores): 8.1 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1318650/PGC1318650-largegalaxy-writecat.p All done: 52.414 s worker CPU, 437.977 s worker Wall, Wall: 141.955 s, Cores in use: 0.44, Total efficiency (on 8 cores): 5.5 % Finished galaxy PGC1318650 in 2.402 minutes.