Started working on galaxy PGC1366475 at Wed Aug 5 19:21:59 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.11215 9.5342 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:22:01.229730 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.11215', '9.5342', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.11215 9.5342 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 323.11215 9.5342 Starting process 6243 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 6244 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 6245 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 6246 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 6247 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 6248 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 6249 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 6250 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 6251 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 6252 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 6253 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 6254 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 6255 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 6256 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 6257 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 6258 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:22:02.407372 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 16 CCDs: c4d_180619_075554_ooi_g_ls9-N3 g expnum 754095 exptime 190.0 propid 2014B-0404 seeing 1.30 MJD 58288.330 object DECaLS_11850_g decam/CP/V4.8.2a/CP20180618/c4d_180619_075554_ooi_g_ls9.fits.fz c4d_140817_040200_ooi_g_ls9-N3 g expnum 348780 exptime 86.0 propid 2014B-0404 seeing 1.53 MJD 56886.166 object DECaLS_11850_g decam/CP/V4.8.2a/CP20140816/c4d_140817_040200_ooi_g_ls9.fits.fz c4d_140816_034159_ooi_r_ls9-N3 r expnum 348331 exptime 67.0 propid 2014B-0404 seeing 0.92 MJD 56885.153 object DECaLS_11850_r decam/CP/V4.8.2a/CP20140815/c4d_140816_034159_ooi_r_ls9.fits.fz c4d_140816_043111_ooi_z_ls9-N3 z expnum 348352 exptime 115.0 propid 2014B-0404 seeing 0.84 MJD 56885.186 object DECaLS_11850_z decam/CP/V4.8.2a/CP20140815/c4d_140816_043111_ooi_z_ls9.fits.fz c4d_140818_030703_ooi_r_ls9-N2 r expnum 349234 exptime 66.0 propid 2014B-0404 seeing 1.14 MJD 56887.129 object DECaLS_27722_r decam/CP/V4.8.2a/CP20140817/c4d_140818_030703_ooi_r_ls9.fits.fz c4d_140818_040133_ooi_g_ls9-N2 g expnum 349261 exptime 73.0 propid 2014B-0404 seeing 1.60 MJD 56887.166 object DECaLS_27722_g decam/CP/V4.8.2a/CP20140817/c4d_140818_040133_ooi_g_ls9.fits.fz c4d_160813_041612_ooi_z_ls9-N2 z expnum 563541 exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 57613.176 object DECaLS_27722_z decam/CP/V4.8.2a/CP20160812/c4d_160813_041612_ooi_z_ls9.fits.fz c4d_170721_044755_ooi_g_ls9-N1 g expnum 660441 exptime 186.0 propid 2014B-0404 seeing 1.34 MJD 57955.197 object DECaLS_43594_g decam/CP/V4.8.2/CP20170720/c4d_170721_044755_ooi_g_ls9.fits.fz c4d_140814_043704_ooi_z_ls9-N1 z expnum 347709 exptime 238.0 propid 2014B-0404 seeing 1.04 MJD 56883.189 object DECaLS_43594_z decam/CP/V4.8.2a/CP20140813/c4d_140814_043704_ooi_z_ls9.fits.fz c4d_140815_032542_ooi_r_ls9-N1 r expnum 347970 exptime 85.0 propid 2014B-0404 seeing 1.14 MJD 56884.141 object DECaLS_43594_r decam/CP/V4.8.2a/CP20140814/c4d_140815_032542_ooi_r_ls9.fits.fz c4d_140818_022259_ooi_g_ls9-N7 g expnum 349212 exptime 82.0 propid 2014B-0404 seeing 1.88 MJD 56887.098 object DECaLS_27721_g decam/CP/V4.8.2a/CP20140817/c4d_140818_022259_ooi_g_ls9.fits.fz c4d_160724_054223_ooi_z_ls9-N7 z expnum 554191 exptime 80.0 propid 2016A-0190 seeing 1.60 MJD 57593.236 object DECaLS_27721_z decam/CP/V4.8.2a/CP20160723/c4d_160724_054223_ooi_z_ls9.fits.fz c4d_140818_030004_ooi_r_ls9-N7 r expnum 349230 exptime 66.0 propid 2014B-0404 seeing 1.44 MJD 56887.124 object DECaLS_27721_r decam/CP/V4.8.2a/CP20140817/c4d_140818_030004_ooi_r_ls9.fits.fz c4d_140814_040021_ooi_z_ls9-N6 z expnum 347701 exptime 237.0 propid 2014B-0404 seeing 1.05 MJD 56883.164 object DECaLS_43593_z decam/CP/V4.8.2a/CP20140813/c4d_140814_040021_ooi_z_ls9.fits.fz c4d_140815_031220_ooi_r_ls9-N6 r expnum 347963 exptime 85.0 propid 2014B-0404 seeing 1.22 MJD 56884.132 object DECaLS_43593_r decam/CP/V4.8.2a/CP20140814/c4d_140815_031220_ooi_r_ls9.fits.fz c4d_170728_044556_ooi_g_ls9-N6 g expnum 662859 exptime 153.0 propid 2014B-0404 seeing 1.38 MJD 57962.196 object DECaLS_43593_g decam/CP/V4.8.2a/CP20170727/c4d_170728_044556_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T043213_oi[N1,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140817T035942_oi[N3,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T025803_oi[N7,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T041400_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T032324_oi[N1,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T044230_oi[N6,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T022043_oi[N7,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T054012_oi[N7,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T031003_oi[N6,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T035927_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T030503_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T034002_oi[N3,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T042823_oi[N3,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T044357_oi[N1,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180619T075554_oi[N3,noinherit][2046,4094][real]: DECaLS_1 Clipping 121 pixels with anomalously large oow values: max 0.0187253 vs median 0.0123103 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T035534_oi[N6,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 50.36 s, CPU: 1.10 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 183 MB, VmData: 216 MB, maxrss: 0.18784 MB Stage tims finished: 2020-08-05T19:22:52.763593 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140817T035942_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T041400_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T025803_oi[N7,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T032324_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T044230_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T054012_oi[N7,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T022043_oi[N7,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T031003_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T030503_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T034002_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T042823_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T044357_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T035534_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 11.237 s worker CPU, 373.083 s worker Wall, Wall: 50.358 s, Cores in use: 0.25, Total efficiency (on 16 cores): 1.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T043213_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T035927_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180619T075554_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:22:53.045793 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05171.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05170.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05299.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05043.fits Matched 0 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/reference-custom-323112p09534.fits Stage refs : Wall: 11.00 s, CPU: 4.21 s, VmPeak: 1070 MB, VmSize: 1065 MB, VmRSS: 238 MB, VmData: 268 MB, maxrss: 0.24368 MB Stage refs finished: 2020-08-05T19:23:04.042217 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.998 s, Cores in use: 0.38, Total efficiency (on 16 cores): 2.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:23:04.159938 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outlier-mask-custom-323112p09534.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outliers-pre-custom-323112p09534.jpg Image c4d_180619_075554_ooi_g_ls9-N3 g : masking 203 positive outlier pixels and 0 negative outlier pixels Image c4d_170728_044556_ooi_g_ls9-N6 g : masking 405 positive outlier pixels and 0 negative outlier pixels Image c4d_140816_034159_ooi_r_ls9-N3 r : masking 572 positive outlier pixels and 0 negative outlier pixels Image c4d_140815_031220_ooi_r_ls9-N6 r : masking 295 positive outlier pixels and 0 negative outlier pixels Image c4d_140814_043704_ooi_z_ls9-N1 z : masking 0 positive outlier pixels and 101 negative outlier pixels Image c4d_160724_054223_ooi_z_ls9-N7 z : masking 124 positive outlier pixels and 0 negative outlier pixels Image c4d_140816_043111_ooi_z_ls9-N3 z : masking 81 positive outlier pixels and 0 negative outlier pixels Image c4d_140814_040021_ooi_z_ls9-N6 z : masking 0 positive outlier pixels and 1042 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outlier-mask-custom-323112p09534.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outliers-post-custom-323112p09534.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outliers-masked-pos-custom-323112p09534.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outliers-masked-neg-custom-323112p09534.jpg Stage outliers : Wall: 2.82 s, CPU: 2.40 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 256 MB, VmData: 284 MB, maxrss: 0.26244 MB Stage outliers finished: 2020-08-05T19:23:06.977872 Resources for stage outliers : 1.201 s worker CPU, 1.201 s worker Wall, Wall: 2.819 s, Cores in use: 1.28, Total efficiency (on 16 cores): 8.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:23:07.194028 Stage halos : Wall: 1.59 s, CPU: 1.40 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 257 MB, VmData: 284 MB, maxrss: 0.26274 MB Stage halos finished: 2020-08-05T19:23:08.781194 Resources for stage halos : 0.619 s worker CPU, 2.332 s worker Wall, Wall: 1.589 s, Cores in use: 1.27, Total efficiency (on 16 cores): 8.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:23:08.847402 PSF sigmas in coadd pixels: ['2.11', '2.48', '2.60', '2.17', '3.05', '2.25'] Using average PSF sigma 2.4428973653916493 Gaussian PSF norm 0.11547549879511712 vs pixelized 0.096927986 average tim pixel scale / coadd scale: 1.0011810598315543 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.50', '1.85', '1.85', '2.33', '1.98'] Using average PSF sigma 1.902512848908832 Gaussian PSF norm 0.14827484184176254 vs pixelized 0.124009706 average tim pixel scale / coadd scale: 1.0011839624387673 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.37', '1.63', '1.68', '2.59', '1.71'] Using average PSF sigma 1.7957391297893193 Gaussian PSF norm 0.15709118718539827 vs pixelized 0.124378316 average tim pixel scale / coadd scale: 1.0011016630269018 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.22 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 258 MB, VmData: 284 MB, maxrss: 0.26422 MB Stage fit_on_coadds finished: 2020-08-05T19:23:09.089849 Resources for stage fit_on_coadds : 0.268 s worker CPU, 0.268 s worker Wall, Wall: 0.244 s, Cores in use: 2.02, Total efficiency (on 16 cores): 12.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:23:09.102586 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 180 potential peaks Of 180 potential peaks: 153 in veto map, 12 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 196 potential peaks Of 196 potential peaks: 183 in veto map, 12 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 86 potential peaks Of 86 potential peaks: 79 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 134 potential peaks Of 134 potential peaks: 123 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 193 potential peaks Of 193 potential peaks: 175 in veto map, 16 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 22 new sources Median coadd sky for g : 0.0002919807 Median coadd sky for r : 0.0009804787 Median coadd sky for z : 0.0021010283 Stage srcs : Wall: 1.11 s, CPU: 1.07 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 259 MB, VmData: 284 MB, maxrss: 0.264752 MB Stage srcs finished: 2020-08-05T19:23:10.213037 Resources for stage srcs : 0.064 s worker CPU, 0.064 s worker Wall, Wall: 1.112 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:23:10.224881 Blob 1 of 1, id: 0, sources: 27, size: 245x245, npix 53769, brick X: 0,245, Y: 0,245, one pixel: 9 0 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.48018, ee1=-0.0109285, ee2=0.0112837 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.11000, 9.54346), pm (-0.2, -4.1), parallax 0.031 with NanoMaggies: g=20.2, r=19.4, z=19.4 Reset brightness to NanoMaggies: g=19.7, r=19, z=18.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.11274, 9.54435), pm (-5.8, -8.1), parallax 2.284 with NanoMaggies: g=17.9, r=16.5, z=16.4 Reset brightness to NanoMaggies: g=21.7, r=20.3, z=19.3 Measuring 25 iterative sources Blob 1 finished, total: Wall: 53.51 s, CPU: 53.49 s, VmPeak: 956 MB, VmSize: 753 MB, VmRSS: 174 MB, VmData: 201 MB, maxrss: 0.177812 MB Old catalog: 31 New catalog: 48 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/blobs-custom-323112p09534.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/all-models-custom-323112p09534.fits Stage fitblobs : Wall: 56.38 s, CPU: 0.43 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 260 MB, VmData: 285 MB, maxrss: 0.266348 MB Stage fitblobs finished: 2020-08-05T19:24:06.605196 Resources for stage fitblobs : 53.521 s worker CPU, 53.543 s worker Wall, Wall: 56.382 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:24:06.636976 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-resid.jpg Stage coadds : Wall: 3.00 s, CPU: 1.83 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 260 MB, VmData: 285 MB, maxrss: 0.266696 MB Stage coadds finished: 2020-08-05T19:24:09.632447 Resources for stage coadds : 8.152 s worker CPU, 10.397 s worker Wall, Wall: 2.997 s, Cores in use: 3.33, Total efficiency (on 16 cores): 20.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T19:24:09.650943 Cut to 1 unWISE tiles Reading WISE tile 3232p090 band 1 Reading WISE tile 3232p090 band 2 Reading WISE tile 3232p090 band 4 Reading WISE tile 3232p090 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 950 MB, VmSize: 807 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.192108 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 953 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207024 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 952 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207248 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207276 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.35 s, CPU: 0.74 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 261 MB, VmData: 285 MB, maxrss: 0.267208 MB Stage wise_forced finished: 2020-08-05T19:24:11.998448 Resources for stage wise_forced : 3.457 s worker CPU, 5.040 s worker Wall, Wall: 2.349 s, Cores in use: 1.79, Total efficiency (on 16 cores): 11.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:24:12.015156 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/tractor-i/cus/tractor-custom-323112p09534.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/tractor/cus/tractor-custom-323112p09534.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/tractor/cus/brick-custom-323112p09534.sha256sum Stage writecat : Wall: 0.98 s, CPU: 0.73 s, VmPeak: 1207 MB, VmSize: 1079 MB, VmRSS: 263 MB, VmData: 285 MB, maxrss: 0.400084 MB Stage writecat finished: 2020-08-05T19:24:12.990800 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.977 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-writecat.p All done: 78.521 s worker CPU, 445.931 s worker Wall, Wall: 130.602 s, Cores in use: 0.71, Total efficiency (on 16 cores): 4.4 % Finished galaxy PGC1366475 in 2.234 minutes. Started working on galaxy PGC1366475 at Wed Aug 5 19:26:56 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.11215 9.5342 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:27:00.431544 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.11215', '9.5342', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.11215 9.5342 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 323.11215 9.5342 Starting process 7436 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 7437 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 7438 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 7439 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 7440 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0594 MB Starting process 7441 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 7442 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 7443 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 7444 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 7445 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 7446 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 7447 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 7448 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 7449 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 7450 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 7451 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 7452 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 7453 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 7454 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 7455 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 7456 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 7457 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 7458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 7460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 7461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 7459 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 7462 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 7463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 7464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 7465 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 7466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 7467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:27:01.703168 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 16 CCDs: c4d_180619_075554_ooi_g_ls9-N3 g expnum 754095 exptime 190.0 propid 2014B-0404 seeing 1.30 MJD 58288.330 object DECaLS_11850_g decam/CP/V4.8.2a/CP20180618/c4d_180619_075554_ooi_g_ls9.fits.fz c4d_140817_040200_ooi_g_ls9-N3 g expnum 348780 exptime 86.0 propid 2014B-0404 seeing 1.53 MJD 56886.166 object DECaLS_11850_g decam/CP/V4.8.2a/CP20140816/c4d_140817_040200_ooi_g_ls9.fits.fz c4d_140816_034159_ooi_r_ls9-N3 r expnum 348331 exptime 67.0 propid 2014B-0404 seeing 0.92 MJD 56885.153 object DECaLS_11850_r decam/CP/V4.8.2a/CP20140815/c4d_140816_034159_ooi_r_ls9.fits.fz c4d_140816_043111_ooi_z_ls9-N3 z expnum 348352 exptime 115.0 propid 2014B-0404 seeing 0.84 MJD 56885.186 object DECaLS_11850_z decam/CP/V4.8.2a/CP20140815/c4d_140816_043111_ooi_z_ls9.fits.fz c4d_140818_030703_ooi_r_ls9-N2 r expnum 349234 exptime 66.0 propid 2014B-0404 seeing 1.14 MJD 56887.129 object DECaLS_27722_r decam/CP/V4.8.2a/CP20140817/c4d_140818_030703_ooi_r_ls9.fits.fz c4d_140818_040133_ooi_g_ls9-N2 g expnum 349261 exptime 73.0 propid 2014B-0404 seeing 1.60 MJD 56887.166 object DECaLS_27722_g decam/CP/V4.8.2a/CP20140817/c4d_140818_040133_ooi_g_ls9.fits.fz c4d_160813_041612_ooi_z_ls9-N2 z expnum 563541 exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 57613.176 object DECaLS_27722_z decam/CP/V4.8.2a/CP20160812/c4d_160813_041612_ooi_z_ls9.fits.fz c4d_170721_044755_ooi_g_ls9-N1 g expnum 660441 exptime 186.0 propid 2014B-0404 seeing 1.34 MJD 57955.197 object DECaLS_43594_g decam/CP/V4.8.2/CP20170720/c4d_170721_044755_ooi_g_ls9.fits.fz c4d_140814_043704_ooi_z_ls9-N1 z expnum 347709 exptime 238.0 propid 2014B-0404 seeing 1.04 MJD 56883.189 object DECaLS_43594_z decam/CP/V4.8.2a/CP20140813/c4d_140814_043704_ooi_z_ls9.fits.fz c4d_140815_032542_ooi_r_ls9-N1 r expnum 347970 exptime 85.0 propid 2014B-0404 seeing 1.14 MJD 56884.141 object DECaLS_43594_r decam/CP/V4.8.2a/CP20140814/c4d_140815_032542_ooi_r_ls9.fits.fz c4d_140818_022259_ooi_g_ls9-N7 g expnum 349212 exptime 82.0 propid 2014B-0404 seeing 1.88 MJD 56887.098 object DECaLS_27721_g decam/CP/V4.8.2a/CP20140817/c4d_140818_022259_ooi_g_ls9.fits.fz c4d_160724_054223_ooi_z_ls9-N7 z expnum 554191 exptime 80.0 propid 2016A-0190 seeing 1.60 MJD 57593.236 object DECaLS_27721_z decam/CP/V4.8.2a/CP20160723/c4d_160724_054223_ooi_z_ls9.fits.fz c4d_140818_030004_ooi_r_ls9-N7 r expnum 349230 exptime 66.0 propid 2014B-0404 seeing 1.44 MJD 56887.124 object DECaLS_27721_r decam/CP/V4.8.2a/CP20140817/c4d_140818_030004_ooi_r_ls9.fits.fz c4d_140814_040021_ooi_z_ls9-N6 z expnum 347701 exptime 237.0 propid 2014B-0404 seeing 1.05 MJD 56883.164 object DECaLS_43593_z decam/CP/V4.8.2a/CP20140813/c4d_140814_040021_ooi_z_ls9.fits.fz c4d_140815_031220_ooi_r_ls9-N6 r expnum 347963 exptime 85.0 propid 2014B-0404 seeing 1.22 MJD 56884.132 object DECaLS_43593_r decam/CP/V4.8.2a/CP20140814/c4d_140815_031220_ooi_r_ls9.fits.fz c4d_170728_044556_ooi_g_ls9-N6 g expnum 662859 exptime 153.0 propid 2014B-0404 seeing 1.38 MJD 57962.196 object DECaLS_43593_g decam/CP/V4.8.2a/CP20170727/c4d_170728_044556_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T041400_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T044357_oi[N1,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T044230_oi[N6,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T034002_oi[N3,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T032324_oi[N1,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T025803_oi[N7,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T043213_oi[N1,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T031003_oi[N6,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T054012_oi[N7,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T022043_oi[N7,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T042823_oi[N3,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T035927_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T030503_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140817T035942_oi[N3,noinherit][2046,4094][real]: DECaLS_1 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180619T075554_oi[N3,noinherit][2046,4094][real]: DECaLS_1 Clipping 121 pixels with anomalously large oow values: max 0.0187253 vs median 0.0123103 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T035534_oi[N6,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 66.87 s, CPU: 1.92 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 183 MB, VmData: 216 MB, maxrss: 0.187748 MB Stage tims finished: 2020-08-05T19:28:08.570121 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T044230_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T032324_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T025803_oi[N7,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T042823_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T022043_oi[N7,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T043213_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T035927_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T030503_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 10.004 s worker CPU, 439.425 s worker Wall, Wall: 66.869 s, Cores in use: 0.18, Total efficiency (on 32 cores): 0.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T044357_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T031003_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140817T035942_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T035534_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180619T075554_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:28:08.640583 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05171.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05170.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05299.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05043.fits Matched 0 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/reference-custom-323112p09534.fits Stage refs : Wall: 10.43 s, CPU: 5.21 s, VmPeak: 1070 MB, VmSize: 1065 MB, VmRSS: 238 MB, VmData: 268 MB, maxrss: 0.243508 MB Stage refs finished: 2020-08-05T19:28:19.070304 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T041400_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T054012_oi[N7,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 10.432 s, Cores in use: 0.50, Total efficiency (on 32 cores): 1.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-refs.p Running stage outliers WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T034002_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage outliers at 2020-08-05T19:28:19.292721 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outlier-mask-custom-323112p09534.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outliers-pre-custom-323112p09534.jpg Image c4d_170728_044556_ooi_g_ls9-N6 g : masking 405 positive outlier pixels and 0 negative outlier pixels Image c4d_180619_075554_ooi_g_ls9-N3 g : masking 203 positive outlier pixels and 0 negative outlier pixels Image c4d_140816_034159_ooi_r_ls9-N3 r : masking 572 positive outlier pixels and 0 negative outlier pixels Image c4d_140815_031220_ooi_r_ls9-N6 r : masking 295 positive outlier pixels and 0 negative outlier pixels Image c4d_140816_043111_ooi_z_ls9-N3 z : masking 81 positive outlier pixels and 0 negative outlier pixels Image c4d_140814_043704_ooi_z_ls9-N1 z : masking 0 positive outlier pixels and 101 negative outlier pixels Image c4d_160724_054223_ooi_z_ls9-N7 z : masking 124 positive outlier pixels and 0 negative outlier pixels Image c4d_140814_040021_ooi_z_ls9-N6 z : masking 0 positive outlier pixels and 1042 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outlier-mask-custom-323112p09534.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outliers-post-custom-323112p09534.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outliers-masked-pos-custom-323112p09534.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/outliers-masked-neg-custom-323112p09534.jpg Stage outliers : Wall: 1.42 s, CPU: 0.91 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 255 MB, VmData: 282 MB, maxrss: 0.260836 MB Stage outliers finished: 2020-08-05T19:28:20.711922 Resources for stage outliers : 1.698 s worker CPU, 2.178 s worker Wall, Wall: 1.422 s, Cores in use: 1.84, Total efficiency (on 32 cores): 5.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:28:20.754820 Stage halos : Wall: 0.58 s, CPU: 0.48 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 255 MB, VmData: 283 MB, maxrss: 0.261016 MB Stage halos finished: 2020-08-05T19:28:21.336750 Resources for stage halos : 0.802 s worker CPU, 1.200 s worker Wall, Wall: 0.584 s, Cores in use: 2.20, Total efficiency (on 32 cores): 6.9 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:28:21.386286 PSF sigmas in coadd pixels: ['2.11', '2.48', '2.60', '2.17', '3.05', '2.25'] Using average PSF sigma 2.4428973653916493 Gaussian PSF norm 0.11547549879511712 vs pixelized 0.096927986 average tim pixel scale / coadd scale: 1.0011810598315543 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.50', '1.85', '1.85', '2.33', '1.98'] Using average PSF sigma 1.902512848908832 Gaussian PSF norm 0.14827484184176254 vs pixelized 0.124009706 average tim pixel scale / coadd scale: 1.0011839624387673 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.37', '1.63', '1.68', '2.59', '1.71'] Using average PSF sigma 1.7957391297893193 Gaussian PSF norm 0.15709118718539827 vs pixelized 0.1243783 average tim pixel scale / coadd scale: 1.0011016630269018 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.24 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 258 MB, VmData: 284 MB, maxrss: 0.26414 MB Stage fit_on_coadds finished: 2020-08-05T19:28:21.632440 Resources for stage fit_on_coadds : 0.258 s worker CPU, 0.258 s worker Wall, Wall: 0.249 s, Cores in use: 2.00, Total efficiency (on 32 cores): 6.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:28:21.668341 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 180 potential peaks Of 180 potential peaks: 153 in veto map, 12 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 196 potential peaks Of 196 potential peaks: 183 in veto map, 12 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 86 potential peaks Of 86 potential peaks: 79 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 134 potential peaks Of 134 potential peaks: 123 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 193 potential peaks Of 193 potential peaks: 175 in veto map, 16 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 22 new sources Median coadd sky for g : 0.00029198074 Median coadd sky for r : 0.0009804785 Median coadd sky for z : 0.0021010288 Stage srcs : Wall: 0.74 s, CPU: 0.71 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 259 MB, VmData: 284 MB, maxrss: 0.264756 MB Stage srcs finished: 2020-08-05T19:28:22.412679 Resources for stage srcs : 0.086 s worker CPU, 0.086 s worker Wall, Wall: 0.747 s, Cores in use: 1.07, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:28:22.427389 Blob 1 of 1, id: 0, sources: 27, size: 245x245, npix 53769, brick X: 0,245, Y: 0,245, one pixel: 9 0 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.48018, ee1=-0.0109285, ee2=0.0112838 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.11000, 9.54346), pm (-0.2, -4.1), parallax 0.031 with NanoMaggies: g=20.2, r=19.4, z=19.4 Reset brightness to NanoMaggies: g=19.7, r=19, z=18.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.11274, 9.54435), pm (-5.8, -8.1), parallax 2.284 with NanoMaggies: g=17.9, r=16.5, z=16.4 Reset brightness to NanoMaggies: g=21.7, r=20.3, z=19.3 Measuring 25 iterative sources Blob 1 finished, total: Wall: 54.85 s, CPU: 54.84 s, VmPeak: 950 MB, VmSize: 753 MB, VmRSS: 174 MB, VmData: 201 MB, maxrss: 0.17778 MB Old catalog: 31 New catalog: 48 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/blobs-custom-323112p09534.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/metrics/cus/all-models-custom-323112p09534.fits Stage fitblobs : Wall: 55.40 s, CPU: 0.49 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 260 MB, VmData: 285 MB, maxrss: 0.266208 MB Stage fitblobs finished: 2020-08-05T19:29:17.832312 Resources for stage fitblobs : 54.871 s worker CPU, 54.886 s worker Wall, Wall: 55.407 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:29:17.869868 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-resid.jpg Stage coadds : Wall: 4.34 s, CPU: 1.75 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 260 MB, VmData: 285 MB, maxrss: 0.2667 MB Stage coadds finished: 2020-08-05T19:29:22.207836 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 25.310 s worker CPU, 40.486 s worker Wall, Wall: 4.340 s, Cores in use: 6.23, Total efficiency (on 32 cores): 19.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:29:22.223612 Cut to 1 unWISE tiles Reading WISE tile 3232p090 band 1 Reading WISE tile 3232p090 band 2 Reading WISE tile 3232p090 band 3 Reading WISE tile 3232p090 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 952 MB, VmSize: 807 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.191352 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 953 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.206928 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 952 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206788 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 953 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206672 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.15 s, CPU: 0.68 s, VmPeak: 1074 MB, VmSize: 1074 MB, VmRSS: 261 MB, VmData: 285 MB, maxrss: 0.267212 MB Stage wise_forced finished: 2020-08-05T19:29:24.376836 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.365 s worker CPU, 4.527 s worker Wall, Wall: 2.155 s, Cores in use: 1.88, Total efficiency (on 32 cores): 5.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:29:24.394482 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/tractor-i/cus/tractor-custom-323112p09534.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/tractor/cus/tractor-custom-323112p09534.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/tractor/cus/brick-custom-323112p09534.sha256sum Stage writecat : Wall: 0.98 s, CPU: 0.75 s, VmPeak: 1207 MB, VmSize: 1079 MB, VmRSS: 263 MB, VmData: 285 MB, maxrss: 0.400088 MB Stage writecat finished: 2020-08-05T19:29:25.373838 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.981 s, Cores in use: 0.77, Total efficiency (on 32 cores): 2.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1366475/PGC1366475-largegalaxy-writecat.p All done: 96.399 s worker CPU, 543.052 s worker Wall, Wall: 143.696 s, Cores in use: 0.76, Total efficiency (on 32 cores): 2.4 % Finished galaxy PGC1366475 in 2.491 minutes. Started working on galaxy PGC1366475 at Mon Aug 10 08:20:35 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.1125969375803 9.534151314087154 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T08:20:36.357529 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.1125969375803', '9.534151314087154', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.1125969375803 9.534151314087154 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 323.1125969375803 9.534151314087154 Starting process 47876 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 47877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 47878 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 47879 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 47880 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB Starting process 47881 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 47882 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 47883 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T08:20:37.024177 Keeping 16 CCDs: c4d_180619_075554_ooi_g_ls9-N3 g expnum 754095 exptime 190.0 propid 2014B-0404 seeing 1.30 MJD 58288.330 object DECaLS_11850_g decam/CP/V4.8.2a/CP20180618/c4d_180619_075554_ooi_g_ls9.fits.fz c4d_140817_040200_ooi_g_ls9-N3 g expnum 348780 exptime 86.0 propid 2014B-0404 seeing 1.53 MJD 56886.166 object DECaLS_11850_g decam/CP/V4.8.2a/CP20140816/c4d_140817_040200_ooi_g_ls9.fits.fz c4d_140816_034159_ooi_r_ls9-N3 r expnum 348331 exptime 67.0 propid 2014B-0404 seeing 0.92 MJD 56885.153 object DECaLS_11850_r decam/CP/V4.8.2a/CP20140815/c4d_140816_034159_ooi_r_ls9.fits.fz c4d_140816_043111_ooi_z_ls9-N3 z expnum 348352 exptime 115.0 propid 2014B-0404 seeing 0.84 MJD 56885.186 object DECaLS_11850_z decam/CP/V4.8.2a/CP20140815/c4d_140816_043111_ooi_z_ls9.fits.fz c4d_140818_030703_ooi_r_ls9-N2 r expnum 349234 exptime 66.0 propid 2014B-0404 seeing 1.14 MJD 56887.129 object DECaLS_27722_r decam/CP/V4.8.2a/CP20140817/c4d_140818_030703_ooi_r_ls9.fits.fz c4d_140818_040133_ooi_g_ls9-N2 g expnum 349261 exptime 73.0 propid 2014B-0404 seeing 1.60 MJD 56887.166 object DECaLS_27722_g decam/CP/V4.8.2a/CP20140817/c4d_140818_040133_ooi_g_ls9.fits.fz c4d_160813_041612_ooi_z_ls9-N2 z expnum 563541 exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 57613.176 object DECaLS_27722_z decam/CP/V4.8.2a/CP20160812/c4d_160813_041612_ooi_z_ls9.fits.fz c4d_170721_044755_ooi_g_ls9-N1 g expnum 660441 exptime 186.0 propid 2014B-0404 seeing 1.34 MJD 57955.197 object DECaLS_43594_g decam/CP/V4.8.2/CP20170720/c4d_170721_044755_ooi_g_ls9.fits.fz c4d_140814_043704_ooi_z_ls9-N1 z expnum 347709 exptime 238.0 propid 2014B-0404 seeing 1.04 MJD 56883.189 object DECaLS_43594_z decam/CP/V4.8.2a/CP20140813/c4d_140814_043704_ooi_z_ls9.fits.fz c4d_140815_032542_ooi_r_ls9-N1 r expnum 347970 exptime 85.0 propid 2014B-0404 seeing 1.14 MJD 56884.141 object DECaLS_43594_r decam/CP/V4.8.2a/CP20140814/c4d_140815_032542_ooi_r_ls9.fits.fz c4d_140818_022259_ooi_g_ls9-N7 g expnum 349212 exptime 82.0 propid 2014B-0404 seeing 1.88 MJD 56887.098 object DECaLS_27721_g decam/CP/V4.8.2a/CP20140817/c4d_140818_022259_ooi_g_ls9.fits.fz c4d_160724_054223_ooi_z_ls9-N7 z expnum 554191 exptime 80.0 propid 2016A-0190 seeing 1.60 MJD 57593.236 object DECaLS_27721_z decam/CP/V4.8.2a/CP20160723/c4d_160724_054223_ooi_z_ls9.fits.fz c4d_140818_030004_ooi_r_ls9-N7 r expnum 349230 exptime 66.0 propid 2014B-0404 seeing 1.44 MJD 56887.124 object DECaLS_27721_r decam/CP/V4.8.2a/CP20140817/c4d_140818_030004_ooi_r_ls9.fits.fz c4d_140814_040021_ooi_z_ls9-N6 z expnum 347701 exptime 237.0 propid 2014B-0404 seeing 1.05 MJD 56883.164 object DECaLS_43593_z decam/CP/V4.8.2a/CP20140813/c4d_140814_040021_ooi_z_ls9.fits.fz c4d_140815_031220_ooi_r_ls9-N6 r expnum 347963 exptime 85.0 propid 2014B-0404 seeing 1.22 MJD 56884.132 object DECaLS_43593_r decam/CP/V4.8.2a/CP20140814/c4d_140815_031220_ooi_r_ls9.fits.fz c4d_170728_044556_ooi_g_ls9-N6 g expnum 662859 exptime 153.0 propid 2014B-0404 seeing 1.38 MJD 57962.196 object DECaLS_43593_g decam/CP/V4.8.2a/CP20170727/c4d_170728_044556_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T042823_oi[N3,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T044357_oi[N1,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T035927_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140817T035942_oi[N3,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T034002_oi[N3,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T041400_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T030503_oi[N2,noinherit][2046,4094][real]: DECaLS_2 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T032324_oi[N1,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T043213_oi[N1,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T022043_oi[N7,noinherit][2046,4094][real]: DECaLS_2 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T054012_oi[N7,noinherit][2046,4094][real]: DECaLS_2 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T031003_oi[N6,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T025803_oi[N7,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180619T075554_oi[N3,noinherit][2046,4094][real]: DECaLS_1 Clipping 124 pixels with anomalously large oow values: max 0.0187253 vs median 0.0123103 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T044230_oi[N6,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T035534_oi[N6,noinherit][2046,4094][real]: DECaLS_4 Stage tims : Wall: 130.80 s, CPU: 0.88 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 182 MB, VmData: 215 MB, maxrss: 0.1859 MB Stage tims finished: 2020-08-10T08:22:47.827227 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d16a-z-20140816T042823_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T031003_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T044357_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T022043_oi[N7,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140817T035942_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T054012_oi[N7,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140818T035927_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T025803_oi[N7,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T034002_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T043213_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180619T075554_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140818T030503_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140814T035534_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T041400_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140815T032324_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T044230_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Resources for stage tims : 7.121 s worker CPU, 763.333 s worker Wall, Wall: 130.804 s, Cores in use: 0.06, Total efficiency (on 8 cores): 0.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-10T08:22:48.012366 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05171.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05170.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05299.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05043.fits Matched 0 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/metrics/cus/reference-custom-323112p09534.fits Stage refs : Wall: 9.77 s, CPU: 4.01 s, VmPeak: 1064 MB, VmSize: 1058 MB, VmRSS: 236 MB, VmData: 267 MB, maxrss: 0.241684 MB Stage refs finished: 2020-08-10T08:22:57.780655 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.769 s, Cores in use: 0.41, Total efficiency (on 8 cores): 5.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T08:22:57.950297 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/metrics/cus/outlier-mask-custom-323112p09534.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/metrics/cus/outliers-pre-custom-323112p09534.jpg Image c4d_170728_044556_ooi_g_ls9-N6 g : masking 405 positive outlier pixels and 0 negative outlier pixels Image c4d_140816_034159_ooi_r_ls9-N3 r : masking 570 positive outlier pixels and 0 negative outlier pixels Image c4d_140815_031220_ooi_r_ls9-N6 r : masking 293 positive outlier pixels and 0 negative outlier pixels Image c4d_160724_054223_ooi_z_ls9-N7 z : masking 108 positive outlier pixels and 0 negative outlier pixels Image c4d_140814_040021_ooi_z_ls9-N6 z : masking 122 positive outlier pixels and 1019 negative outlier pixels Image c4d_140816_043111_ooi_z_ls9-N3 z : masking 159 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/metrics/cus/outlier-mask-custom-323112p09534.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/metrics/cus/outliers-post-custom-323112p09534.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/metrics/cus/outliers-masked-pos-custom-323112p09534.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/metrics/cus/outliers-masked-neg-custom-323112p09534.jpg Stage outliers : Wall: 1.00 s, CPU: 0.81 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 254 MB, VmData: 283 MB, maxrss: 0.25978 MB Stage outliers finished: 2020-08-10T08:22:58.948846 Resources for stage outliers : 1.197 s worker CPU, 1.197 s worker Wall, Wall: 0.999 s, Cores in use: 2.00, Total efficiency (on 8 cores): 25.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T08:22:59.158248 Stage halos : Wall: 0.44 s, CPU: 0.25 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 254 MB, VmData: 283 MB, maxrss: 0.260132 MB Stage halos finished: 2020-08-10T08:22:59.602696 Resources for stage halos : 0.552 s worker CPU, 1.491 s worker Wall, Wall: 0.445 s, Cores in use: 1.81, Total efficiency (on 8 cores): 22.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T08:22:59.840277 PSF sigmas in coadd pixels: ['2.11', '2.48', '2.60', '2.17', '3.05', '2.25'] Using average PSF sigma 2.4428973653916493 Gaussian PSF norm 0.11547549879511712 vs pixelized 0.09692951 average tim pixel scale / coadd scale: 1.0011810598315543 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.50', '1.85', '1.85', '2.33', '1.98'] Using average PSF sigma 1.902512848908832 Gaussian PSF norm 0.14827484184176254 vs pixelized 0.1240136 average tim pixel scale / coadd scale: 1.0011839624387673 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.37', '1.63', '1.68', '2.59', '1.71'] Using average PSF sigma 1.7957391297893193 Gaussian PSF norm 0.15709118718539827 vs pixelized 0.12437936 average tim pixel scale / coadd scale: 1.0011016630269018 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.23 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 255 MB, VmData: 283 MB, maxrss: 0.2616 MB Stage fit_on_coadds finished: 2020-08-10T08:23:00.080017 Resources for stage fit_on_coadds : 0.274 s worker CPU, 0.277 s worker Wall, Wall: 0.241 s, Cores in use: 2.09, Total efficiency (on 8 cores): 26.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T08:23:00.089093 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 178 potential peaks Of 178 potential peaks: 153 in veto map, 11 cut by saddle test, 0 cut by aper test, 14 kept SED z : 14 new peaks Found 198 potential peaks Of 198 potential peaks: 185 in veto map, 12 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 87 potential peaks Of 87 potential peaks: 81 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 131 potential peaks Of 131 potential peaks: 120 in veto map, 8 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 199 potential peaks Of 199 potential peaks: 181 in veto map, 15 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 22 new sources Median coadd sky for g : 0.00026080225 Median coadd sky for r : 0.00094731414 Median coadd sky for z : 0.0018531687 Stage srcs : Wall: 0.62 s, CPU: 0.59 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.262096 MB Stage srcs finished: 2020-08-10T08:23:00.708552 Resources for stage srcs : 0.077 s worker CPU, 0.077 s worker Wall, Wall: 0.620 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T08:23:00.719616 Blob 1 of 1, id: 0, sources: 28, size: 245x245, npix 53768, brick X: 0,245, Y: 0,245, one pixel: 15 0 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.18427, ee1=-0.00402152, ee2=0.00732255 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.11274, 9.54435), pm (-5.8, -8.1), parallax 2.284 with NanoMaggies: g=17.9, r=16.4, z=16.2 Reset brightness to NanoMaggies: g=21.7, r=20.3, z=19.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.10037, 9.53239), pm (22.1, -17.6), parallax 1.807 with NanoMaggies: g=19.4, r=17.9, z=16.2 Reset brightness to NanoMaggies: g=19.4, r=17.9, z=16.2 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.11000, 9.54346), pm (-0.2, -4.1), parallax 0.031 with NanoMaggies: g=19.8, r=19.2, z=19.1 Reset brightness to NanoMaggies: g=19.7, r=19, z=18.7 Measuring 13 iterative sources Blob 1 finished, total: Wall: 30.03 s, CPU: 30.03 s, VmPeak: 965 MB, VmSize: 738 MB, VmRSS: 162 MB, VmData: 193 MB, maxrss: 0.165516 MB Old catalog: 30 New catalog: 32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/metrics/cus/blobs-custom-323112p09534.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/metrics/cus/all-models-custom-323112p09534.fits Stage fitblobs : Wall: 30.46 s, CPU: 0.38 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 257 MB, VmData: 284 MB, maxrss: 0.263488 MB Stage fitblobs finished: 2020-08-10T08:23:31.177790 Resources for stage fitblobs : 30.055 s worker CPU, 30.064 s worker Wall, Wall: 30.459 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T08:23:31.190033 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-resid.jpg Stage coadds : Wall: 1.31 s, CPU: 0.52 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 258 MB, VmData: 284 MB, maxrss: 0.264024 MB Stage coadds finished: 2020-08-10T08:23:32.497036 Resources for stage coadds : 4.387 s worker CPU, 4.676 s worker Wall, Wall: 1.308 s, Cores in use: 3.75, Total efficiency (on 8 cores): 46.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T08:23:32.509754 Cut to 1 unWISE tiles Reading WISE tile 3232p090 band 3 Reading WISE tile 3232p090 band 1 Reading WISE tile 3232p090 band 4 Reading WISE tile 3232p090 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 970 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 176 MB, maxrss: 0.188348 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 965 MB, VmSize: 810 MB, VmRSS: 158 MB, VmData: 182 MB, maxrss: 0.222188 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 936 MB, VmSize: 795 MB, VmRSS: 138 MB, VmData: 170 MB, maxrss: 0.200344 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3232p090/unwise-3232p090-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 963 MB, VmSize: 798 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.20588 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/tmp-legacysurvey-custom-323112p09534-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.56 s, CPU: 0.73 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 258 MB, VmData: 284 MB, maxrss: 0.26454 MB Stage wise_forced finished: 2020-08-10T08:23:35.070571 Resources for stage wise_forced : 3.712 s worker CPU, 5.556 s worker Wall, Wall: 2.562 s, Cores in use: 1.73, Total efficiency (on 8 cores): 21.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T08:23:35.110090 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/coadd/cus/custom-323112p09534/legacysurvey-custom-323112p09534-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/tractor-i/cus/tractor-custom-323112p09534.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/tractor/cus/tractor-custom-323112p09534.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/tractor/cus/brick-custom-323112p09534.sha256sum Stage writecat : Wall: 0.78 s, CPU: 0.58 s, VmPeak: 1200 MB, VmSize: 1072 MB, VmRSS: 260 MB, VmData: 284 MB, maxrss: 0.397416 MB Stage writecat finished: 2020-08-10T08:23:35.889297 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.780 s, Cores in use: 0.75, Total efficiency (on 8 cores): 9.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1366475/PGC1366475-largegalaxy-writecat.p All done: 47.377 s worker CPU, 806.673 s worker Wall, Wall: 178.882 s, Cores in use: 0.32, Total efficiency (on 8 cores): 3.9 % Finished galaxy PGC1366475 in 3.017 minutes.