Started working on galaxy PGC3097563 at Sat Feb 8 08:09:22 2020 RA, Dec=215.030625, 30.399389: run=decam (0 north CCDs, 13 south CCDs). python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 215.03062500000001 30.399388899999998 --width 447 --height 447 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-08T08:09:22.871681 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '215.03062500000001', '30.399388899999998', '--width', '447', '--height', '447', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 215.03062500000001 30.399388899999998 --width 447 --height 447 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 215.03062500000001 30.399388899999998 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 5627 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07116 MB Starting process 5628 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 5629 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 5630 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 5631 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 5632 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 5633 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 5634 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-08T08:09:25.171462 Keeping 13 CCDs: c4d_170317_072842_ooi_z_ls9.fits.fz c4d_170317_072842_ooi_z_ls9-S27 z exptime 80.0 propid 2014B-0404 seeing 1.13 MJD 57829.310 object DECaLS_38567_z c4d_180222_084327_ooi_r_ls9.fits.fz c4d_180222_084327_ooi_r_ls9-S27 r exptime 47.0 propid 2014B-0404 seeing 0.97 MJD 58171.364 object DECaLS_38567_r c4d_180222_084443_ooi_g_ls9.fits.fz c4d_180222_084443_ooi_g_ls9-S27 g exptime 105.0 propid 2014B-0404 seeing 1.21 MJD 58171.364 object DECaLS_38567_g c4d_190305_071119_ooi_z_ls9.fits.fz c4d_190305_071119_ooi_z_ls9-S27 z exptime 87.0 propid 2014B-0404 seeing 1.31 MJD 58547.300 object DECaLS_38567_z c4d_170329_070305_ooi_r_ls9.fits.fz c4d_170329_070305_ooi_r_ls9-N29 r exptime 64.0 propid 2014B-0404 seeing 1.22 MJD 57841.292 object DECaLS_6843_r c4d_170422_052449_ooi_g_ls9.fits.fz c4d_170422_052449_ooi_g_ls9-N29 g exptime 147.0 propid 2014B-0404 seeing 1.16 MJD 57865.223 object DECaLS_6843_g c4d_160228_082044_ooi_z_ls9.fits.fz c4d_160228_082044_ooi_z_ls9-N29 z exptime 131.0 propid 2014B-0404 seeing 1.01 MJD 57446.346 object DECaLS_6843_z c4d_170522_025302_ooi_g_ls9.fits.fz c4d_170522_025302_ooi_g_ls9-S28 g exptime 175.0 propid 2014B-0404 seeing 1.82 MJD 57895.118 object DECaLS_22695_g c4d_170422_050255_ooi_r_ls9.fits.fz c4d_170422_050255_ooi_r_ls9-S28 r exptime 72.0 propid 2014B-0404 seeing 1.21 MJD 57865.209 object DECaLS_22695_r c4d_150408_055503_ooi_z_ls9.fits.fz c4d_150408_055503_ooi_z_ls9-S28 z exptime 109.0 propid 2014B-0404 seeing 1.18 MJD 57120.245 object DECaLS_22695_z c4d_170522_025630_ooi_g_ls9.fits.fz c4d_170522_025630_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.72 MJD 57895.120 object DECaLS_22715_g c4d_170521_031658_ooi_r_ls9.fits.fz c4d_170521_031658_ooi_r_ls9-N25 r exptime 125.0 propid 2014B-0404 seeing 1.57 MJD 57894.135 object DECaLS_22715_r c4d_160226_081124_ooi_z_ls9.fits.fz c4d_160226_081124_ooi_z_ls9-N25 z exptime 133.0 propid 2014B-0404 seeing 0.97 MJD 57444.339 object DECaLS_22715_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954f856-z-20160228T081743_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95508ff-z-20160226T080822_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95351a0-z-20190305T071119_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T072630_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055224_oi[S28,noinherit][2046,4094][real]: DECaLS_ WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954f856-z-20160228T081743_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95508ff-z-20160226T080822_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T072630_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value OSError: FITSIO status = 104: could not open the named file failed to find or open the following file: (ffopen) /global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170328/c4d_170329_0 70305_ooi_r_ls9.fits.fz Something went wrong; please check the logfile. ERROR: galaxy PGC3097563; please check the logfile. Finished galaxy PGC3097563 in 0.106 minutes. Started working on galaxy PGC3097563 at Sat Feb 8 12:45:30 2020 RA, Dec=215.030625, 30.399389: run=decam (0 north CCDs, 13 south CCDs). python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 215.03062500000001 30.399388899999998 --width 447 --height 447 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-08T12:45:31.694764 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '215.03062500000001', '30.399388899999998', '--width', '447', '--height', '447', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 215.03062500000001 30.399388899999998 --width 447 --height 447 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 215.03062500000001 30.399388899999998 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 30296 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 30297 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 30298 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 30299 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 30300 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 30301 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 30302 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 30303 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-08T12:45:32.918275 Keeping 13 CCDs: c4d_170317_072842_ooi_z_ls9.fits.fz c4d_170317_072842_ooi_z_ls9-S27 z exptime 80.0 propid 2014B-0404 seeing 1.13 MJD 57829.310 object DECaLS_38567_z c4d_180222_084327_ooi_r_ls9.fits.fz c4d_180222_084327_ooi_r_ls9-S27 r exptime 47.0 propid 2014B-0404 seeing 0.97 MJD 58171.364 object DECaLS_38567_r c4d_180222_084443_ooi_g_ls9.fits.fz c4d_180222_084443_ooi_g_ls9-S27 g exptime 105.0 propid 2014B-0404 seeing 1.21 MJD 58171.364 object DECaLS_38567_g c4d_190305_071119_ooi_z_ls9.fits.fz c4d_190305_071119_ooi_z_ls9-S27 z exptime 87.0 propid 2014B-0404 seeing 1.31 MJD 58547.300 object DECaLS_38567_z c4d_170329_070305_ooi_r_ls9.fits.fz c4d_170329_070305_ooi_r_ls9-N29 r exptime 64.0 propid 2014B-0404 seeing 1.22 MJD 57841.292 object DECaLS_6843_r c4d_170422_052449_ooi_g_ls9.fits.fz c4d_170422_052449_ooi_g_ls9-N29 g exptime 147.0 propid 2014B-0404 seeing 1.16 MJD 57865.223 object DECaLS_6843_g c4d_160228_082044_ooi_z_ls9.fits.fz c4d_160228_082044_ooi_z_ls9-N29 z exptime 131.0 propid 2014B-0404 seeing 1.01 MJD 57446.346 object DECaLS_6843_z c4d_170522_025302_ooi_g_ls9.fits.fz c4d_170522_025302_ooi_g_ls9-S28 g exptime 175.0 propid 2014B-0404 seeing 1.82 MJD 57895.118 object DECaLS_22695_g c4d_170422_050255_ooi_r_ls9.fits.fz c4d_170422_050255_ooi_r_ls9-S28 r exptime 72.0 propid 2014B-0404 seeing 1.21 MJD 57865.209 object DECaLS_22695_r c4d_150408_055503_ooi_z_ls9.fits.fz c4d_150408_055503_ooi_z_ls9-S28 z exptime 109.0 propid 2014B-0404 seeing 1.18 MJD 57120.245 object DECaLS_22695_z c4d_170522_025630_ooi_g_ls9.fits.fz c4d_170522_025630_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.72 MJD 57895.120 object DECaLS_22715_g c4d_170521_031658_ooi_r_ls9.fits.fz c4d_170521_031658_ooi_r_ls9-N25 r exptime 125.0 propid 2014B-0404 seeing 1.57 MJD 57894.135 object DECaLS_22715_r c4d_160226_081124_ooi_z_ls9.fits.fz c4d_160226_081124_ooi_z_ls9-N25 z exptime 133.0 propid 2014B-0404 seeing 0.97 MJD 57444.339 object DECaLS_22715_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95508ff-z-20160226T080822_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95351a0-z-20190305T071119_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T072630_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055224_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954f856-z-20160228T081743_oi[N29,noinherit][2046,4094][real]: DECaLS_ WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95508ff-z-20160226T080822_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95351a0-z-20190305T071119_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T072630_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954f856-z-20160228T081743_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value OSError: FITSIO status = 104: could not open the named file failed to find or open the following file: (ffopen) /global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2a/CP20180221/c4d_180222_ 084443_ooi_g_ls9.fits.fz Something went wrong; please check the logfile. ERROR: galaxy PGC3097563; please check the logfile. Finished galaxy PGC3097563 in 0.091 minutes. Started working on galaxy PGC3097563 at Sun Feb 9 07:51:38 2020 RA, Dec=215.030625, 30.399389: run=decam (0 north CCDs, 13 south CCDs). python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 215.03062500000001 30.399388899999998 --width 447 --height 447 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-09T07:51:39.808426 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '215.03062500000001', '30.399388899999998', '--width', '447', '--height', '447', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 215.03062500000001 30.399388899999998 --width 447 --height 447 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 215.03062500000001 30.399388899999998 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 26379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 26380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 26381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 26382 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 26383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 26384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Starting process 26385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 26386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 26387 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 26388 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 26389 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB Starting process 26390 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB Starting process 26391 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB Starting process 26392 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB Starting process 26393 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB Starting process 26394 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB Starting process 26395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.0712 MB Starting process 26396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072212 MB Starting process 26397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072212 MB Starting process 26398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07192 MB Starting process 26399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071916 MB Starting process 26400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 26401 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 26402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 26403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 26404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 26405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 26406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 26407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 26408 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 26409 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 26410 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-09T07:51:41.409361 Keeping 13 CCDs: c4d_170317_072842_ooi_z_ls9.fits.fz c4d_170317_072842_ooi_z_ls9-S27 z exptime 80.0 propid 2014B-0404 seeing 1.13 MJD 57829.310 object DECaLS_38567_z c4d_180222_084327_ooi_r_ls9.fits.fz c4d_180222_084327_ooi_r_ls9-S27 r exptime 47.0 propid 2014B-0404 seeing 0.97 MJD 58171.364 object DECaLS_38567_r c4d_180222_084443_ooi_g_ls9.fits.fz c4d_180222_084443_ooi_g_ls9-S27 g exptime 105.0 propid 2014B-0404 seeing 1.21 MJD 58171.364 object DECaLS_38567_g c4d_190305_071119_ooi_z_ls9.fits.fz c4d_190305_071119_ooi_z_ls9-S27 z exptime 87.0 propid 2014B-0404 seeing 1.31 MJD 58547.300 object DECaLS_38567_z c4d_170329_070305_ooi_r_ls9.fits.fz c4d_170329_070305_ooi_r_ls9-N29 r exptime 64.0 propid 2014B-0404 seeing 1.22 MJD 57841.292 object DECaLS_6843_r c4d_170422_052449_ooi_g_ls9.fits.fz c4d_170422_052449_ooi_g_ls9-N29 g exptime 147.0 propid 2014B-0404 seeing 1.16 MJD 57865.223 object DECaLS_6843_g c4d_160228_082044_ooi_z_ls9.fits.fz c4d_160228_082044_ooi_z_ls9-N29 z exptime 131.0 propid 2014B-0404 seeing 1.01 MJD 57446.346 object DECaLS_6843_z c4d_170522_025302_ooi_g_ls9.fits.fz c4d_170522_025302_ooi_g_ls9-S28 g exptime 175.0 propid 2014B-0404 seeing 1.82 MJD 57895.118 object DECaLS_22695_g c4d_170422_050255_ooi_r_ls9.fits.fz c4d_170422_050255_ooi_r_ls9-S28 r exptime 72.0 propid 2014B-0404 seeing 1.21 MJD 57865.209 object DECaLS_22695_r c4d_150408_055503_ooi_z_ls9.fits.fz c4d_150408_055503_ooi_z_ls9-S28 z exptime 109.0 propid 2014B-0404 seeing 1.18 MJD 57120.245 object DECaLS_22695_z c4d_170522_025630_ooi_g_ls9.fits.fz c4d_170522_025630_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.72 MJD 57895.120 object DECaLS_22715_g c4d_170521_031658_ooi_r_ls9.fits.fz c4d_170521_031658_ooi_r_ls9-N25 r exptime 125.0 propid 2014B-0404 seeing 1.57 MJD 57894.135 object DECaLS_22715_r c4d_160226_081124_ooi_z_ls9.fits.fz c4d_160226_081124_ooi_z_ls9-N25 z exptime 133.0 propid 2014B-0404 seeing 0.97 MJD 57444.339 object DECaLS_22715_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95508ff-z-20160226T080822_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954f856-z-20160228T081743_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T072630_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95351a0-z-20190305T071119_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055224_oi[S28,noinherit][2046,4094][real]: DECaLS_ WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95508ff-z-20160226T080822_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954f856-z-20160228T081743_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055224_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95351a0-z-20190305T071119_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value OSError: FITSIO status = 104: could not open the named file failed to find or open the following file: (ffopen) /global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170328/c4d_170329_0 70305_ooi_r_ls9.fits.fz Something went wrong; please check the logfile. ERROR: galaxy PGC3097563; please check the logfile. Finished galaxy PGC3097563 in 0.115 minutes. Started working on galaxy PGC3097563 at Sun Feb 9 09:57:59 2020 RA, Dec=215.030625, 30.399389: run=decam (0 north CCDs, 13 south CCDs). python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 215.03062500000001 30.399388899999998 --width 447 --height 447 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-09T09:58:00.403896 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '215.03062500000001', '30.399388899999998', '--width', '447', '--height', '447', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 215.03062500000001 30.399388899999998 --width 447 --height 447 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 215.03062500000001 30.399388899999998 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 37903 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 37904 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 37905 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 37906 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 37907 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 37908 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 37909 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Starting process 37910 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 37911 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 37912 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 37913 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 37914 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 37915 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 37916 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB Starting process 37917 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB Starting process 37918 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB Starting process 37919 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071196 MB Starting process 37920 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072208 MB Starting process 37921 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072208 MB Starting process 37922 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071916 MB Starting process 37923 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071916 MB Starting process 37924 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB Starting process 37925 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 37926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 37927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 37928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 37929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 37930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 37931 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 37932 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 37933 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 37934 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-09T09:58:01.694313 Keeping 13 CCDs: c4d_170317_072842_ooi_z_ls9.fits.fz c4d_170317_072842_ooi_z_ls9-S27 z exptime 80.0 propid 2014B-0404 seeing 1.13 MJD 57829.310 object DECaLS_38567_z c4d_180222_084327_ooi_r_ls9.fits.fz c4d_180222_084327_ooi_r_ls9-S27 r exptime 47.0 propid 2014B-0404 seeing 0.97 MJD 58171.364 object DECaLS_38567_r c4d_180222_084443_ooi_g_ls9.fits.fz c4d_180222_084443_ooi_g_ls9-S27 g exptime 105.0 propid 2014B-0404 seeing 1.21 MJD 58171.364 object DECaLS_38567_g c4d_190305_071119_ooi_z_ls9.fits.fz c4d_190305_071119_ooi_z_ls9-S27 z exptime 87.0 propid 2014B-0404 seeing 1.31 MJD 58547.300 object DECaLS_38567_z c4d_170329_070305_ooi_r_ls9.fits.fz c4d_170329_070305_ooi_r_ls9-N29 r exptime 64.0 propid 2014B-0404 seeing 1.22 MJD 57841.292 object DECaLS_6843_r c4d_170422_052449_ooi_g_ls9.fits.fz c4d_170422_052449_ooi_g_ls9-N29 g exptime 147.0 propid 2014B-0404 seeing 1.16 MJD 57865.223 object DECaLS_6843_g c4d_160228_082044_ooi_z_ls9.fits.fz c4d_160228_082044_ooi_z_ls9-N29 z exptime 131.0 propid 2014B-0404 seeing 1.01 MJD 57446.346 object DECaLS_6843_z c4d_170522_025302_ooi_g_ls9.fits.fz c4d_170522_025302_ooi_g_ls9-S28 g exptime 175.0 propid 2014B-0404 seeing 1.82 MJD 57895.118 object DECaLS_22695_g c4d_170422_050255_ooi_r_ls9.fits.fz c4d_170422_050255_ooi_r_ls9-S28 r exptime 72.0 propid 2014B-0404 seeing 1.21 MJD 57865.209 object DECaLS_22695_r c4d_150408_055503_ooi_z_ls9.fits.fz c4d_150408_055503_ooi_z_ls9-S28 z exptime 109.0 propid 2014B-0404 seeing 1.18 MJD 57120.245 object DECaLS_22695_z c4d_170522_025630_ooi_g_ls9.fits.fz c4d_170522_025630_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.72 MJD 57895.120 object DECaLS_22715_g c4d_170521_031658_ooi_r_ls9.fits.fz c4d_170521_031658_ooi_r_ls9-N25 r exptime 125.0 propid 2014B-0404 seeing 1.57 MJD 57894.135 object DECaLS_22715_r c4d_160226_081124_ooi_z_ls9.fits.fz c4d_160226_081124_ooi_z_ls9-N25 z exptime 133.0 propid 2014B-0404 seeing 0.97 MJD 57444.339 object DECaLS_22715_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055224_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T072630_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95351a0-z-20190305T071119_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95508ff-z-20160226T080822_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954f856-z-20160228T081743_oi[N29,noinherit][2046,4094][real]: DECaLS_ WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055224_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95508ff-z-20160226T080822_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T072630_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954f856-z-20160228T081743_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value OSError: FITSIO status = 104: could not open the named file failed to find or open the following file: (ffopen) /global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2a/CP20180221/c4d_180222_ 084443_ooi_g_ls9.fits.fz Something went wrong; please check the logfile. ERROR: galaxy PGC3097563; please check the logfile. Finished galaxy PGC3097563 in 0.060 minutes. Started working on galaxy PGC3097563 at Mon Feb 10 06:13:33 2020 RA, Dec=215.030625, 30.399389: run=decam (0 north CCDs, 13 south CCDs). python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 215.03062500000001 30.399388899999998 --width 447 --height 447 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-10T06:13:33.611486 legacypipe git version: dr9e-pre1-9-g4a51be93 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '215.03062500000001', '30.399388899999998', '--width', '447', '--height', '447', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 215.03062500000001 30.399388899999998 --width 447 --height 447 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/215/PGC3097563/PGC3097563-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 215.03062500000001 30.399388899999998 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 12355 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071128 MB Starting process 12356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071132 MB Starting process 12357 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071132 MB Starting process 12358 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071132 MB Starting process 12359 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071132 MB Starting process 12360 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB Starting process 12361 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB Starting process 12362 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB Starting process 12363 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB Starting process 12364 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB Starting process 12365 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB Starting process 12366 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB Starting process 12367 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB Starting process 12368 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071152 MB Starting process 12369 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071152 MB Starting process 12370 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071156 MB Starting process 12371 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071156 MB Starting process 12372 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072168 MB Starting process 12373 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072168 MB Starting process 12374 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071872 MB Starting process 12375 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071868 MB Starting process 12376 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB Starting process 12377 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB Starting process 12378 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB Starting process 12379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB Starting process 12380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB Starting process 12381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB Starting process 12382 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB Starting process 12383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB Starting process 12384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB Starting process 12385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB Starting process 12386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-10T06:13:34.861977 Keeping 13 CCDs: c4d_170317_072842_ooi_z_ls9.fits.fz c4d_170317_072842_ooi_z_ls9-S27 z exptime 80.0 propid 2014B-0404 seeing 1.13 MJD 57829.310 object DECaLS_38567_z c4d_180222_084327_ooi_r_ls9.fits.fz c4d_180222_084327_ooi_r_ls9-S27 r exptime 47.0 propid 2014B-0404 seeing 0.97 MJD 58171.364 object DECaLS_38567_r c4d_180222_084443_ooi_g_ls9.fits.fz c4d_180222_084443_ooi_g_ls9-S27 g exptime 105.0 propid 2014B-0404 seeing 1.21 MJD 58171.364 object DECaLS_38567_g c4d_190305_071119_ooi_z_ls9.fits.fz c4d_190305_071119_ooi_z_ls9-S27 z exptime 87.0 propid 2014B-0404 seeing 1.31 MJD 58547.300 object DECaLS_38567_z c4d_170329_070305_ooi_r_ls9.fits.fz c4d_170329_070305_ooi_r_ls9-N29 r exptime 64.0 propid 2014B-0404 seeing 1.22 MJD 57841.292 object DECaLS_6843_r c4d_170422_052449_ooi_g_ls9.fits.fz c4d_170422_052449_ooi_g_ls9-N29 g exptime 147.0 propid 2014B-0404 seeing 1.16 MJD 57865.223 object DECaLS_6843_g c4d_160228_082044_ooi_z_ls9.fits.fz c4d_160228_082044_ooi_z_ls9-N29 z exptime 131.0 propid 2014B-0404 seeing 1.01 MJD 57446.346 object DECaLS_6843_z c4d_170522_025302_ooi_g_ls9.fits.fz c4d_170522_025302_ooi_g_ls9-S28 g exptime 175.0 propid 2014B-0404 seeing 1.82 MJD 57895.118 object DECaLS_22695_g c4d_170422_050255_ooi_r_ls9.fits.fz c4d_170422_050255_ooi_r_ls9-S28 r exptime 72.0 propid 2014B-0404 seeing 1.21 MJD 57865.209 object DECaLS_22695_r c4d_150408_055503_ooi_z_ls9.fits.fz c4d_150408_055503_ooi_z_ls9-S28 z exptime 109.0 propid 2014B-0404 seeing 1.18 MJD 57120.245 object DECaLS_22695_z c4d_170522_025630_ooi_g_ls9.fits.fz c4d_170522_025630_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.72 MJD 57895.120 object DECaLS_22715_g c4d_170521_031658_ooi_r_ls9.fits.fz c4d_170521_031658_ooi_r_ls9-N25 r exptime 125.0 propid 2014B-0404 seeing 1.57 MJD 57894.135 object DECaLS_22715_r c4d_160226_081124_ooi_z_ls9.fits.fz c4d_160226_081124_ooi_z_ls9-N25 z exptime 133.0 propid 2014B-0404 seeing 0.97 MJD 57444.339 object DECaLS_22715_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T072630_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055224_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95351a0-z-20190305T071119_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954f856-z-20160228T081743_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95508ff-z-20160226T080822_oi[N25,noinherit][2046,4094][real]: DECaLS_ WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T072630_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055224_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95351a0-z-20190305T071119_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95508ff-z-20160226T080822_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value OSError: FITSIO status = 104: could not open the named file failed to find or open the following file: (ffopen) /global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2a/CP20180221/c4d_180222_ 084327_ooi_r_ls9.fits.fz Something went wrong; please check the logfile. ERROR: galaxy PGC3097563; please check the logfile. Finished galaxy PGC3097563 in 0.057 minutes.