Started working on galaxy NGC5611 at Sat Feb  8 08:35:17 2020
RA, Dec=216.019925, 33.047467: run=decam (16 north CCDs, 20 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.0199245 33.0474667 --width 935 --height 935 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-08T08:35:18.186534
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.0199245', '33.0474667', '--width', '935', '--height', '935', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.0199245 33.0474667 --width 935 --height 935 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.0199245 33.0474667
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 35734 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 35735 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 35736 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 35737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 35738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 35739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 35740 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 35741 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-08T08:35:19.597803
Keeping 20 CCDs:
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-S9 g exptime 169.0 propid 2014B-0404 seeing 1.41 MJD 57951.996 object DECaLS_22732_g
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-S9 r exptime 96.0 propid 2014B-0404 seeing 1.48 MJD 57951.994 object DECaLS_22732_r
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-S10 r exptime 52.0 propid 2014B-0404 seeing 1.07 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-S10 g exptime 125.0 propid 2014B-0404 seeing 1.39 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-S10 z exptime 147.0 propid 2014B-0404 seeing 0.98 MJD 57446.353 object DECaLS_6860_z
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-S9 z exptime 135.0 propid 2014B-0404 seeing 0.98 MJD 57444.341 object DECaLS_22732_z
   c4d_170504_040311_ooi_z_ls9.fits.fz c4d_170504_040311_ooi_z_ls9-S13 z exptime 139.0 propid 2014B-0404 seeing 1.22 MJD 57877.167 object DECaLS_38588_z
   c4d_180224_084353_ooi_g_ls9.fits.fz c4d_180224_084353_ooi_g_ls9-S13 g exptime 159.0 propid 2014B-0404 seeing 1.64 MJD 58173.364 object DECaLS_38588_g
   c4d_180221_085301_ooi_r_ls9.fits.fz c4d_180221_085301_ooi_r_ls9-S13 r exptime 67.0 propid 2014B-0404 seeing 1.22 MJD 58170.370 object DECaLS_38588_r
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-S9 r exptime 52.0 propid 2014B-0404 seeing 1.05 MJD 58162.375 object DECaLS_6860_r
   c4d_170504_040311_ooi_z_ls9.fits.fz c4d_170504_040311_ooi_z_ls9-S19 z exptime 139.0 propid 2014B-0404 seeing 1.21 MJD 57877.167 object DECaLS_38588_z
   c4d_180224_084353_ooi_g_ls9.fits.fz c4d_180224_084353_ooi_g_ls9-S19 g exptime 159.0 propid 2014B-0404 seeing 1.67 MJD 58173.364 object DECaLS_38588_g
   c4d_180221_085301_ooi_r_ls9.fits.fz c4d_180221_085301_ooi_r_ls9-S19 r exptime 67.0 propid 2014B-0404 seeing 1.22 MJD 58170.370 object DECaLS_38588_r
   c4d_160226_090239_ooi_z_ls9.fits.fz c4d_160226_090239_ooi_z_ls9-S14 z exptime 140.0 propid 2014B-0404 seeing 0.96 MJD 57444.375 object DECaLS_38604_z
   c4d_180513_031444_ooi_r_ls9.fits.fz c4d_180513_031444_ooi_r_ls9-S14 r exptime 166.0 propid 2014B-0404 seeing 1.89 MJD 58251.135 object DECaLS_38604_r
   c4d_190307_071335_ooi_r_ls9.fits.fz c4d_190307_071335_ooi_r_ls9-S14 r exptime 49.0 propid 2014B-0404 seeing 1.51 MJD 58549.301 object DECaLS_38604_r
   c4d_180221_085747_ooi_g_ls9.fits.fz c4d_180221_085747_ooi_g_ls9-S14 g exptime 173.0 propid 2014B-0404 seeing 1.46 MJD 58170.373 object DECaLS_38604_g
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-S15 z exptime 135.0 propid 2014B-0404 seeing 0.96 MJD 57444.341 object DECaLS_22732_z
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-S15 r exptime 96.0 propid 2014B-0404 seeing 1.51 MJD 57951.994 object DECaLS_22732_r
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-S15 g exptime 169.0 propid 2014B-0404 seeing 1.67 MJD 57951.996 object DECaLS_22732_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[S10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95144db-z-20170504T040003_oi[S19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S9,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95144db-z-20170504T040003_oi[S13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[S14,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S9,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170717/c4d_170717_2
35713_ooi_g_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy NGC5611; please check the logfile.
Finished galaxy NGC5611 in 0.106 minutes.
Started working on galaxy NGC5611 at Sat Feb  8 12:50:13 2020
RA, Dec=216.019925, 33.047467: run=decam (16 north CCDs, 20 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.0199245 33.0474667 --width 935 --height 935 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-08T12:50:13.885416
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.0199245', '33.0474667', '--width', '935', '--height', '935', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.0199245 33.0474667 --width 935 --height 935 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.0199245 33.0474667
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 2111 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 2112 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 2113 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 2114 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 2115 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 2116 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 2117 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 2118 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-08T12:50:15.238187
Keeping 20 CCDs:
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-S9 g exptime 169.0 propid 2014B-0404 seeing 1.41 MJD 57951.996 object DECaLS_22732_g
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-S9 r exptime 96.0 propid 2014B-0404 seeing 1.48 MJD 57951.994 object DECaLS_22732_r
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-S10 r exptime 52.0 propid 2014B-0404 seeing 1.07 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-S10 g exptime 125.0 propid 2014B-0404 seeing 1.39 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-S10 z exptime 147.0 propid 2014B-0404 seeing 0.98 MJD 57446.353 object DECaLS_6860_z
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-S9 z exptime 135.0 propid 2014B-0404 seeing 0.98 MJD 57444.341 object DECaLS_22732_z
   c4d_170504_040311_ooi_z_ls9.fits.fz c4d_170504_040311_ooi_z_ls9-S13 z exptime 139.0 propid 2014B-0404 seeing 1.22 MJD 57877.167 object DECaLS_38588_z
   c4d_180224_084353_ooi_g_ls9.fits.fz c4d_180224_084353_ooi_g_ls9-S13 g exptime 159.0 propid 2014B-0404 seeing 1.64 MJD 58173.364 object DECaLS_38588_g
   c4d_180221_085301_ooi_r_ls9.fits.fz c4d_180221_085301_ooi_r_ls9-S13 r exptime 67.0 propid 2014B-0404 seeing 1.22 MJD 58170.370 object DECaLS_38588_r
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-S9 r exptime 52.0 propid 2014B-0404 seeing 1.05 MJD 58162.375 object DECaLS_6860_r
   c4d_170504_040311_ooi_z_ls9.fits.fz c4d_170504_040311_ooi_z_ls9-S19 z exptime 139.0 propid 2014B-0404 seeing 1.21 MJD 57877.167 object DECaLS_38588_z
   c4d_180224_084353_ooi_g_ls9.fits.fz c4d_180224_084353_ooi_g_ls9-S19 g exptime 159.0 propid 2014B-0404 seeing 1.67 MJD 58173.364 object DECaLS_38588_g
   c4d_180221_085301_ooi_r_ls9.fits.fz c4d_180221_085301_ooi_r_ls9-S19 r exptime 67.0 propid 2014B-0404 seeing 1.22 MJD 58170.370 object DECaLS_38588_r
   c4d_160226_090239_ooi_z_ls9.fits.fz c4d_160226_090239_ooi_z_ls9-S14 z exptime 140.0 propid 2014B-0404 seeing 0.96 MJD 57444.375 object DECaLS_38604_z
   c4d_180513_031444_ooi_r_ls9.fits.fz c4d_180513_031444_ooi_r_ls9-S14 r exptime 166.0 propid 2014B-0404 seeing 1.89 MJD 58251.135 object DECaLS_38604_r
   c4d_190307_071335_ooi_r_ls9.fits.fz c4d_190307_071335_ooi_r_ls9-S14 r exptime 49.0 propid 2014B-0404 seeing 1.51 MJD 58549.301 object DECaLS_38604_r
   c4d_180221_085747_ooi_g_ls9.fits.fz c4d_180221_085747_ooi_g_ls9-S14 g exptime 173.0 propid 2014B-0404 seeing 1.46 MJD 58170.373 object DECaLS_38604_g
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-S15 z exptime 135.0 propid 2014B-0404 seeing 0.96 MJD 57444.341 object DECaLS_22732_z
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-S15 r exptime 96.0 propid 2014B-0404 seeing 1.51 MJD 57951.994 object DECaLS_22732_r
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-S15 g exptime 169.0 propid 2014B-0404 seeing 1.67 MJD 57951.996 object DECaLS_22732_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[S10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S9,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[S14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95144db-z-20170504T040003_oi[S19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95144db-z-20170504T040003_oi[S13,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S9,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170717/c4d_170717_2
35355_ooi_r_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy NGC5611; please check the logfile.
Finished galaxy NGC5611 in 0.091 minutes.
Started working on galaxy NGC5611 at Sun Feb  9 10:59:26 2020
RA, Dec=216.019925, 33.047467: run=decam (16 north CCDs, 20 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.0199245 33.0474667 --width 935 --height 935 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-09T10:59:27.200447
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.0199245', '33.0474667', '--width', '935', '--height', '935', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.0199245 33.0474667 --width 935 --height 935 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.0199245 33.0474667
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 58441 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 58442 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 58443 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 58444 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 58445 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 58446 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 58447 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 58448 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 58449 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 58450 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 58451 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 58452 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 58453 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB
Starting process 58454 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB
Starting process 58455 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB
Starting process 58456 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB
Starting process 58457 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071196 MB
Starting process 58458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072208 MB
Starting process 58459 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072208 MB
Starting process 58460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071916 MB
Starting process 58461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071912 MB
Starting process 58462 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB
Starting process 58463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Starting process 58464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB
Starting process 58465 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Starting process 58466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB
Starting process 58467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Starting process 58468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Starting process 58469 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Starting process 58470 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Starting process 58471 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Starting process 58472 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-09T10:59:29.062294
Keeping 20 CCDs:
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-S9 g exptime 169.0 propid 2014B-0404 seeing 1.41 MJD 57951.996 object DECaLS_22732_g
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-S9 r exptime 96.0 propid 2014B-0404 seeing 1.48 MJD 57951.994 object DECaLS_22732_r
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-S10 r exptime 52.0 propid 2014B-0404 seeing 1.07 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-S10 g exptime 125.0 propid 2014B-0404 seeing 1.39 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-S10 z exptime 147.0 propid 2014B-0404 seeing 0.98 MJD 57446.353 object DECaLS_6860_z
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-S9 z exptime 135.0 propid 2014B-0404 seeing 0.98 MJD 57444.341 object DECaLS_22732_z
   c4d_170504_040311_ooi_z_ls9.fits.fz c4d_170504_040311_ooi_z_ls9-S13 z exptime 139.0 propid 2014B-0404 seeing 1.22 MJD 57877.167 object DECaLS_38588_z
   c4d_180224_084353_ooi_g_ls9.fits.fz c4d_180224_084353_ooi_g_ls9-S13 g exptime 159.0 propid 2014B-0404 seeing 1.64 MJD 58173.364 object DECaLS_38588_g
   c4d_180221_085301_ooi_r_ls9.fits.fz c4d_180221_085301_ooi_r_ls9-S13 r exptime 67.0 propid 2014B-0404 seeing 1.22 MJD 58170.370 object DECaLS_38588_r
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-S9 r exptime 52.0 propid 2014B-0404 seeing 1.05 MJD 58162.375 object DECaLS_6860_r
   c4d_170504_040311_ooi_z_ls9.fits.fz c4d_170504_040311_ooi_z_ls9-S19 z exptime 139.0 propid 2014B-0404 seeing 1.21 MJD 57877.167 object DECaLS_38588_z
   c4d_180224_084353_ooi_g_ls9.fits.fz c4d_180224_084353_ooi_g_ls9-S19 g exptime 159.0 propid 2014B-0404 seeing 1.67 MJD 58173.364 object DECaLS_38588_g
   c4d_180221_085301_ooi_r_ls9.fits.fz c4d_180221_085301_ooi_r_ls9-S19 r exptime 67.0 propid 2014B-0404 seeing 1.22 MJD 58170.370 object DECaLS_38588_r
   c4d_160226_090239_ooi_z_ls9.fits.fz c4d_160226_090239_ooi_z_ls9-S14 z exptime 140.0 propid 2014B-0404 seeing 0.96 MJD 57444.375 object DECaLS_38604_z
   c4d_180513_031444_ooi_r_ls9.fits.fz c4d_180513_031444_ooi_r_ls9-S14 r exptime 166.0 propid 2014B-0404 seeing 1.89 MJD 58251.135 object DECaLS_38604_r
   c4d_190307_071335_ooi_r_ls9.fits.fz c4d_190307_071335_ooi_r_ls9-S14 r exptime 49.0 propid 2014B-0404 seeing 1.51 MJD 58549.301 object DECaLS_38604_r
   c4d_180221_085747_ooi_g_ls9.fits.fz c4d_180221_085747_ooi_g_ls9-S14 g exptime 173.0 propid 2014B-0404 seeing 1.46 MJD 58170.373 object DECaLS_38604_g
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-S15 z exptime 135.0 propid 2014B-0404 seeing 0.96 MJD 57444.341 object DECaLS_22732_z
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-S15 r exptime 96.0 propid 2014B-0404 seeing 1.51 MJD 57951.994 object DECaLS_22732_r
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-S15 g exptime 169.0 propid 2014B-0404 seeing 1.67 MJD 57951.996 object DECaLS_22732_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[S10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S9,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95144db-z-20170504T040003_oi[S19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95144db-z-20170504T040003_oi[S13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[S14,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S9,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95144db-z-20170504T040003_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2a/CP20180212/c4d_180213_
090013_ooi_r_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy NGC5611; please check the logfile.
Finished galaxy NGC5611 in 0.118 minutes.
Started working on galaxy NGC5611 at Mon Feb 10 06:17:32 2020
RA, Dec=216.019925, 33.047467: run=decam (16 north CCDs, 20 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.0199245 33.0474667 --width 935 --height 935 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-10T06:17:33.252327
legacypipe git version: dr9e-pre1-9-g4a51be93
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.0199245', '33.0474667', '--width', '935', '--height', '935', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.0199245 33.0474667 --width 935 --height 935 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/NGC5611/NGC5611-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.0199245 33.0474667
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 15355 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15357 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15358 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15359 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15360 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB
Starting process 15361 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071132 MB
Starting process 15362 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071132 MB
Starting process 15363 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB
Starting process 15364 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB
Starting process 15365 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB
Starting process 15366 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB
Starting process 15367 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15368 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15369 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15370 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15371 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071148 MB
Starting process 15372 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072164 MB
Starting process 15373 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072164 MB
Starting process 15374 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071876 MB
Starting process 15375 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071876 MB
Starting process 15376 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071152 MB
Starting process 15377 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB
Starting process 15378 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB
Starting process 15379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB
Starting process 15380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB
Starting process 15381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB
Starting process 15382 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB
Starting process 15383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB
Starting process 15384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB
Starting process 15385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB
Starting process 15386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-10T06:17:34.502136
Keeping 20 CCDs:
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-S9 g exptime 169.0 propid 2014B-0404 seeing 1.41 MJD 57951.996 object DECaLS_22732_g
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-S9 r exptime 96.0 propid 2014B-0404 seeing 1.48 MJD 57951.994 object DECaLS_22732_r
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-S10 r exptime 52.0 propid 2014B-0404 seeing 1.07 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-S10 g exptime 125.0 propid 2014B-0404 seeing 1.39 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-S10 z exptime 147.0 propid 2014B-0404 seeing 0.98 MJD 57446.353 object DECaLS_6860_z
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-S9 z exptime 135.0 propid 2014B-0404 seeing 0.98 MJD 57444.341 object DECaLS_22732_z
   c4d_170504_040311_ooi_z_ls9.fits.fz c4d_170504_040311_ooi_z_ls9-S13 z exptime 139.0 propid 2014B-0404 seeing 1.22 MJD 57877.167 object DECaLS_38588_z
   c4d_180224_084353_ooi_g_ls9.fits.fz c4d_180224_084353_ooi_g_ls9-S13 g exptime 159.0 propid 2014B-0404 seeing 1.64 MJD 58173.364 object DECaLS_38588_g
   c4d_180221_085301_ooi_r_ls9.fits.fz c4d_180221_085301_ooi_r_ls9-S13 r exptime 67.0 propid 2014B-0404 seeing 1.22 MJD 58170.370 object DECaLS_38588_r
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-S9 r exptime 52.0 propid 2014B-0404 seeing 1.05 MJD 58162.375 object DECaLS_6860_r
   c4d_170504_040311_ooi_z_ls9.fits.fz c4d_170504_040311_ooi_z_ls9-S19 z exptime 139.0 propid 2014B-0404 seeing 1.21 MJD 57877.167 object DECaLS_38588_z
   c4d_180224_084353_ooi_g_ls9.fits.fz c4d_180224_084353_ooi_g_ls9-S19 g exptime 159.0 propid 2014B-0404 seeing 1.67 MJD 58173.364 object DECaLS_38588_g
   c4d_180221_085301_ooi_r_ls9.fits.fz c4d_180221_085301_ooi_r_ls9-S19 r exptime 67.0 propid 2014B-0404 seeing 1.22 MJD 58170.370 object DECaLS_38588_r
   c4d_160226_090239_ooi_z_ls9.fits.fz c4d_160226_090239_ooi_z_ls9-S14 z exptime 140.0 propid 2014B-0404 seeing 0.96 MJD 57444.375 object DECaLS_38604_z
   c4d_180513_031444_ooi_r_ls9.fits.fz c4d_180513_031444_ooi_r_ls9-S14 r exptime 166.0 propid 2014B-0404 seeing 1.89 MJD 58251.135 object DECaLS_38604_r
   c4d_190307_071335_ooi_r_ls9.fits.fz c4d_190307_071335_ooi_r_ls9-S14 r exptime 49.0 propid 2014B-0404 seeing 1.51 MJD 58549.301 object DECaLS_38604_r
   c4d_180221_085747_ooi_g_ls9.fits.fz c4d_180221_085747_ooi_g_ls9-S14 g exptime 173.0 propid 2014B-0404 seeing 1.46 MJD 58170.373 object DECaLS_38604_g
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-S15 z exptime 135.0 propid 2014B-0404 seeing 0.96 MJD 57444.341 object DECaLS_22732_z
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-S15 r exptime 96.0 propid 2014B-0404 seeing 1.51 MJD 57951.994 object DECaLS_22732_r
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-S15 g exptime 169.0 propid 2014B-0404 seeing 1.67 MJD 57951.996 object DECaLS_22732_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95144db-z-20170504T040003_oi[S19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95144db-z-20170504T040003_oi[S13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[S10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S9,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[S14,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95144db-z-20170504T040003_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95144db-z-20170504T040003_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170717/c4d_170717_2
35355_ooi_r_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy NGC5611; please check the logfile.
Finished galaxy NGC5611 in 0.062 minutes.