Started working on galaxy PGC3089074 at Sat Feb  8 08:12:15 2020
RA, Dec=216.576324, 30.403207: run=decam (1 north CCDs, 18 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.57632399999997 30.4032067 --width 385 --height 385 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-08T08:12:16.535059
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.57632399999997', '30.4032067', '--width', '385', '--height', '385', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.57632399999997 30.4032067 --width 385 --height 385 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.57632399999997 30.4032067
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 43167 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 43168 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 43169 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 43170 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 43171 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 43172 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 43173 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 43174 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-08T08:12:17.805987
Keeping 18 CCDs:
   c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S26 z exptime 101.0 propid 2014B-0404 seeing 0.95 MJD 57818.397 object DECaLS_38586_z
   c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S26 r exptime 49.0 propid 2014B-0404 seeing 0.93 MJD 58171.370 object DECaLS_38586_r
   c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S26 g exptime 185.0 propid 2014B-0404 seeing 1.23 MJD 58171.371 object DECaLS_38586_g
   c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S27 g exptime 148.0 propid 2014B-0404 seeing 1.53 MJD 58255.108 object DECaLS_22714_g
   c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S27 z exptime 109.0 propid 2014B-0404 seeing 1.20 MJD 57120.248 object DECaLS_22714_z
   c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S27 r exptime 95.0 propid 2014B-0404 seeing 1.22 MJD 57864.240 object DECaLS_22714_r
   c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S27 g exptime 175.0 propid 2014B-0404 seeing 1.83 MJD 57893.143 object DECaLS_22714_g
   c4d_170718_233712_ooi_g_ls9.fits.fz c4d_170718_233712_ooi_g_ls9-S28 g exptime 113.0 propid 2014B-0404 seeing 1.62 MJD 57952.982 object DECaLS_6842_g
   c4d_170329_070133_ooi_r_ls9.fits.fz c4d_170329_070133_ooi_r_ls9-S28 r exptime 63.0 propid 2014B-0404 seeing 1.20 MJD 57841.291 object DECaLS_6842_r
   c4d_180209_091225_ooi_z_ls9.fits.fz c4d_180209_091225_ooi_z_ls9-S28 z exptime 109.0 propid 2014B-0404 seeing 1.10 MJD 58158.384 object DECaLS_6842_z
   c4d_150411_054724_ooi_z_ls9.fits.fz c4d_150411_054724_ooi_z_ls9-S28 z exptime 88.0 propid 2014B-0404 seeing 1.27 MJD 57123.240 object DECaLS_6842_z
   c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S30 z exptime 101.0 propid 2014B-0404 seeing 1.04 MJD 57818.397 object DECaLS_38586_z
   c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S30 r exptime 49.0 propid 2014B-0404 seeing 1.00 MJD 58171.370 object DECaLS_38586_r
   c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S30 g exptime 185.0 propid 2014B-0404 seeing 1.39 MJD 58171.371 object DECaLS_38586_g
   c4d_160228_082310_ooi_z_ls9.fits.fz c4d_160228_082310_ooi_z_ls9-N25 z exptime 115.0 propid 2014B-0404 seeing 0.95 MJD 57446.348 object DECaLS_6859_z
   c4d_180517_031813_ooi_g_ls9.fits.fz c4d_180517_031813_ooi_g_ls9-N25 g exptime 149.0 propid 2014B-0404 seeing 1.29 MJD 58255.138 object DECaLS_6859_g
   c4d_170329_070435_ooi_r_ls9.fits.fz c4d_170329_070435_ooi_r_ls9-N25 r exptime 62.0 propid 2014B-0404 seeing 1.26 MJD 57841.294 object DECaLS_6859_r
   c4d_170406_065019_ooi_g_ls9.fits.fz c4d_170406_065019_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.57 MJD 57849.282 object DECaLS_6859_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S30,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[N25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T054506_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9577b3f-z-20150408T055701_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180209T091225_oi[S28,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T054506_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9577b3f-z-20150408T055701_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2a/CP20180221/c4d_180222_
085300_ooi_r_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy PGC3089074; please check the logfile.
Finished galaxy PGC3089074 in 0.094 minutes.
Started working on galaxy PGC3089074 at Sat Feb  8 08:48:35 2020
RA, Dec=216.576324, 30.403207: run=decam (1 north CCDs, 18 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.57632399999997 30.4032067 --width 385 --height 385 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-08T08:48:36.104586
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.57632399999997', '30.4032067', '--width', '385', '--height', '385', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.57632399999997 30.4032067 --width 385 --height 385 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.57632399999997 30.4032067
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 37567 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 37568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 37569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 37570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 37571 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 37572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 37573 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 37574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-08T08:48:37.474595
Keeping 18 CCDs:
   c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S26 z exptime 101.0 propid 2014B-0404 seeing 0.95 MJD 57818.397 object DECaLS_38586_z
   c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S26 r exptime 49.0 propid 2014B-0404 seeing 0.93 MJD 58171.370 object DECaLS_38586_r
   c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S26 g exptime 185.0 propid 2014B-0404 seeing 1.23 MJD 58171.371 object DECaLS_38586_g
   c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S27 g exptime 148.0 propid 2014B-0404 seeing 1.53 MJD 58255.108 object DECaLS_22714_g
   c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S27 z exptime 109.0 propid 2014B-0404 seeing 1.20 MJD 57120.248 object DECaLS_22714_z
   c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S27 r exptime 95.0 propid 2014B-0404 seeing 1.22 MJD 57864.240 object DECaLS_22714_r
   c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S27 g exptime 175.0 propid 2014B-0404 seeing 1.83 MJD 57893.143 object DECaLS_22714_g
   c4d_170718_233712_ooi_g_ls9.fits.fz c4d_170718_233712_ooi_g_ls9-S28 g exptime 113.0 propid 2014B-0404 seeing 1.62 MJD 57952.982 object DECaLS_6842_g
   c4d_170329_070133_ooi_r_ls9.fits.fz c4d_170329_070133_ooi_r_ls9-S28 r exptime 63.0 propid 2014B-0404 seeing 1.20 MJD 57841.291 object DECaLS_6842_r
   c4d_180209_091225_ooi_z_ls9.fits.fz c4d_180209_091225_ooi_z_ls9-S28 z exptime 109.0 propid 2014B-0404 seeing 1.10 MJD 58158.384 object DECaLS_6842_z
   c4d_150411_054724_ooi_z_ls9.fits.fz c4d_150411_054724_ooi_z_ls9-S28 z exptime 88.0 propid 2014B-0404 seeing 1.27 MJD 57123.240 object DECaLS_6842_z
   c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S30 z exptime 101.0 propid 2014B-0404 seeing 1.04 MJD 57818.397 object DECaLS_38586_z
   c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S30 r exptime 49.0 propid 2014B-0404 seeing 1.00 MJD 58171.370 object DECaLS_38586_r
   c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S30 g exptime 185.0 propid 2014B-0404 seeing 1.39 MJD 58171.371 object DECaLS_38586_g
   c4d_160228_082310_ooi_z_ls9.fits.fz c4d_160228_082310_ooi_z_ls9-N25 z exptime 115.0 propid 2014B-0404 seeing 0.95 MJD 57446.348 object DECaLS_6859_z
   c4d_180517_031813_ooi_g_ls9.fits.fz c4d_180517_031813_ooi_g_ls9-N25 g exptime 149.0 propid 2014B-0404 seeing 1.29 MJD 58255.138 object DECaLS_6859_g
   c4d_170329_070435_ooi_r_ls9.fits.fz c4d_170329_070435_ooi_r_ls9-N25 r exptime 62.0 propid 2014B-0404 seeing 1.26 MJD 57841.294 object DECaLS_6859_r
   c4d_170406_065019_ooi_g_ls9.fits.fz c4d_170406_065019_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.57 MJD 57849.282 object DECaLS_6859_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[N25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T054506_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S30,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180209T091225_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9577b3f-z-20150408T055701_oi[S27,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T054506_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2a/CP20180221/c4d_180222_
085419_ooi_g_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy PGC3089074; please check the logfile.
Finished galaxy PGC3089074 in 0.096 minutes.
Started working on galaxy PGC3089074 at Sat Feb  8 12:44:40 2020
RA, Dec=216.576324, 30.403207: run=decam (1 north CCDs, 18 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.57632399999997 30.4032067 --width 385 --height 385 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-08T12:44:42.407784
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.57632399999997', '30.4032067', '--width', '385', '--height', '385', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.57632399999997 30.4032067 --width 385 --height 385 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.57632399999997 30.4032067
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 10663 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 10664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 10665 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 10673 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 10674 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 10675 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 10676 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 10677 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-08T12:44:43.859111
Keeping 18 CCDs:
   c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S26 z exptime 101.0 propid 2014B-0404 seeing 0.95 MJD 57818.397 object DECaLS_38586_z
   c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S26 r exptime 49.0 propid 2014B-0404 seeing 0.93 MJD 58171.370 object DECaLS_38586_r
   c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S26 g exptime 185.0 propid 2014B-0404 seeing 1.23 MJD 58171.371 object DECaLS_38586_g
   c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S27 g exptime 148.0 propid 2014B-0404 seeing 1.53 MJD 58255.108 object DECaLS_22714_g
   c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S27 z exptime 109.0 propid 2014B-0404 seeing 1.20 MJD 57120.248 object DECaLS_22714_z
   c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S27 r exptime 95.0 propid 2014B-0404 seeing 1.22 MJD 57864.240 object DECaLS_22714_r
   c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S27 g exptime 175.0 propid 2014B-0404 seeing 1.83 MJD 57893.143 object DECaLS_22714_g
   c4d_170718_233712_ooi_g_ls9.fits.fz c4d_170718_233712_ooi_g_ls9-S28 g exptime 113.0 propid 2014B-0404 seeing 1.62 MJD 57952.982 object DECaLS_6842_g
   c4d_170329_070133_ooi_r_ls9.fits.fz c4d_170329_070133_ooi_r_ls9-S28 r exptime 63.0 propid 2014B-0404 seeing 1.20 MJD 57841.291 object DECaLS_6842_r
   c4d_180209_091225_ooi_z_ls9.fits.fz c4d_180209_091225_ooi_z_ls9-S28 z exptime 109.0 propid 2014B-0404 seeing 1.10 MJD 58158.384 object DECaLS_6842_z
   c4d_150411_054724_ooi_z_ls9.fits.fz c4d_150411_054724_ooi_z_ls9-S28 z exptime 88.0 propid 2014B-0404 seeing 1.27 MJD 57123.240 object DECaLS_6842_z
   c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S30 z exptime 101.0 propid 2014B-0404 seeing 1.04 MJD 57818.397 object DECaLS_38586_z
   c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S30 r exptime 49.0 propid 2014B-0404 seeing 1.00 MJD 58171.370 object DECaLS_38586_r
   c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S30 g exptime 185.0 propid 2014B-0404 seeing 1.39 MJD 58171.371 object DECaLS_38586_g
   c4d_160228_082310_ooi_z_ls9.fits.fz c4d_160228_082310_ooi_z_ls9-N25 z exptime 115.0 propid 2014B-0404 seeing 0.95 MJD 57446.348 object DECaLS_6859_z
   c4d_180517_031813_ooi_g_ls9.fits.fz c4d_180517_031813_ooi_g_ls9-N25 g exptime 149.0 propid 2014B-0404 seeing 1.29 MJD 58255.138 object DECaLS_6859_g
   c4d_170329_070435_ooi_r_ls9.fits.fz c4d_170329_070435_ooi_r_ls9-N25 r exptime 62.0 propid 2014B-0404 seeing 1.26 MJD 57841.294 object DECaLS_6859_r
   c4d_170406_065019_ooi_g_ls9.fits.fz c4d_170406_065019_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.57 MJD 57849.282 object DECaLS_6859_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T054506_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S30,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180209T091225_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[N25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9577b3f-z-20150408T055701_oi[S27,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T054506_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180209T091225_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9577b3f-z-20150408T055701_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2a/CP20180221/c4d_180222_
085419_ooi_g_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy PGC3089074; please check the logfile.
Finished galaxy PGC3089074 in 0.137 minutes.
Started working on galaxy PGC3089074 at Sun Feb  9 09:52:03 2020
RA, Dec=216.576324, 30.403207: run=decam (1 north CCDs, 18 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.57632399999997 30.4032067 --width 385 --height 385 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-09T09:52:03.704461
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.57632399999997', '30.4032067', '--width', '385', '--height', '385', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.57632399999997 30.4032067 --width 385 --height 385 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.57632399999997 30.4032067
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 35956 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 35957 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 35958 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 35959 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 35960 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 35961 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 35962 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 35963 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 35964 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 35965 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 35966 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 35967 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 35968 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 35969 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 35970 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 35971 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB
Starting process 35972 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071192 MB
Starting process 35973 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072204 MB
Starting process 35974 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072204 MB
Starting process 35975 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071912 MB
Starting process 35976 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071908 MB
Starting process 35977 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB
Starting process 35978 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB
Starting process 35979 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB
Starting process 35980 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB
Starting process 35981 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB
Starting process 35982 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB
Starting process 35983 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB
Starting process 35984 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB
Starting process 35985 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB
Starting process 35986 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB
Starting process 35987 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-09T09:52:05.019491
Keeping 18 CCDs:
   c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S26 z exptime 101.0 propid 2014B-0404 seeing 0.95 MJD 57818.397 object DECaLS_38586_z
   c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S26 r exptime 49.0 propid 2014B-0404 seeing 0.93 MJD 58171.370 object DECaLS_38586_r
   c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S26 g exptime 185.0 propid 2014B-0404 seeing 1.23 MJD 58171.371 object DECaLS_38586_g
   c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S27 g exptime 148.0 propid 2014B-0404 seeing 1.53 MJD 58255.108 object DECaLS_22714_g
   c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S27 z exptime 109.0 propid 2014B-0404 seeing 1.20 MJD 57120.248 object DECaLS_22714_z
   c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S27 r exptime 95.0 propid 2014B-0404 seeing 1.22 MJD 57864.240 object DECaLS_22714_r
   c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S27 g exptime 175.0 propid 2014B-0404 seeing 1.83 MJD 57893.143 object DECaLS_22714_g
   c4d_170718_233712_ooi_g_ls9.fits.fz c4d_170718_233712_ooi_g_ls9-S28 g exptime 113.0 propid 2014B-0404 seeing 1.62 MJD 57952.982 object DECaLS_6842_g
   c4d_170329_070133_ooi_r_ls9.fits.fz c4d_170329_070133_ooi_r_ls9-S28 r exptime 63.0 propid 2014B-0404 seeing 1.20 MJD 57841.291 object DECaLS_6842_r
   c4d_180209_091225_ooi_z_ls9.fits.fz c4d_180209_091225_ooi_z_ls9-S28 z exptime 109.0 propid 2014B-0404 seeing 1.10 MJD 58158.384 object DECaLS_6842_z
   c4d_150411_054724_ooi_z_ls9.fits.fz c4d_150411_054724_ooi_z_ls9-S28 z exptime 88.0 propid 2014B-0404 seeing 1.27 MJD 57123.240 object DECaLS_6842_z
   c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S30 z exptime 101.0 propid 2014B-0404 seeing 1.04 MJD 57818.397 object DECaLS_38586_z
   c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S30 r exptime 49.0 propid 2014B-0404 seeing 1.00 MJD 58171.370 object DECaLS_38586_r
   c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S30 g exptime 185.0 propid 2014B-0404 seeing 1.39 MJD 58171.371 object DECaLS_38586_g
   c4d_160228_082310_ooi_z_ls9.fits.fz c4d_160228_082310_ooi_z_ls9-N25 z exptime 115.0 propid 2014B-0404 seeing 0.95 MJD 57446.348 object DECaLS_6859_z
   c4d_180517_031813_ooi_g_ls9.fits.fz c4d_180517_031813_ooi_g_ls9-N25 g exptime 149.0 propid 2014B-0404 seeing 1.29 MJD 58255.138 object DECaLS_6859_g
   c4d_170329_070435_ooi_r_ls9.fits.fz c4d_170329_070435_ooi_r_ls9-N25 r exptime 62.0 propid 2014B-0404 seeing 1.26 MJD 57841.294 object DECaLS_6859_r
   c4d_170406_065019_ooi_g_ls9.fits.fz c4d_170406_065019_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.57 MJD 57849.282 object DECaLS_6859_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180209T091225_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T054506_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S30,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9577b3f-z-20150408T055701_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[N25,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180209T091225_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T054506_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9577b3f-z-20150408T055701_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2a/CP20180221/c4d_180222_
085300_ooi_r_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy PGC3089074; please check the logfile.
Finished galaxy PGC3089074 in 0.058 minutes.
Started working on galaxy PGC3089074 at Mon Feb 10 06:12:28 2020
RA, Dec=216.576324, 30.403207: run=decam (1 north CCDs, 18 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.57632399999997 30.4032067 --width 385 --height 385 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-10T06:12:28.595615
legacypipe git version: dr9e-pre1-9-g4a51be93
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.57632399999997', '30.4032067', '--width', '385', '--height', '385', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.57632399999997 30.4032067 --width 385 --height 385 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/PGC3089074/PGC3089074-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.57632399999997 30.4032067
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 11379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07112 MB
Starting process 11380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 11381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 11382 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 11383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 11384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071128 MB
Starting process 11385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071132 MB
Starting process 11386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071132 MB
Starting process 11387 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB
Starting process 11388 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB
Starting process 11389 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07114 MB
Starting process 11392 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 11393 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 11394 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 11395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 11396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 11397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 11398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07216 MB
Starting process 11399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07216 MB
Starting process 11400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071872 MB
Starting process 11401 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071872 MB
Starting process 11402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB
Starting process 11403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB
Starting process 11404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB
Starting process 11405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB
Starting process 11406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB
Starting process 11407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB
Starting process 11408 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB
Starting process 11409 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB
Starting process 11410 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB
Starting process 11411 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB
Starting process 11412 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071444 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-10T06:12:29.833328
Keeping 18 CCDs:
   c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S26 z exptime 101.0 propid 2014B-0404 seeing 0.95 MJD 57818.397 object DECaLS_38586_z
   c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S26 r exptime 49.0 propid 2014B-0404 seeing 0.93 MJD 58171.370 object DECaLS_38586_r
   c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S26 g exptime 185.0 propid 2014B-0404 seeing 1.23 MJD 58171.371 object DECaLS_38586_g
   c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S27 g exptime 148.0 propid 2014B-0404 seeing 1.53 MJD 58255.108 object DECaLS_22714_g
   c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S27 z exptime 109.0 propid 2014B-0404 seeing 1.20 MJD 57120.248 object DECaLS_22714_z
   c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S27 r exptime 95.0 propid 2014B-0404 seeing 1.22 MJD 57864.240 object DECaLS_22714_r
   c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S27 g exptime 175.0 propid 2014B-0404 seeing 1.83 MJD 57893.143 object DECaLS_22714_g
   c4d_170718_233712_ooi_g_ls9.fits.fz c4d_170718_233712_ooi_g_ls9-S28 g exptime 113.0 propid 2014B-0404 seeing 1.62 MJD 57952.982 object DECaLS_6842_g
   c4d_170329_070133_ooi_r_ls9.fits.fz c4d_170329_070133_ooi_r_ls9-S28 r exptime 63.0 propid 2014B-0404 seeing 1.20 MJD 57841.291 object DECaLS_6842_r
   c4d_180209_091225_ooi_z_ls9.fits.fz c4d_180209_091225_ooi_z_ls9-S28 z exptime 109.0 propid 2014B-0404 seeing 1.10 MJD 58158.384 object DECaLS_6842_z
   c4d_150411_054724_ooi_z_ls9.fits.fz c4d_150411_054724_ooi_z_ls9-S28 z exptime 88.0 propid 2014B-0404 seeing 1.27 MJD 57123.240 object DECaLS_6842_z
   c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S30 z exptime 101.0 propid 2014B-0404 seeing 1.04 MJD 57818.397 object DECaLS_38586_z
   c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S30 r exptime 49.0 propid 2014B-0404 seeing 1.00 MJD 58171.370 object DECaLS_38586_r
   c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S30 g exptime 185.0 propid 2014B-0404 seeing 1.39 MJD 58171.371 object DECaLS_38586_g
   c4d_160228_082310_ooi_z_ls9.fits.fz c4d_160228_082310_ooi_z_ls9-N25 z exptime 115.0 propid 2014B-0404 seeing 0.95 MJD 57446.348 object DECaLS_6859_z
   c4d_180517_031813_ooi_g_ls9.fits.fz c4d_180517_031813_ooi_g_ls9-N25 g exptime 149.0 propid 2014B-0404 seeing 1.29 MJD 58255.138 object DECaLS_6859_g
   c4d_170329_070435_ooi_r_ls9.fits.fz c4d_170329_070435_ooi_r_ls9-N25 r exptime 62.0 propid 2014B-0404 seeing 1.26 MJD 57841.294 object DECaLS_6859_r
   c4d_170406_065019_ooi_g_ls9.fits.fz c4d_170406_065019_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.57 MJD 57849.282 object DECaLS_6859_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S30,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9577b3f-z-20150408T055701_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T054506_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180209T091225_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[N25,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ea1d-z-20170306T093211_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9577b3f-z-20150408T055701_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180209T091225_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T054506_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2a/CP20180221/c4d_180222_
085419_ooi_g_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy PGC3089074; please check the logfile.
Finished galaxy PGC3089074 in 0.054 minutes.