Started working on galaxy UGC09268 at Sat Feb  8 08:52:13 2020
RA, Dec=216.914664, 32.139777: run=decam (7 north CCDs, 23 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.91466399999996 32.1397765 --width 773 --height 773 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-08T08:52:13.955744
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.91466399999996', '32.1397765', '--width', '773', '--height', '773', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.91466399999996 32.1397765 --width 773 --height 773 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.91466399999996 32.1397765
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 44594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 44595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 44596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 44597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 44598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 44599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 44601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 44600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-08T08:52:15.354375
Keeping 23 CCDs:
   c4d_170422_051737_ooi_g_ls9.fits.fz c4d_170422_051737_ooi_g_ls9-S29 g exptime 121.0 propid 2014B-0404 seeing 1.57 MJD 57865.219 object DECaLS_22731_g
   c4d_170503_050055_ooi_r_ls9.fits.fz c4d_170503_050055_ooi_r_ls9-S29 r exptime 112.0 propid 2014B-0404 seeing 1.42 MJD 57876.207 object DECaLS_22731_r
   c4d_160226_081655_ooi_z_ls9.fits.fz c4d_160226_081655_ooi_z_ls9-S29 z exptime 135.0 propid 2014B-0404 seeing 1.17 MJD 57444.343 object DECaLS_22731_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N24 r exptime 52.0 propid 2014B-0404 seeing 0.99 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N24 g exptime 125.0 propid 2014B-0404 seeing 1.27 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N24 z exptime 147.0 propid 2014B-0404 seeing 1.03 MJD 57446.353 object DECaLS_6860_z
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-N23 g exptime 169.0 propid 2014B-0404 seeing 1.67 MJD 57951.996 object DECaLS_22732_g
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-N23 r exptime 96.0 propid 2014B-0404 seeing 1.47 MJD 57951.994 object DECaLS_22732_r
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-N23 z exptime 135.0 propid 2014B-0404 seeing 0.97 MJD 57444.341 object DECaLS_22732_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N28 r exptime 52.0 propid 2014B-0404 seeing 1.06 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N28 g exptime 125.0 propid 2014B-0404 seeing 1.25 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N28 z exptime 147.0 propid 2014B-0404 seeing 1.00 MJD 57446.353 object DECaLS_6860_z
   c4d_190307_071335_ooi_r_ls9.fits.fz c4d_190307_071335_ooi_r_ls9-N22 r exptime 49.0 propid 2014B-0404 seeing 1.56 MJD 58549.301 object DECaLS_38604_r
   c4d_180221_085747_ooi_g_ls9.fits.fz c4d_180221_085747_ooi_g_ls9-N22 g exptime 173.0 propid 2014B-0404 seeing 1.31 MJD 58170.373 object DECaLS_38604_g
   c4d_180513_031444_ooi_r_ls9.fits.fz c4d_180513_031444_ooi_r_ls9-N22 r exptime 166.0 propid 2014B-0404 seeing 1.80 MJD 58251.135 object DECaLS_38604_r
   c4d_160226_090239_ooi_z_ls9.fits.fz c4d_160226_090239_ooi_z_ls9-N22 z exptime 140.0 propid 2014B-0404 seeing 0.97 MJD 57444.375 object DECaLS_38604_z
   c4d_180517_031813_ooi_g_ls9.fits.fz c4d_180517_031813_ooi_g_ls9-S29 g exptime 149.0 propid 2014B-0404 seeing 1.54 MJD 58255.138 object DECaLS_6859_g
   c4d_170406_065019_ooi_g_ls9.fits.fz c4d_170406_065019_ooi_g_ls9-S29 g exptime 175.0 propid 2014B-0404 seeing 1.79 MJD 57849.282 object DECaLS_6859_g
   c4d_170329_070435_ooi_r_ls9.fits.fz c4d_170329_070435_ooi_r_ls9-S29 r exptime 62.0 propid 2014B-0404 seeing 1.33 MJD 57841.294 object DECaLS_6859_r
   c4d_160228_082310_ooi_z_ls9.fits.fz c4d_160228_082310_ooi_z_ls9-S29 z exptime 115.0 propid 2014B-0404 seeing 1.02 MJD 57446.348 object DECaLS_6859_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N23 r exptime 52.0 propid 2014B-0404 seeing 1.13 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N23 g exptime 125.0 propid 2014B-0404 seeing 1.29 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N23 z exptime 147.0 propid 2014B-0404 seeing 1.10 MJD 57446.353 object DECaLS_6860_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081350_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[N22,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081350_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170421/c4d_170422_0
51737_ooi_g_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy UGC09268; please check the logfile.
Finished galaxy UGC09268 in 0.104 minutes.
Started working on galaxy UGC09268 at Sat Feb  8 12:47:51 2020
RA, Dec=216.914664, 32.139777: run=decam (7 north CCDs, 23 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.91466399999996 32.1397765 --width 773 --height 773 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-08T12:47:52.071753
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.91466399999996', '32.1397765', '--width', '773', '--height', '773', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.91466399999996 32.1397765 --width 773 --height 773 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.91466399999996 32.1397765
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 54922 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 71 MB, VmData: 141 MB, maxrss: 0.071952 MB
Starting process 54923 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071952 MB
Starting process 54924 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071952 MB
Starting process 54925 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071952 MB
Starting process 54926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071952 MB
Starting process 54928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071964 MB
Starting process 54927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071956 MB
Starting process 54929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071964 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-08T12:48:12.749949
Keeping 23 CCDs:
   c4d_170422_051737_ooi_g_ls9.fits.fz c4d_170422_051737_ooi_g_ls9-S29 g exptime 121.0 propid 2014B-0404 seeing 1.57 MJD 57865.219 object DECaLS_22731_g
   c4d_170503_050055_ooi_r_ls9.fits.fz c4d_170503_050055_ooi_r_ls9-S29 r exptime 112.0 propid 2014B-0404 seeing 1.42 MJD 57876.207 object DECaLS_22731_r
   c4d_160226_081655_ooi_z_ls9.fits.fz c4d_160226_081655_ooi_z_ls9-S29 z exptime 135.0 propid 2014B-0404 seeing 1.17 MJD 57444.343 object DECaLS_22731_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N24 r exptime 52.0 propid 2014B-0404 seeing 0.99 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N24 g exptime 125.0 propid 2014B-0404 seeing 1.27 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N24 z exptime 147.0 propid 2014B-0404 seeing 1.03 MJD 57446.353 object DECaLS_6860_z
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-N23 g exptime 169.0 propid 2014B-0404 seeing 1.67 MJD 57951.996 object DECaLS_22732_g
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-N23 r exptime 96.0 propid 2014B-0404 seeing 1.47 MJD 57951.994 object DECaLS_22732_r
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-N23 z exptime 135.0 propid 2014B-0404 seeing 0.97 MJD 57444.341 object DECaLS_22732_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N28 r exptime 52.0 propid 2014B-0404 seeing 1.06 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N28 g exptime 125.0 propid 2014B-0404 seeing 1.25 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N28 z exptime 147.0 propid 2014B-0404 seeing 1.00 MJD 57446.353 object DECaLS_6860_z
   c4d_190307_071335_ooi_r_ls9.fits.fz c4d_190307_071335_ooi_r_ls9-N22 r exptime 49.0 propid 2014B-0404 seeing 1.56 MJD 58549.301 object DECaLS_38604_r
   c4d_180221_085747_ooi_g_ls9.fits.fz c4d_180221_085747_ooi_g_ls9-N22 g exptime 173.0 propid 2014B-0404 seeing 1.31 MJD 58170.373 object DECaLS_38604_g
   c4d_180513_031444_ooi_r_ls9.fits.fz c4d_180513_031444_ooi_r_ls9-N22 r exptime 166.0 propid 2014B-0404 seeing 1.80 MJD 58251.135 object DECaLS_38604_r
   c4d_160226_090239_ooi_z_ls9.fits.fz c4d_160226_090239_ooi_z_ls9-N22 z exptime 140.0 propid 2014B-0404 seeing 0.97 MJD 57444.375 object DECaLS_38604_z
   c4d_180517_031813_ooi_g_ls9.fits.fz c4d_180517_031813_ooi_g_ls9-S29 g exptime 149.0 propid 2014B-0404 seeing 1.54 MJD 58255.138 object DECaLS_6859_g
   c4d_170406_065019_ooi_g_ls9.fits.fz c4d_170406_065019_ooi_g_ls9-S29 g exptime 175.0 propid 2014B-0404 seeing 1.79 MJD 57849.282 object DECaLS_6859_g
   c4d_170329_070435_ooi_r_ls9.fits.fz c4d_170329_070435_ooi_r_ls9-S29 r exptime 62.0 propid 2014B-0404 seeing 1.33 MJD 57841.294 object DECaLS_6859_r
   c4d_160228_082310_ooi_z_ls9.fits.fz c4d_160228_082310_ooi_z_ls9-S29 z exptime 115.0 propid 2014B-0404 seeing 1.02 MJD 57446.348 object DECaLS_6859_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N23 r exptime 52.0 propid 2014B-0404 seeing 1.13 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N23 g exptime 125.0 propid 2014B-0404 seeing 1.29 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N23 z exptime 147.0 propid 2014B-0404 seeing 1.10 MJD 57446.353 object DECaLS_6860_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081350_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[N22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N23,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081350_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170421/c4d_170422_0
51737_ooi_g_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy UGC09268; please check the logfile.
Finished galaxy UGC09268 in 0.443 minutes.
Started working on galaxy UGC09268 at Sun Feb  9 09:30:29 2020
RA, Dec=216.914664, 32.139777: run=decam (7 north CCDs, 23 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.91466399999996 32.1397765 --width 773 --height 773 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-09T09:30:31.115426
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.91466399999996', '32.1397765', '--width', '773', '--height', '773', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.91466399999996 32.1397765 --width 773 --height 773 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.91466399999996 32.1397765
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 32797 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 32798 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 32799 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 32800 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 32801 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 32802 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 32803 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 32804 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 32805 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 32806 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 32807 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 32808 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 32809 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 32810 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 32811 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 32812 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 32813 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 32814 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.0722 MB
Starting process 32815 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.0722 MB
Starting process 32816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071904 MB
Starting process 32817 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071908 MB
Starting process 32818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071476 MB
Starting process 32819 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071476 MB
Starting process 32820 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071476 MB
Starting process 32821 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071476 MB
Starting process 32822 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Starting process 32823 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Starting process 32824 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Starting process 32825 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Starting process 32826 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Starting process 32827 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Starting process 32828 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-09T09:30:32.366546
Keeping 23 CCDs:
   c4d_170422_051737_ooi_g_ls9.fits.fz c4d_170422_051737_ooi_g_ls9-S29 g exptime 121.0 propid 2014B-0404 seeing 1.57 MJD 57865.219 object DECaLS_22731_g
   c4d_170503_050055_ooi_r_ls9.fits.fz c4d_170503_050055_ooi_r_ls9-S29 r exptime 112.0 propid 2014B-0404 seeing 1.42 MJD 57876.207 object DECaLS_22731_r
   c4d_160226_081655_ooi_z_ls9.fits.fz c4d_160226_081655_ooi_z_ls9-S29 z exptime 135.0 propid 2014B-0404 seeing 1.17 MJD 57444.343 object DECaLS_22731_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N24 r exptime 52.0 propid 2014B-0404 seeing 0.99 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N24 g exptime 125.0 propid 2014B-0404 seeing 1.27 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N24 z exptime 147.0 propid 2014B-0404 seeing 1.03 MJD 57446.353 object DECaLS_6860_z
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-N23 g exptime 169.0 propid 2014B-0404 seeing 1.67 MJD 57951.996 object DECaLS_22732_g
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-N23 r exptime 96.0 propid 2014B-0404 seeing 1.47 MJD 57951.994 object DECaLS_22732_r
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-N23 z exptime 135.0 propid 2014B-0404 seeing 0.97 MJD 57444.341 object DECaLS_22732_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N28 r exptime 52.0 propid 2014B-0404 seeing 1.06 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N28 g exptime 125.0 propid 2014B-0404 seeing 1.25 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N28 z exptime 147.0 propid 2014B-0404 seeing 1.00 MJD 57446.353 object DECaLS_6860_z
   c4d_190307_071335_ooi_r_ls9.fits.fz c4d_190307_071335_ooi_r_ls9-N22 r exptime 49.0 propid 2014B-0404 seeing 1.56 MJD 58549.301 object DECaLS_38604_r
   c4d_180221_085747_ooi_g_ls9.fits.fz c4d_180221_085747_ooi_g_ls9-N22 g exptime 173.0 propid 2014B-0404 seeing 1.31 MJD 58170.373 object DECaLS_38604_g
   c4d_180513_031444_ooi_r_ls9.fits.fz c4d_180513_031444_ooi_r_ls9-N22 r exptime 166.0 propid 2014B-0404 seeing 1.80 MJD 58251.135 object DECaLS_38604_r
   c4d_160226_090239_ooi_z_ls9.fits.fz c4d_160226_090239_ooi_z_ls9-N22 z exptime 140.0 propid 2014B-0404 seeing 0.97 MJD 57444.375 object DECaLS_38604_z
   c4d_180517_031813_ooi_g_ls9.fits.fz c4d_180517_031813_ooi_g_ls9-S29 g exptime 149.0 propid 2014B-0404 seeing 1.54 MJD 58255.138 object DECaLS_6859_g
   c4d_170406_065019_ooi_g_ls9.fits.fz c4d_170406_065019_ooi_g_ls9-S29 g exptime 175.0 propid 2014B-0404 seeing 1.79 MJD 57849.282 object DECaLS_6859_g
   c4d_170329_070435_ooi_r_ls9.fits.fz c4d_170329_070435_ooi_r_ls9-S29 r exptime 62.0 propid 2014B-0404 seeing 1.33 MJD 57841.294 object DECaLS_6859_r
   c4d_160228_082310_ooi_z_ls9.fits.fz c4d_160228_082310_ooi_z_ls9-S29 z exptime 115.0 propid 2014B-0404 seeing 1.02 MJD 57446.348 object DECaLS_6859_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N23 r exptime 52.0 propid 2014B-0404 seeing 1.13 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N23 g exptime 125.0 propid 2014B-0404 seeing 1.29 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N23 z exptime 147.0 propid 2014B-0404 seeing 1.10 MJD 57446.353 object DECaLS_6860_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081350_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[N22,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081350_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170421/c4d_170422_0
51737_ooi_g_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy UGC09268; please check the logfile.
Finished galaxy UGC09268 in 0.073 minutes.
Started working on galaxy UGC09268 at Sun Feb  9 10:23:21 2020
RA, Dec=216.914664, 32.139777: run=decam (7 north CCDs, 23 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.91466399999996 32.1397765 --width 773 --height 773 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-09T10:23:21.908720
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.91466399999996', '32.1397765', '--width', '773', '--height', '773', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.91466399999996 32.1397765 --width 773 --height 773 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.91466399999996 32.1397765
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 43906 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 43907 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 43908 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 43909 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 43910 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 43911 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 43912 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 43913 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 43914 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 43915 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 43916 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 43917 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 43918 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 43919 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 43920 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 43921 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 43922 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071192 MB
Starting process 43923 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072204 MB
Starting process 43924 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072204 MB
Starting process 43925 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071912 MB
Starting process 43926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071904 MB
Starting process 43927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB
Starting process 43928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Starting process 43929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Starting process 43930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Starting process 43931 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Starting process 43932 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB
Starting process 43933 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Starting process 43934 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Starting process 43935 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Starting process 43936 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Starting process 43937 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-09T10:23:23.161292
Keeping 23 CCDs:
   c4d_170422_051737_ooi_g_ls9.fits.fz c4d_170422_051737_ooi_g_ls9-S29 g exptime 121.0 propid 2014B-0404 seeing 1.57 MJD 57865.219 object DECaLS_22731_g
   c4d_170503_050055_ooi_r_ls9.fits.fz c4d_170503_050055_ooi_r_ls9-S29 r exptime 112.0 propid 2014B-0404 seeing 1.42 MJD 57876.207 object DECaLS_22731_r
   c4d_160226_081655_ooi_z_ls9.fits.fz c4d_160226_081655_ooi_z_ls9-S29 z exptime 135.0 propid 2014B-0404 seeing 1.17 MJD 57444.343 object DECaLS_22731_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N24 r exptime 52.0 propid 2014B-0404 seeing 0.99 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N24 g exptime 125.0 propid 2014B-0404 seeing 1.27 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N24 z exptime 147.0 propid 2014B-0404 seeing 1.03 MJD 57446.353 object DECaLS_6860_z
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-N23 g exptime 169.0 propid 2014B-0404 seeing 1.67 MJD 57951.996 object DECaLS_22732_g
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-N23 r exptime 96.0 propid 2014B-0404 seeing 1.47 MJD 57951.994 object DECaLS_22732_r
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-N23 z exptime 135.0 propid 2014B-0404 seeing 0.97 MJD 57444.341 object DECaLS_22732_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N28 r exptime 52.0 propid 2014B-0404 seeing 1.06 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N28 g exptime 125.0 propid 2014B-0404 seeing 1.25 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N28 z exptime 147.0 propid 2014B-0404 seeing 1.00 MJD 57446.353 object DECaLS_6860_z
   c4d_190307_071335_ooi_r_ls9.fits.fz c4d_190307_071335_ooi_r_ls9-N22 r exptime 49.0 propid 2014B-0404 seeing 1.56 MJD 58549.301 object DECaLS_38604_r
   c4d_180221_085747_ooi_g_ls9.fits.fz c4d_180221_085747_ooi_g_ls9-N22 g exptime 173.0 propid 2014B-0404 seeing 1.31 MJD 58170.373 object DECaLS_38604_g
   c4d_180513_031444_ooi_r_ls9.fits.fz c4d_180513_031444_ooi_r_ls9-N22 r exptime 166.0 propid 2014B-0404 seeing 1.80 MJD 58251.135 object DECaLS_38604_r
   c4d_160226_090239_ooi_z_ls9.fits.fz c4d_160226_090239_ooi_z_ls9-N22 z exptime 140.0 propid 2014B-0404 seeing 0.97 MJD 57444.375 object DECaLS_38604_z
   c4d_180517_031813_ooi_g_ls9.fits.fz c4d_180517_031813_ooi_g_ls9-S29 g exptime 149.0 propid 2014B-0404 seeing 1.54 MJD 58255.138 object DECaLS_6859_g
   c4d_170406_065019_ooi_g_ls9.fits.fz c4d_170406_065019_ooi_g_ls9-S29 g exptime 175.0 propid 2014B-0404 seeing 1.79 MJD 57849.282 object DECaLS_6859_g
   c4d_170329_070435_ooi_r_ls9.fits.fz c4d_170329_070435_ooi_r_ls9-S29 r exptime 62.0 propid 2014B-0404 seeing 1.33 MJD 57841.294 object DECaLS_6859_r
   c4d_160228_082310_ooi_z_ls9.fits.fz c4d_160228_082310_ooi_z_ls9-S29 z exptime 115.0 propid 2014B-0404 seeing 1.02 MJD 57446.348 object DECaLS_6859_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N23 r exptime 52.0 propid 2014B-0404 seeing 1.13 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N23 g exptime 125.0 propid 2014B-0404 seeing 1.29 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N23 z exptime 147.0 propid 2014B-0404 seeing 1.10 MJD 57446.353 object DECaLS_6860_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081350_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[N22,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081350_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170421/c4d_170422_0
51737_ooi_g_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy UGC09268; please check the logfile.
Finished galaxy UGC09268 in 0.061 minutes.
Started working on galaxy UGC09268 at Mon Feb 10 06:17:10 2020
RA, Dec=216.914664, 32.139777: run=decam (7 north CCDs, 23 south CCDs).
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.91466399999996 32.1397765 --width 773 --height 773 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-10T06:17:10.853203
legacypipe git version: dr9e-pre1-9-g4a51be93
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.91466399999996', '32.1397765', '--width', '773', '--height', '773', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.91466399999996 32.1397765 --width 773 --height 773 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09268/UGC09268-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 216.91466399999996 32.1397765
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 15078 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07112 MB
Starting process 15079 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15080 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15081 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15082 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15083 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB
Starting process 15084 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071132 MB
Starting process 15085 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB
Starting process 15086 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB
Starting process 15087 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB
Starting process 15088 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB
Starting process 15089 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15090 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15091 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15092 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15093 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15094 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071148 MB
Starting process 15095 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07216 MB
Starting process 15096 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07216 MB
Starting process 15097 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071884 MB
Starting process 15098 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072028 MB
Starting process 15099 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB
Starting process 15100 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB
Starting process 15101 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB
Starting process 15102 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB
Starting process 15103 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB
Starting process 15104 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB
Starting process 15105 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071436 MB
Starting process 15106 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071436 MB
Starting process 15107 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071436 MB
Starting process 15108 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071436 MB
Starting process 15109 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071436 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-10T06:17:12.108748
Keeping 23 CCDs:
   c4d_170422_051737_ooi_g_ls9.fits.fz c4d_170422_051737_ooi_g_ls9-S29 g exptime 121.0 propid 2014B-0404 seeing 1.57 MJD 57865.219 object DECaLS_22731_g
   c4d_170503_050055_ooi_r_ls9.fits.fz c4d_170503_050055_ooi_r_ls9-S29 r exptime 112.0 propid 2014B-0404 seeing 1.42 MJD 57876.207 object DECaLS_22731_r
   c4d_160226_081655_ooi_z_ls9.fits.fz c4d_160226_081655_ooi_z_ls9-S29 z exptime 135.0 propid 2014B-0404 seeing 1.17 MJD 57444.343 object DECaLS_22731_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N24 r exptime 52.0 propid 2014B-0404 seeing 0.99 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N24 g exptime 125.0 propid 2014B-0404 seeing 1.27 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N24 z exptime 147.0 propid 2014B-0404 seeing 1.03 MJD 57446.353 object DECaLS_6860_z
   c4d_170717_235713_ooi_g_ls9.fits.fz c4d_170717_235713_ooi_g_ls9-N23 g exptime 169.0 propid 2014B-0404 seeing 1.67 MJD 57951.996 object DECaLS_22732_g
   c4d_170717_235355_ooi_r_ls9.fits.fz c4d_170717_235355_ooi_r_ls9-N23 r exptime 96.0 propid 2014B-0404 seeing 1.47 MJD 57951.994 object DECaLS_22732_r
   c4d_160226_081409_ooi_z_ls9.fits.fz c4d_160226_081409_ooi_z_ls9-N23 z exptime 135.0 propid 2014B-0404 seeing 0.97 MJD 57444.341 object DECaLS_22732_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N28 r exptime 52.0 propid 2014B-0404 seeing 1.06 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N28 g exptime 125.0 propid 2014B-0404 seeing 1.25 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N28 z exptime 147.0 propid 2014B-0404 seeing 1.00 MJD 57446.353 object DECaLS_6860_z
   c4d_190307_071335_ooi_r_ls9.fits.fz c4d_190307_071335_ooi_r_ls9-N22 r exptime 49.0 propid 2014B-0404 seeing 1.56 MJD 58549.301 object DECaLS_38604_r
   c4d_180221_085747_ooi_g_ls9.fits.fz c4d_180221_085747_ooi_g_ls9-N22 g exptime 173.0 propid 2014B-0404 seeing 1.31 MJD 58170.373 object DECaLS_38604_g
   c4d_180513_031444_ooi_r_ls9.fits.fz c4d_180513_031444_ooi_r_ls9-N22 r exptime 166.0 propid 2014B-0404 seeing 1.80 MJD 58251.135 object DECaLS_38604_r
   c4d_160226_090239_ooi_z_ls9.fits.fz c4d_160226_090239_ooi_z_ls9-N22 z exptime 140.0 propid 2014B-0404 seeing 0.97 MJD 57444.375 object DECaLS_38604_z
   c4d_180517_031813_ooi_g_ls9.fits.fz c4d_180517_031813_ooi_g_ls9-S29 g exptime 149.0 propid 2014B-0404 seeing 1.54 MJD 58255.138 object DECaLS_6859_g
   c4d_170406_065019_ooi_g_ls9.fits.fz c4d_170406_065019_ooi_g_ls9-S29 g exptime 175.0 propid 2014B-0404 seeing 1.79 MJD 57849.282 object DECaLS_6859_g
   c4d_170329_070435_ooi_r_ls9.fits.fz c4d_170329_070435_ooi_r_ls9-S29 r exptime 62.0 propid 2014B-0404 seeing 1.33 MJD 57841.294 object DECaLS_6859_r
   c4d_160228_082310_ooi_z_ls9.fits.fz c4d_160228_082310_ooi_z_ls9-S29 z exptime 115.0 propid 2014B-0404 seeing 1.02 MJD 57446.348 object DECaLS_6859_z
   c4d_180213_090013_ooi_r_ls9.fits.fz c4d_180213_090013_ooi_r_ls9-N23 r exptime 52.0 propid 2014B-0404 seeing 1.13 MJD 58162.375 object DECaLS_6860_r
   c4d_170422_052010_ooi_g_ls9.fits.fz c4d_170422_052010_ooi_g_ls9-N23 g exptime 125.0 propid 2014B-0404 seeing 1.29 MJD 57865.220 object DECaLS_6860_g
   c4d_160228_083134_ooi_z_ls9.fits.fz c4d_160228_083134_ooi_z_ls9-N23 z exptime 147.0 propid 2014B-0404 seeing 1.10 MJD 57446.353 object DECaLS_6860_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081350_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081104_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[N22,noinherit][2046,4094][real]: DECaLS_
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T081350_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082024_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f856-z-20160228T082816_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95508ff-z-20160226T085930_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
OSError: FITSIO status = 104: could not open the named file
failed to find or open the following file: (ffopen)
/global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170421/c4d_170422_0
51737_ooi_g_ls9.fits.fz

Something went wrong; please check the logfile.
ERROR: galaxy UGC09268; please check the logfile.
Finished galaxy UGC09268 in 0.064 minutes.