Started working on galaxy UGC09266 at Sat Feb 8 08:29:38 2020 RA, Dec=216.870738, 29.951906: run=decam (1 north CCDs, 15 south CCDs). python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.870738 29.9519065 --width 545 --height 545 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-08T08:29:39.271956 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.870738', '29.9519065', '--width', '545', '--height', '545', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.870738 29.9519065 --width 545 --height 545 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 216.870738 29.9519065 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 34650 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.07118 MB Starting process 34651 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.07118 MB Starting process 34652 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071184 MB Starting process 34653 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071184 MB Starting process 34654 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071184 MB Starting process 34655 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071184 MB Starting process 34656 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071184 MB Starting process 34657 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071188 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-08T08:29:40.616337 Keeping 15 CCDs: c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S18 r exptime 95.0 propid 2014B-0404 seeing 1.17 MJD 57864.240 object DECaLS_22714_r c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S18 g exptime 175.0 propid 2014B-0404 seeing 1.66 MJD 57893.143 object DECaLS_22714_g c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S18 g exptime 148.0 propid 2014B-0404 seeing 1.41 MJD 58255.108 object DECaLS_22714_g c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S18 z exptime 109.0 propid 2014B-0404 seeing 1.19 MJD 57120.248 object DECaLS_22714_z c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S17 g exptime 185.0 propid 2014B-0404 seeing 1.14 MJD 58171.371 object DECaLS_38586_g c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S17 r exptime 49.0 propid 2014B-0404 seeing 0.96 MJD 58171.370 object DECaLS_38586_r c4d_180209_091225_ooi_z_ls9.fits.fz c4d_180209_091225_ooi_z_ls9-S13 z exptime 109.0 propid 2014B-0404 seeing 1.08 MJD 58158.384 object DECaLS_6842_z c4d_150411_054724_ooi_z_ls9.fits.fz c4d_150411_054724_ooi_z_ls9-S13 z exptime 88.0 propid 2014B-0404 seeing 1.34 MJD 57123.240 object DECaLS_6842_z c4d_170329_070133_ooi_r_ls9.fits.fz c4d_170329_070133_ooi_r_ls9-S13 r exptime 63.0 propid 2014B-0404 seeing 1.22 MJD 57841.291 object DECaLS_6842_r c4d_170718_233712_ooi_g_ls9.fits.fz c4d_170718_233712_ooi_g_ls9-S13 g exptime 113.0 propid 2014B-0404 seeing 1.59 MJD 57952.982 object DECaLS_6842_g c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S12 r exptime 95.0 propid 2014B-0404 seeing 1.16 MJD 57864.240 object DECaLS_22714_r c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S12 g exptime 175.0 propid 2014B-0404 seeing 2.10 MJD 57893.143 object DECaLS_22714_g c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S12 g exptime 148.0 propid 2014B-0404 seeing 1.39 MJD 58255.108 object DECaLS_22714_g c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S12 z exptime 109.0 propid 2014B-0404 seeing 1.19 MJD 57120.248 object DECaLS_22714_z c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S17 z exptime 101.0 propid 2014B-0404 seeing 0.99 MJD 57818.397 object DECaLS_38586_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170306T093211_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527115-z-20180209T091225_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150411T054506_oi[S13,noinherit][2046,4094][real]: DECaLS_ WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170306T093211_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527115-z-20180209T091225_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value OSError: FITSIO status = 104: could not open the named file failed to find or open the following file: (ffopen) /global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170420/c4d_170421_0 54800_ooi_r_ls9.fits.fz Something went wrong; please check the logfile. ERROR: galaxy UGC09266; please check the logfile. Finished galaxy UGC09266 in 0.255 minutes. Started working on galaxy UGC09266 at Sat Feb 8 12:44:49 2020 RA, Dec=216.870738, 29.951906: run=decam (1 north CCDs, 15 south CCDs). python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.870738 29.9519065 --width 545 --height 545 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-08T12:44:50.677821 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.870738', '29.9519065', '--width', '545', '--height', '545', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.870738 29.9519065 --width 545 --height 545 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 216.870738 29.9519065 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 16432 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 16433 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 16434 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 16435 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 16436 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 16437 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Starting process 16438 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Starting process 16439 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-08T12:44:52.108359 Keeping 15 CCDs: c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S18 r exptime 95.0 propid 2014B-0404 seeing 1.17 MJD 57864.240 object DECaLS_22714_r c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S18 g exptime 175.0 propid 2014B-0404 seeing 1.66 MJD 57893.143 object DECaLS_22714_g c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S18 g exptime 148.0 propid 2014B-0404 seeing 1.41 MJD 58255.108 object DECaLS_22714_g c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S18 z exptime 109.0 propid 2014B-0404 seeing 1.19 MJD 57120.248 object DECaLS_22714_z c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S17 g exptime 185.0 propid 2014B-0404 seeing 1.14 MJD 58171.371 object DECaLS_38586_g c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S17 r exptime 49.0 propid 2014B-0404 seeing 0.96 MJD 58171.370 object DECaLS_38586_r c4d_180209_091225_ooi_z_ls9.fits.fz c4d_180209_091225_ooi_z_ls9-S13 z exptime 109.0 propid 2014B-0404 seeing 1.08 MJD 58158.384 object DECaLS_6842_z c4d_150411_054724_ooi_z_ls9.fits.fz c4d_150411_054724_ooi_z_ls9-S13 z exptime 88.0 propid 2014B-0404 seeing 1.34 MJD 57123.240 object DECaLS_6842_z c4d_170329_070133_ooi_r_ls9.fits.fz c4d_170329_070133_ooi_r_ls9-S13 r exptime 63.0 propid 2014B-0404 seeing 1.22 MJD 57841.291 object DECaLS_6842_r c4d_170718_233712_ooi_g_ls9.fits.fz c4d_170718_233712_ooi_g_ls9-S13 g exptime 113.0 propid 2014B-0404 seeing 1.59 MJD 57952.982 object DECaLS_6842_g c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S12 r exptime 95.0 propid 2014B-0404 seeing 1.16 MJD 57864.240 object DECaLS_22714_r c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S12 g exptime 175.0 propid 2014B-0404 seeing 2.10 MJD 57893.143 object DECaLS_22714_g c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S12 g exptime 148.0 propid 2014B-0404 seeing 1.39 MJD 58255.108 object DECaLS_22714_g c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S12 z exptime 109.0 propid 2014B-0404 seeing 1.19 MJD 57120.248 object DECaLS_22714_z c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S17 z exptime 101.0 propid 2014B-0404 seeing 0.99 MJD 57818.397 object DECaLS_38586_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150411T054506_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527115-z-20180209T091225_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170306T093211_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S18,noinherit][2046,4094][real]: DECaLS_ WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150411T054506_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527115-z-20180209T091225_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170306T093211_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value OSError: FITSIO status = 104: could not open the named file failed to find or open the following file: (ffopen) /global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2a/CP20180516/c4d_180517_ 023606_ooi_g_ls9.fits.fz Something went wrong; please check the logfile. ERROR: galaxy UGC09266; please check the logfile. Finished galaxy UGC09266 in 0.095 minutes. Started working on galaxy UGC09266 at Sun Feb 9 10:05:23 2020 RA, Dec=216.870738, 29.951906: run=decam (1 north CCDs, 15 south CCDs). python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.870738 29.9519065 --width 545 --height 545 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-09T10:05:24.113813 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.870738', '29.9519065', '--width', '545', '--height', '545', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.870738 29.9519065 --width 545 --height 545 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 216.870738 29.9519065 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 40368 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 40369 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 40370 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 40371 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 40372 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 40373 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 40374 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 40375 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 40376 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 40377 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB Starting process 40378 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB Starting process 40379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0712 MB Starting process 40380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0712 MB Starting process 40381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0712 MB Starting process 40382 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0712 MB Starting process 40383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0712 MB Starting process 40384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071204 MB Starting process 40385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072216 MB Starting process 40386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072216 MB Starting process 40387 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071924 MB Starting process 40388 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071916 MB Starting process 40389 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB Starting process 40390 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 40391 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 40392 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 40393 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 40394 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB Starting process 40395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 40396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 40397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 40398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071488 MB Starting process 40399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071492 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-09T10:05:25.404393 Keeping 15 CCDs: c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S18 r exptime 95.0 propid 2014B-0404 seeing 1.17 MJD 57864.240 object DECaLS_22714_r c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S18 g exptime 175.0 propid 2014B-0404 seeing 1.66 MJD 57893.143 object DECaLS_22714_g c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S18 g exptime 148.0 propid 2014B-0404 seeing 1.41 MJD 58255.108 object DECaLS_22714_g c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S18 z exptime 109.0 propid 2014B-0404 seeing 1.19 MJD 57120.248 object DECaLS_22714_z c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S17 g exptime 185.0 propid 2014B-0404 seeing 1.14 MJD 58171.371 object DECaLS_38586_g c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S17 r exptime 49.0 propid 2014B-0404 seeing 0.96 MJD 58171.370 object DECaLS_38586_r c4d_180209_091225_ooi_z_ls9.fits.fz c4d_180209_091225_ooi_z_ls9-S13 z exptime 109.0 propid 2014B-0404 seeing 1.08 MJD 58158.384 object DECaLS_6842_z c4d_150411_054724_ooi_z_ls9.fits.fz c4d_150411_054724_ooi_z_ls9-S13 z exptime 88.0 propid 2014B-0404 seeing 1.34 MJD 57123.240 object DECaLS_6842_z c4d_170329_070133_ooi_r_ls9.fits.fz c4d_170329_070133_ooi_r_ls9-S13 r exptime 63.0 propid 2014B-0404 seeing 1.22 MJD 57841.291 object DECaLS_6842_r c4d_170718_233712_ooi_g_ls9.fits.fz c4d_170718_233712_ooi_g_ls9-S13 g exptime 113.0 propid 2014B-0404 seeing 1.59 MJD 57952.982 object DECaLS_6842_g c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S12 r exptime 95.0 propid 2014B-0404 seeing 1.16 MJD 57864.240 object DECaLS_22714_r c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S12 g exptime 175.0 propid 2014B-0404 seeing 2.10 MJD 57893.143 object DECaLS_22714_g c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S12 g exptime 148.0 propid 2014B-0404 seeing 1.39 MJD 58255.108 object DECaLS_22714_g c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S12 z exptime 109.0 propid 2014B-0404 seeing 1.19 MJD 57120.248 object DECaLS_22714_z c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S17 z exptime 101.0 propid 2014B-0404 seeing 0.99 MJD 57818.397 object DECaLS_38586_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150411T054506_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527115-z-20180209T091225_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170306T093211_oi[S17,noinherit][2046,4094][real]: DECaLS_ WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150411T054506_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170306T093211_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value OSError: FITSIO status = 104: could not open the named file failed to find or open the following file: (ffopen) /global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2/CP20170519/c4d_170520_0 33017_ooi_g_ls9.fits.fz Something went wrong; please check the logfile. ERROR: galaxy UGC09266; please check the logfile. Finished galaxy UGC09266 in 0.059 minutes. Started working on galaxy UGC09266 at Mon Feb 10 06:15:13 2020 RA, Dec=216.870738, 29.951906: run=decam (1 north CCDs, 15 south CCDs). python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.870738 29.9519065 --width 545 --height 545 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-10T06:15:13.890375 legacypipe git version: dr9e-pre1-9-g4a51be93 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.870738', '29.9519065', '--width', '545', '--height', '545', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', 'decam', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.870738 29.9519065 --width 545 --height 545 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run decam --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/216/UGC09266/UGC09266-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 216.870738 29.9519065 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 13671 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071132 MB Starting process 13672 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 13673 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 13674 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 13675 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 13676 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB Starting process 13677 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB Starting process 13678 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071148 MB Starting process 13679 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071148 MB Starting process 13680 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071148 MB Starting process 13681 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071152 MB Starting process 13682 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071156 MB Starting process 13683 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071156 MB Starting process 13684 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071156 MB Starting process 13685 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071156 MB Starting process 13686 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 13687 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 13688 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072176 MB Starting process 13689 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072176 MB Starting process 13690 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071888 MB Starting process 13691 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071884 MB Starting process 13692 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071512 MB Starting process 13693 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB Starting process 13694 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB Starting process 13695 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB Starting process 13696 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB Starting process 13697 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB Starting process 13698 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB Starting process 13699 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB Starting process 13700 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB Starting process 13701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB Starting process 13702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071452 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-10T06:15:15.157596 Keeping 15 CCDs: c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S18 r exptime 95.0 propid 2014B-0404 seeing 1.17 MJD 57864.240 object DECaLS_22714_r c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S18 g exptime 175.0 propid 2014B-0404 seeing 1.66 MJD 57893.143 object DECaLS_22714_g c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S18 g exptime 148.0 propid 2014B-0404 seeing 1.41 MJD 58255.108 object DECaLS_22714_g c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S18 z exptime 109.0 propid 2014B-0404 seeing 1.19 MJD 57120.248 object DECaLS_22714_z c4d_180222_085419_ooi_g_ls9.fits.fz c4d_180222_085419_ooi_g_ls9-S17 g exptime 185.0 propid 2014B-0404 seeing 1.14 MJD 58171.371 object DECaLS_38586_g c4d_180222_085300_ooi_r_ls9.fits.fz c4d_180222_085300_ooi_r_ls9-S17 r exptime 49.0 propid 2014B-0404 seeing 0.96 MJD 58171.370 object DECaLS_38586_r c4d_180209_091225_ooi_z_ls9.fits.fz c4d_180209_091225_ooi_z_ls9-S13 z exptime 109.0 propid 2014B-0404 seeing 1.08 MJD 58158.384 object DECaLS_6842_z c4d_150411_054724_ooi_z_ls9.fits.fz c4d_150411_054724_ooi_z_ls9-S13 z exptime 88.0 propid 2014B-0404 seeing 1.34 MJD 57123.240 object DECaLS_6842_z c4d_170329_070133_ooi_r_ls9.fits.fz c4d_170329_070133_ooi_r_ls9-S13 r exptime 63.0 propid 2014B-0404 seeing 1.22 MJD 57841.291 object DECaLS_6842_r c4d_170718_233712_ooi_g_ls9.fits.fz c4d_170718_233712_ooi_g_ls9-S13 g exptime 113.0 propid 2014B-0404 seeing 1.59 MJD 57952.982 object DECaLS_6842_g c4d_170421_054800_ooi_r_ls9.fits.fz c4d_170421_054800_ooi_r_ls9-S12 r exptime 95.0 propid 2014B-0404 seeing 1.16 MJD 57864.240 object DECaLS_22714_r c4d_170520_033017_ooi_g_ls9.fits.fz c4d_170520_033017_ooi_g_ls9-S12 g exptime 175.0 propid 2014B-0404 seeing 2.10 MJD 57893.143 object DECaLS_22714_g c4d_180517_023606_ooi_g_ls9.fits.fz c4d_180517_023606_ooi_g_ls9-S12 g exptime 148.0 propid 2014B-0404 seeing 1.39 MJD 58255.108 object DECaLS_22714_g c4d_150408_055941_ooi_z_ls9.fits.fz c4d_150408_055941_ooi_z_ls9-S12 z exptime 109.0 propid 2014B-0404 seeing 1.19 MJD 57120.248 object DECaLS_22714_z c4d_170306_093442_ooi_z_ls9.fits.fz c4d_170306_093442_ooi_z_ls9-S17 z exptime 101.0 propid 2014B-0404 seeing 0.99 MJD 57818.397 object DECaLS_38586_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150411T054506_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527115-z-20180209T091225_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170306T093211_oi[S17,noinherit][2046,4094][real]: DECaLS_ WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150411T054506_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055701_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170306T093211_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value OSError: FITSIO status = 104: could not open the named file failed to find or open the following file: (ffopen) /global/cscratch1/sd/desimpp/dr9e/images/decam/CP/V4.8.2a/CP20180516/c4d_180517_ 023606_ooi_g_ls9.fits.fz Something went wrong; please check the logfile. ERROR: galaxy UGC09266; please check the logfile. Finished galaxy UGC09266 in 0.059 minutes.