Started working on galaxy UGC05067 at Sat Feb 8 08:00:00 2020 python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-08T08:00:01.715525 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '143.05176749999998', '68.43969659999999', '--width', '785', '--height', '785', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 143.05176749999998 68.43969659999999 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 36304 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071172 MB Starting process 36308 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071176 MB Starting process 36310 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071176 MB Starting process 36311 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071532 MB Starting process 36312 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071472 MB Starting process 36313 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071472 MB Starting process 36315 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071472 MB Starting process 36316 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 731 MB, VmSize: 731 MB, VmRSS: 70 MB, VmData: 143 MB, maxrss: 0.071184 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-08T08:00:18.084008 Keeping 15 CCDs: ksb_190111_110456_ooi_g_ls9.fits.fz ksb_190111_110456_ooi_g_ls9-CCD1 g exptime 123.643 propid NOTBASS seeing 2.06 MJD 58494.462 object ksb_190128_103155_ooi_r_ls9.fits.fz ksb_190128_103155_ooi_r_ls9-CCD1 r exptime 144.023 propid NOTBASS seeing 1.31 MJD 58511.439 object ksb_190112_101235_ooi_g_ls9.fits.fz ksb_190112_101235_ooi_g_ls9-CCD3 g exptime 126.55 propid NOTBASS seeing 1.56 MJD 58495.425 object ksb_190128_105043_ooi_r_ls9.fits.fz ksb_190128_105043_ooi_r_ls9-CCD3 r exptime 165.75 propid NOTBASS seeing 1.17 MJD 58511.452 object ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD1 r exptime 112.96 propid NOTBASS seeing 1.58 MJD 58514.475 object ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD1 g exptime 178.794 propid BASS seeing 1.95 MJD 58219.275 object 44282 ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD2 g exptime 212.212 propid NOTBASS seeing 2.40 MJD 58510.289 object ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD2 r exptime 142.272 propid NOTBASS seeing 1.51 MJD 58523.380 object k4m_160125_090839_ooi_zd_ls9.fits.fz k4m_160125_090839_ooi_zd_ls9-CCD2 z exptime 122.105 propid 2016B-0453 seeing 0.99 MJD 57412.381 object MzLS_709452_z k4m_160317_055448_ooi_zd_ls9.fits.fz k4m_160317_055448_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 1.19 MJD 57464.246 object MzLS_710387_z k4m_160320_062048_ooi_zd_ls9.fits.fz k4m_160320_062048_ooi_zd_ls9-CCD4 z exptime 89.102 propid 2016A-0453 seeing 0.78 MJD 57467.264 object MzLS_709921_z k4m_170403_050712_ooi_zd_ls9.fits.fz k4m_170403_050712_ooi_zd_ls9-CCD1 z exptime 106.105 propid 2016A-0453 seeing 1.15 MJD 57846.213 object MzLS_710388_z k4m_160317_055914_ooi_zd_ls9.fits.fz k4m_160317_055914_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.25 MJD 57464.249 object MzLS_710388_z k4m_160125_090250_ooi_zd_ls9.fits.fz k4m_160125_090250_ooi_zd_ls9-CCD3 z exptime 120.104 propid 2016B-0453 seeing 0.99 MJD 57412.377 object MzLS_710850_z k4m_180117_060239_ooi_zd_ls9.fits.fz k4m_180117_060239_ooi_zd_ls9-CCD2 z exptime 176.107 propid 2016A-0453 seeing 1.00 MJD 58135.252 object MzLS_709452_z Faked up EXPNUM 85110241 Faked up EXPNUM 85110241 Faked up EXPNUM 85110241 90prime get_fwhm: self.fwhm = 2.57 WARNING: EXPNUM None!=160125090250 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090250_ooi_zd_ls9.fits.fz header Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 90prime get_fwhm: self.fwhm = 5.29 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 90prime get_fwhm: self.fwhm = 4.31 mosaic get_fwhm: self.fwhm = 4.81 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 90prime get_fwhm: self.fwhm = 3.33 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 90prime get_fwhm: self.fwhm = 2.89 WARNING: EXPNUM None!=160125090839 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090839_ooi_zd_ls9.fits.fz header mosaic get_fwhm: self.fwhm = 4.43 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 90prime get_fwhm: self.fwhm = 3.49 mosaic get_fwhm: self.fwhm = 4.57 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value AssertionError Something went wrong; please check the logfile. ERROR: galaxy UGC05067; please check the logfile. Finished galaxy UGC05067 in 0.357 minutes. Started working on galaxy UGC05067 at Sat Feb 8 08:47:18 2020 python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-08T08:47:19.011431 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '143.05176749999998', '68.43969659999999', '--width', '785', '--height', '785', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 143.05176749999998 68.43969659999999 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 24317 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 24318 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 24319 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 24320 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 24321 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 24322 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 24323 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 24324 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-08T08:47:20.325444 Keeping 15 CCDs: ksb_190111_110456_ooi_g_ls9.fits.fz ksb_190111_110456_ooi_g_ls9-CCD1 g exptime 123.643 propid NOTBASS seeing 2.06 MJD 58494.462 object ksb_190128_103155_ooi_r_ls9.fits.fz ksb_190128_103155_ooi_r_ls9-CCD1 r exptime 144.023 propid NOTBASS seeing 1.31 MJD 58511.439 object ksb_190112_101235_ooi_g_ls9.fits.fz ksb_190112_101235_ooi_g_ls9-CCD3 g exptime 126.55 propid NOTBASS seeing 1.56 MJD 58495.425 object ksb_190128_105043_ooi_r_ls9.fits.fz ksb_190128_105043_ooi_r_ls9-CCD3 r exptime 165.75 propid NOTBASS seeing 1.17 MJD 58511.452 object ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD1 r exptime 112.96 propid NOTBASS seeing 1.58 MJD 58514.475 object ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD1 g exptime 178.794 propid BASS seeing 1.95 MJD 58219.275 object 44282 ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD2 g exptime 212.212 propid NOTBASS seeing 2.40 MJD 58510.289 object ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD2 r exptime 142.272 propid NOTBASS seeing 1.51 MJD 58523.380 object k4m_160125_090839_ooi_zd_ls9.fits.fz k4m_160125_090839_ooi_zd_ls9-CCD2 z exptime 122.105 propid 2016B-0453 seeing 0.99 MJD 57412.381 object MzLS_709452_z k4m_160317_055448_ooi_zd_ls9.fits.fz k4m_160317_055448_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 1.19 MJD 57464.246 object MzLS_710387_z k4m_160320_062048_ooi_zd_ls9.fits.fz k4m_160320_062048_ooi_zd_ls9-CCD4 z exptime 89.102 propid 2016A-0453 seeing 0.78 MJD 57467.264 object MzLS_709921_z k4m_170403_050712_ooi_zd_ls9.fits.fz k4m_170403_050712_ooi_zd_ls9-CCD1 z exptime 106.105 propid 2016A-0453 seeing 1.15 MJD 57846.213 object MzLS_710388_z k4m_160317_055914_ooi_zd_ls9.fits.fz k4m_160317_055914_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.25 MJD 57464.249 object MzLS_710388_z k4m_160125_090250_ooi_zd_ls9.fits.fz k4m_160125_090250_ooi_zd_ls9-CCD3 z exptime 120.104 propid 2016B-0453 seeing 0.99 MJD 57412.377 object MzLS_710850_z k4m_180117_060239_ooi_zd_ls9.fits.fz k4m_180117_060239_ooi_zd_ls9-CCD2 z exptime 176.107 propid 2016A-0453 seeing 1.00 MJD 58135.252 object MzLS_709452_z Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 90prime get_fwhm: self.fwhm = 3.33 WARNING: EXPNUM None!=160125090250 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090250_ooi_zd_ls9.fits.fz header Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 90prime get_fwhm: self.fwhm = 2.89 Faked up EXPNUM 85110241 Faked up EXPNUM 85110241 Faked up EXPNUM 85110241 90prime get_fwhm: self.fwhm = 2.57 mosaic get_fwhm: self.fwhm = 4.81 Faked up EXPNUM 84950056 Faked up EXPNUM 84950056 Faked up EXPNUM 84950056 90prime get_fwhm: self.fwhm = 3.45 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 90prime get_fwhm: self.fwhm = 5.29 mosaic get_fwhm: self.fwhm = 3.87 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 90prime get_fwhm: self.fwhm = 4.55 mosaic get_fwhm: self.fwhm = 4.57 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value AssertionError Something went wrong; please check the logfile. ERROR: galaxy UGC05067; please check the logfile. Finished galaxy UGC05067 in 0.079 minutes. Started working on galaxy UGC05067 at Sat Feb 8 13:07:23 2020 python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-08T13:07:24.215005 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '143.05176749999998', '68.43969659999999', '--width', '785', '--height', '785', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 143.05176749999998 68.43969659999999 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 2057 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 2058 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 2059 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 2060 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 2061 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 2062 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB Starting process 2063 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB Starting process 2064 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071148 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-08T13:07:25.483124 Keeping 15 CCDs: ksb_190111_110456_ooi_g_ls9.fits.fz ksb_190111_110456_ooi_g_ls9-CCD1 g exptime 123.643 propid NOTBASS seeing 2.06 MJD 58494.462 object ksb_190128_103155_ooi_r_ls9.fits.fz ksb_190128_103155_ooi_r_ls9-CCD1 r exptime 144.023 propid NOTBASS seeing 1.31 MJD 58511.439 object ksb_190112_101235_ooi_g_ls9.fits.fz ksb_190112_101235_ooi_g_ls9-CCD3 g exptime 126.55 propid NOTBASS seeing 1.56 MJD 58495.425 object ksb_190128_105043_ooi_r_ls9.fits.fz ksb_190128_105043_ooi_r_ls9-CCD3 r exptime 165.75 propid NOTBASS seeing 1.17 MJD 58511.452 object ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD1 r exptime 112.96 propid NOTBASS seeing 1.58 MJD 58514.475 object ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD1 g exptime 178.794 propid BASS seeing 1.95 MJD 58219.275 object 44282 ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD2 g exptime 212.212 propid NOTBASS seeing 2.40 MJD 58510.289 object ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD2 r exptime 142.272 propid NOTBASS seeing 1.51 MJD 58523.380 object k4m_160125_090839_ooi_zd_ls9.fits.fz k4m_160125_090839_ooi_zd_ls9-CCD2 z exptime 122.105 propid 2016B-0453 seeing 0.99 MJD 57412.381 object MzLS_709452_z k4m_160317_055448_ooi_zd_ls9.fits.fz k4m_160317_055448_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 1.19 MJD 57464.246 object MzLS_710387_z k4m_160320_062048_ooi_zd_ls9.fits.fz k4m_160320_062048_ooi_zd_ls9-CCD4 z exptime 89.102 propid 2016A-0453 seeing 0.78 MJD 57467.264 object MzLS_709921_z k4m_170403_050712_ooi_zd_ls9.fits.fz k4m_170403_050712_ooi_zd_ls9-CCD1 z exptime 106.105 propid 2016A-0453 seeing 1.15 MJD 57846.213 object MzLS_710388_z k4m_160317_055914_ooi_zd_ls9.fits.fz k4m_160317_055914_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.25 MJD 57464.249 object MzLS_710388_z k4m_160125_090250_ooi_zd_ls9.fits.fz k4m_160125_090250_ooi_zd_ls9-CCD3 z exptime 120.104 propid 2016B-0453 seeing 0.99 MJD 57412.377 object MzLS_710850_z k4m_180117_060239_ooi_zd_ls9.fits.fz k4m_180117_060239_ooi_zd_ls9-CCD2 z exptime 176.107 propid 2016A-0453 seeing 1.00 MJD 58135.252 object MzLS_709452_z Faked up EXPNUM 85110241 Faked up EXPNUM 85110241 Faked up EXPNUM 85110241 90prime get_fwhm: self.fwhm = 2.57 WARNING: EXPNUM None!=160125090250 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090250_ooi_zd_ls9.fits.fz header Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 90prime get_fwhm: self.fwhm = 3.33 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 90prime get_fwhm: self.fwhm = 5.29 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value AssertionError Something went wrong; please check the logfile. ERROR: galaxy UGC05067; please check the logfile. Finished galaxy UGC05067 in 0.066 minutes. Started working on galaxy UGC05067 at Sun Feb 9 08:25:10 2020 python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-09T08:25:10.616043 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '143.05176749999998', '68.43969659999999', '--width', '785', '--height', '785', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 143.05176749999998 68.43969659999999 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 28940 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071164 MB Starting process 28941 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 141 MB, maxrss: 0.071164 MB Starting process 28942 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 141 MB, maxrss: 0.071164 MB Starting process 28943 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 141 MB, maxrss: 0.071164 MB Starting process 28944 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 141 MB, maxrss: 0.071164 MB Starting process 28945 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071168 MB Starting process 28946 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071172 MB Starting process 28947 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071176 MB Starting process 28948 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071176 MB Starting process 28949 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071176 MB Starting process 28950 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.07118 MB Starting process 28951 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071184 MB Starting process 28952 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071184 MB Starting process 28953 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071184 MB Starting process 28954 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071184 MB Starting process 28955 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071184 MB Starting process 28956 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 141 MB, maxrss: 0.071188 MB Starting process 28957 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 141 MB, maxrss: 0.0722 MB Starting process 28958 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 141 MB, maxrss: 0.0722 MB Starting process 28959 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.07192 MB Starting process 28960 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.07192 MB Starting process 28961 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071188 MB Starting process 28962 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071544 MB Starting process 28963 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071544 MB Starting process 28964 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.07148 MB Starting process 28965 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071544 MB Starting process 28966 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.07148 MB Starting process 28967 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071484 MB Starting process 28968 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071484 MB Starting process 28969 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071484 MB Starting process 28970 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071484 MB Starting process 28971 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 141 MB, maxrss: 0.071484 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-09T08:25:11.885408 Keeping 15 CCDs: ksb_190111_110456_ooi_g_ls9.fits.fz ksb_190111_110456_ooi_g_ls9-CCD1 g exptime 123.643 propid NOTBASS seeing 2.06 MJD 58494.462 object ksb_190128_103155_ooi_r_ls9.fits.fz ksb_190128_103155_ooi_r_ls9-CCD1 r exptime 144.023 propid NOTBASS seeing 1.31 MJD 58511.439 object ksb_190112_101235_ooi_g_ls9.fits.fz ksb_190112_101235_ooi_g_ls9-CCD3 g exptime 126.55 propid NOTBASS seeing 1.56 MJD 58495.425 object ksb_190128_105043_ooi_r_ls9.fits.fz ksb_190128_105043_ooi_r_ls9-CCD3 r exptime 165.75 propid NOTBASS seeing 1.17 MJD 58511.452 object ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD1 r exptime 112.96 propid NOTBASS seeing 1.58 MJD 58514.475 object ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD1 g exptime 178.794 propid BASS seeing 1.95 MJD 58219.275 object 44282 ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD2 g exptime 212.212 propid NOTBASS seeing 2.40 MJD 58510.289 object ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD2 r exptime 142.272 propid NOTBASS seeing 1.51 MJD 58523.380 object k4m_160125_090839_ooi_zd_ls9.fits.fz k4m_160125_090839_ooi_zd_ls9-CCD2 z exptime 122.105 propid 2016B-0453 seeing 0.99 MJD 57412.381 object MzLS_709452_z k4m_160317_055448_ooi_zd_ls9.fits.fz k4m_160317_055448_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 1.19 MJD 57464.246 object MzLS_710387_z k4m_160320_062048_ooi_zd_ls9.fits.fz k4m_160320_062048_ooi_zd_ls9-CCD4 z exptime 89.102 propid 2016A-0453 seeing 0.78 MJD 57467.264 object MzLS_709921_z k4m_170403_050712_ooi_zd_ls9.fits.fz k4m_170403_050712_ooi_zd_ls9-CCD1 z exptime 106.105 propid 2016A-0453 seeing 1.15 MJD 57846.213 object MzLS_710388_z k4m_160317_055914_ooi_zd_ls9.fits.fz k4m_160317_055914_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.25 MJD 57464.249 object MzLS_710388_z k4m_160125_090250_ooi_zd_ls9.fits.fz k4m_160125_090250_ooi_zd_ls9-CCD3 z exptime 120.104 propid 2016B-0453 seeing 0.99 MJD 57412.377 object MzLS_710850_z k4m_180117_060239_ooi_zd_ls9.fits.fz k4m_180117_060239_ooi_zd_ls9-CCD2 z exptime 176.107 propid 2016A-0453 seeing 1.00 MJD 58135.252 object MzLS_709452_z WARNING: EXPNUM None!=160125090839 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090839_ooi_zd_ls9.fits.fz header WARNING: EXPNUM None!=160125090250 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090250_ooi_zd_ls9.fits.fz header Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 90prime get_fwhm: self.fwhm = 4.31 mosaic get_fwhm: self.fwhm = 4.81 mosaic get_fwhm: self.fwhm = 4.43 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 90prime get_fwhm: self.fwhm = 2.89 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 90prime get_fwhm: self.fwhm = 4.55 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 90prime get_fwhm: self.fwhm = 3.49 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 90prime get_fwhm: self.fwhm = 5.29 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 90prime get_fwhm: self.fwhm = 3.33 mosaic get_fwhm: self.fwhm = 3.87 Faked up EXPNUM 84950056 Faked up EXPNUM 84950056 Faked up EXPNUM 84950056 90prime get_fwhm: self.fwhm = 3.45 Faked up EXPNUM 85110241 Faked up EXPNUM 85110241 Faked up EXPNUM 85110241 90prime get_fwhm: self.fwhm = 2.57 mosaic get_fwhm: self.fwhm = 4.57 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value AssertionError Something went wrong; please check the logfile. ERROR: galaxy UGC05067; please check the logfile. Finished galaxy UGC05067 in 0.063 minutes. Started working on galaxy UGC05067 at Sun Feb 9 10:25:49 2020 python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-09T10:25:50.355123 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '143.05176749999998', '68.43969659999999', '--width', '785', '--height', '785', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 143.05176749999998 68.43969659999999 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 44198 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 44199 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 44200 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 44201 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 44202 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 44203 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 44204 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 44205 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Starting process 44206 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Starting process 44207 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Starting process 44208 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 44209 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 44210 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 44211 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 44212 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 44213 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 44214 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071192 MB Starting process 44215 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072204 MB Starting process 44216 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072204 MB Starting process 44217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071916 MB Starting process 44218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071916 MB Starting process 44219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 44220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB Starting process 44221 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB Starting process 44222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB Starting process 44223 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB Starting process 44224 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB Starting process 44225 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB Starting process 44226 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB Starting process 44227 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB Starting process 44228 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB Starting process 44229 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-09T10:25:52.491120 Keeping 15 CCDs: ksb_190111_110456_ooi_g_ls9.fits.fz ksb_190111_110456_ooi_g_ls9-CCD1 g exptime 123.643 propid NOTBASS seeing 2.06 MJD 58494.462 object ksb_190128_103155_ooi_r_ls9.fits.fz ksb_190128_103155_ooi_r_ls9-CCD1 r exptime 144.023 propid NOTBASS seeing 1.31 MJD 58511.439 object ksb_190112_101235_ooi_g_ls9.fits.fz ksb_190112_101235_ooi_g_ls9-CCD3 g exptime 126.55 propid NOTBASS seeing 1.56 MJD 58495.425 object ksb_190128_105043_ooi_r_ls9.fits.fz ksb_190128_105043_ooi_r_ls9-CCD3 r exptime 165.75 propid NOTBASS seeing 1.17 MJD 58511.452 object ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD1 r exptime 112.96 propid NOTBASS seeing 1.58 MJD 58514.475 object ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD1 g exptime 178.794 propid BASS seeing 1.95 MJD 58219.275 object 44282 ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD2 g exptime 212.212 propid NOTBASS seeing 2.40 MJD 58510.289 object ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD2 r exptime 142.272 propid NOTBASS seeing 1.51 MJD 58523.380 object k4m_160125_090839_ooi_zd_ls9.fits.fz k4m_160125_090839_ooi_zd_ls9-CCD2 z exptime 122.105 propid 2016B-0453 seeing 0.99 MJD 57412.381 object MzLS_709452_z k4m_160317_055448_ooi_zd_ls9.fits.fz k4m_160317_055448_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 1.19 MJD 57464.246 object MzLS_710387_z k4m_160320_062048_ooi_zd_ls9.fits.fz k4m_160320_062048_ooi_zd_ls9-CCD4 z exptime 89.102 propid 2016A-0453 seeing 0.78 MJD 57467.264 object MzLS_709921_z k4m_170403_050712_ooi_zd_ls9.fits.fz k4m_170403_050712_ooi_zd_ls9-CCD1 z exptime 106.105 propid 2016A-0453 seeing 1.15 MJD 57846.213 object MzLS_710388_z k4m_160317_055914_ooi_zd_ls9.fits.fz k4m_160317_055914_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.25 MJD 57464.249 object MzLS_710388_z k4m_160125_090250_ooi_zd_ls9.fits.fz k4m_160125_090250_ooi_zd_ls9-CCD3 z exptime 120.104 propid 2016B-0453 seeing 0.99 MJD 57412.377 object MzLS_710850_z k4m_180117_060239_ooi_zd_ls9.fits.fz k4m_180117_060239_ooi_zd_ls9-CCD2 z exptime 176.107 propid 2016A-0453 seeing 1.00 MJD 58135.252 object MzLS_709452_z WARNING: EXPNUM None!=160125090250 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090250_ooi_zd_ls9.fits.fz header WARNING: EXPNUM None!=160125090839 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090839_ooi_zd_ls9.fits.fz header Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 90prime get_fwhm: self.fwhm = 4.55 mosaic get_fwhm: self.fwhm = 4.43 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 90prime get_fwhm: self.fwhm = 4.31 mosaic get_fwhm: self.fwhm = 4.81 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 90prime get_fwhm: self.fwhm = 3.49 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 90prime get_fwhm: self.fwhm = 2.89 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 90prime get_fwhm: self.fwhm = 5.29 mosaic get_fwhm: self.fwhm = 3.87 mosaic get_fwhm: self.fwhm = 3.01 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 90prime get_fwhm: self.fwhm = 3.33 mosaic get_fwhm: self.fwhm = 4.57 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value AssertionError Something went wrong; please check the logfile. ERROR: galaxy UGC05067; please check the logfile. Finished galaxy UGC05067 in 0.073 minutes. Started working on galaxy UGC05067 at Mon Feb 10 06:17:14 2020 python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-10T06:17:14.617131 legacypipe git version: dr9e-pre1-9-g4a51be93 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '143.05176749999998', '68.43969659999999', '--width', '785', '--height', '785', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 143.05176749999998 68.43969659999999 --width 785 --height 785 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/143/UGC05067/UGC05067-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 143.05176749999998 68.43969659999999 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 15124 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071124 MB Starting process 15125 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB Starting process 15126 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB Starting process 15127 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB Starting process 15128 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB Starting process 15129 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 15130 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 15131 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB Starting process 15132 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB Starting process 15133 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB Starting process 15134 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB Starting process 15135 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB Starting process 15136 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB Starting process 15137 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB Starting process 15138 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB Starting process 15139 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071152 MB Starting process 15140 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071152 MB Starting process 15141 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072164 MB Starting process 15142 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072164 MB Starting process 15143 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071944 MB Starting process 15144 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072024 MB Starting process 15145 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071148 MB Starting process 15146 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB Starting process 15147 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB Starting process 15148 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB Starting process 15149 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB Starting process 15150 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB Starting process 15151 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB Starting process 15152 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB Starting process 15153 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB Starting process 15154 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB Starting process 15155 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071512 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-10T06:17:15.881383 Keeping 15 CCDs: ksb_190111_110456_ooi_g_ls9.fits.fz ksb_190111_110456_ooi_g_ls9-CCD1 g exptime 123.643 propid NOTBASS seeing 2.06 MJD 58494.462 object ksb_190128_103155_ooi_r_ls9.fits.fz ksb_190128_103155_ooi_r_ls9-CCD1 r exptime 144.023 propid NOTBASS seeing 1.31 MJD 58511.439 object ksb_190112_101235_ooi_g_ls9.fits.fz ksb_190112_101235_ooi_g_ls9-CCD3 g exptime 126.55 propid NOTBASS seeing 1.56 MJD 58495.425 object ksb_190128_105043_ooi_r_ls9.fits.fz ksb_190128_105043_ooi_r_ls9-CCD3 r exptime 165.75 propid NOTBASS seeing 1.17 MJD 58511.452 object ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD1 r exptime 112.96 propid NOTBASS seeing 1.58 MJD 58514.475 object ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD1 g exptime 178.794 propid BASS seeing 1.95 MJD 58219.275 object 44282 ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD2 g exptime 212.212 propid NOTBASS seeing 2.40 MJD 58510.289 object ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD2 r exptime 142.272 propid NOTBASS seeing 1.51 MJD 58523.380 object k4m_160125_090839_ooi_zd_ls9.fits.fz k4m_160125_090839_ooi_zd_ls9-CCD2 z exptime 122.105 propid 2016B-0453 seeing 0.99 MJD 57412.381 object MzLS_709452_z k4m_160317_055448_ooi_zd_ls9.fits.fz k4m_160317_055448_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 1.19 MJD 57464.246 object MzLS_710387_z k4m_160320_062048_ooi_zd_ls9.fits.fz k4m_160320_062048_ooi_zd_ls9-CCD4 z exptime 89.102 propid 2016A-0453 seeing 0.78 MJD 57467.264 object MzLS_709921_z k4m_170403_050712_ooi_zd_ls9.fits.fz k4m_170403_050712_ooi_zd_ls9-CCD1 z exptime 106.105 propid 2016A-0453 seeing 1.15 MJD 57846.213 object MzLS_710388_z k4m_160317_055914_ooi_zd_ls9.fits.fz k4m_160317_055914_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.25 MJD 57464.249 object MzLS_710388_z k4m_160125_090250_ooi_zd_ls9.fits.fz k4m_160125_090250_ooi_zd_ls9-CCD3 z exptime 120.104 propid 2016B-0453 seeing 0.99 MJD 57412.377 object MzLS_710850_z k4m_180117_060239_ooi_zd_ls9.fits.fz k4m_180117_060239_ooi_zd_ls9-CCD2 z exptime 176.107 propid 2016A-0453 seeing 1.00 MJD 58135.252 object MzLS_709452_z WARNING: EXPNUM None!=160125090250 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090250_ooi_zd_ls9.fits.fz header WARNING: EXPNUM None!=160125090839 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090839_ooi_zd_ls9.fits.fz header Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 90prime get_fwhm: self.fwhm = 4.31 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 90prime get_fwhm: self.fwhm = 2.89 mosaic get_fwhm: self.fwhm = 4.81 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 90prime get_fwhm: self.fwhm = 4.55 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 90prime get_fwhm: self.fwhm = 3.49 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 90prime get_fwhm: self.fwhm = 5.29 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 90prime get_fwhm: self.fwhm = 3.33 mosaic get_fwhm: self.fwhm = 4.43 mosaic get_fwhm: self.fwhm = 3.87 Faked up EXPNUM 85110241 Faked up EXPNUM 85110241 Faked up EXPNUM 85110241 90prime get_fwhm: self.fwhm = 2.57 Faked up EXPNUM 84950056 Faked up EXPNUM 84950056 Faked up EXPNUM 84950056 90prime get_fwhm: self.fwhm = 3.45 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value AssertionError Something went wrong; please check the logfile. ERROR: galaxy UGC05067; please check the logfile. Finished galaxy UGC05067 in 0.060 minutes.