Started working on galaxy UGC05029_GROUP at Sat Feb 8 08:12:14 2020 python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.99361442372376 68.41695527450153 --width 1015 --height 1015 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-08T08:12:15.603782 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '141.99361442372376', '68.41695527450153', '--width', '1015', '--height', '1015', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.99361442372376 68.41695527450153 --width 1015 --height 1015 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 141.99361442372376 68.41695527450153 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 9141 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 9142 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 9143 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 9144 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 9145 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 9146 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 9147 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 9148 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-08T08:12:16.924899 Keeping 11 CCDs: ksb_190128_103155_ooi_r_ls9.fits.fz ksb_190128_103155_ooi_r_ls9-CCD1 r exptime 144.023 propid NOTBASS seeing 1.31 MJD 58511.439 object ksb_190111_110456_ooi_g_ls9.fits.fz ksb_190111_110456_ooi_g_ls9-CCD1 g exptime 123.643 propid NOTBASS seeing 2.06 MJD 58494.462 object ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD3 g exptime 178.794 propid BASS seeing 1.94 MJD 58219.275 object 44282 ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD3 r exptime 112.96 propid NOTBASS seeing 1.50 MJD 58514.475 object ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD4 g exptime 212.212 propid NOTBASS seeing 2.38 MJD 58510.289 object ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD4 r exptime 142.272 propid NOTBASS seeing 1.54 MJD 58523.380 object k4m_160320_062048_ooi_zd_ls9.fits.fz k4m_160320_062048_ooi_zd_ls9-CCD2 z exptime 89.102 propid 2016A-0453 seeing 0.80 MJD 57467.264 object MzLS_709921_z k4m_160125_090017_ooi_zd_ls9.fits.fz k4m_160125_090017_ooi_zd_ls9-CCD2 z exptime 116.103 propid 2016B-0453 seeing 1.11 MJD 57412.375 object MzLS_709451_z k4m_160125_090250_ooi_zd_ls9.fits.fz k4m_160125_090250_ooi_zd_ls9-CCD1 z exptime 120.104 propid 2016B-0453 seeing 1.08 MJD 57412.377 object MzLS_710850_z k4m_160320_061101_ooi_zd_ls9.fits.fz k4m_160320_061101_ooi_zd_ls9-CCD4 z exptime 91.104 propid 2016A-0453 seeing 0.83 MJD 57467.258 object MzLS_709920_z k4m_160317_055448_ooi_zd_ls9.fits.fz k4m_160317_055448_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.19 MJD 57464.246 object MzLS_710387_z Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 90prime get_fwhm: self.fwhm = 4.27 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 90prime get_fwhm: self.fwhm = 4.55 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 90prime get_fwhm: self.fwhm = 3.31 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 90prime get_fwhm: self.fwhm = 3.39 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 90prime get_fwhm: self.fwhm = 5.25 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value AssertionError Something went wrong; please check the logfile. ERROR: galaxy UGC05029_GROUP; please check the logfile. Finished galaxy UGC05029_GROUP in 0.077 minutes. Started working on galaxy UGC05029_GROUP at Sat Feb 8 08:45:06 2020 python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.99361442372376 68.41695527450153 --width 1015 --height 1015 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-08T08:45:07.318133 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '141.99361442372376', '68.41695527450153', '--width', '1015', '--height', '1015', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.99361442372376 68.41695527450153 --width 1015 --height 1015 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 141.99361442372376 68.41695527450153 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 3624 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 3625 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 3626 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 3627 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 3628 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 3629 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Starting process 3630 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Starting process 3631 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-08T08:45:08.746145 Keeping 11 CCDs: ksb_190128_103155_ooi_r_ls9.fits.fz ksb_190128_103155_ooi_r_ls9-CCD1 r exptime 144.023 propid NOTBASS seeing 1.31 MJD 58511.439 object ksb_190111_110456_ooi_g_ls9.fits.fz ksb_190111_110456_ooi_g_ls9-CCD1 g exptime 123.643 propid NOTBASS seeing 2.06 MJD 58494.462 object ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD3 g exptime 178.794 propid BASS seeing 1.94 MJD 58219.275 object 44282 ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD3 r exptime 112.96 propid NOTBASS seeing 1.50 MJD 58514.475 object ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD4 g exptime 212.212 propid NOTBASS seeing 2.38 MJD 58510.289 object ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD4 r exptime 142.272 propid NOTBASS seeing 1.54 MJD 58523.380 object k4m_160320_062048_ooi_zd_ls9.fits.fz k4m_160320_062048_ooi_zd_ls9-CCD2 z exptime 89.102 propid 2016A-0453 seeing 0.80 MJD 57467.264 object MzLS_709921_z k4m_160125_090017_ooi_zd_ls9.fits.fz k4m_160125_090017_ooi_zd_ls9-CCD2 z exptime 116.103 propid 2016B-0453 seeing 1.11 MJD 57412.375 object MzLS_709451_z k4m_160125_090250_ooi_zd_ls9.fits.fz k4m_160125_090250_ooi_zd_ls9-CCD1 z exptime 120.104 propid 2016B-0453 seeing 1.08 MJD 57412.377 object MzLS_710850_z k4m_160320_061101_ooi_zd_ls9.fits.fz k4m_160320_061101_ooi_zd_ls9-CCD4 z exptime 91.104 propid 2016A-0453 seeing 0.83 MJD 57467.258 object MzLS_709920_z k4m_160317_055448_ooi_zd_ls9.fits.fz k4m_160317_055448_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.19 MJD 57464.246 object MzLS_710387_z Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 90prime get_fwhm: self.fwhm = 4.27 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 90prime get_fwhm: self.fwhm = 3.31 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 90prime get_fwhm: self.fwhm = 5.25 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 90prime get_fwhm: self.fwhm = 3.39 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 90prime get_fwhm: self.fwhm = 2.89 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value AssertionError Something went wrong; please check the logfile. ERROR: galaxy UGC05029_GROUP; please check the logfile. Finished galaxy UGC05029_GROUP in 0.086 minutes. Started working on galaxy UGC05029_GROUP at Sat Feb 8 12:52:03 2020 python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.99361442372376 68.41695527450153 --width 1015 --height 1015 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-08T12:52:04.209814 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '141.99361442372376', '68.41695527450153', '--width', '1015', '--height', '1015', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.99361442372376 68.41695527450153 --width 1015 --height 1015 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 141.99361442372376 68.41695527450153 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 31926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 31927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 31928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 31929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 31930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 31931 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 31932 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 31933 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-08T12:52:05.424410 Keeping 11 CCDs: ksb_190128_103155_ooi_r_ls9.fits.fz ksb_190128_103155_ooi_r_ls9-CCD1 r exptime 144.023 propid NOTBASS seeing 1.31 MJD 58511.439 object ksb_190111_110456_ooi_g_ls9.fits.fz ksb_190111_110456_ooi_g_ls9-CCD1 g exptime 123.643 propid NOTBASS seeing 2.06 MJD 58494.462 object ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD3 g exptime 178.794 propid BASS seeing 1.94 MJD 58219.275 object 44282 ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD3 r exptime 112.96 propid NOTBASS seeing 1.50 MJD 58514.475 object ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD4 g exptime 212.212 propid NOTBASS seeing 2.38 MJD 58510.289 object ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD4 r exptime 142.272 propid NOTBASS seeing 1.54 MJD 58523.380 object k4m_160320_062048_ooi_zd_ls9.fits.fz k4m_160320_062048_ooi_zd_ls9-CCD2 z exptime 89.102 propid 2016A-0453 seeing 0.80 MJD 57467.264 object MzLS_709921_z k4m_160125_090017_ooi_zd_ls9.fits.fz k4m_160125_090017_ooi_zd_ls9-CCD2 z exptime 116.103 propid 2016B-0453 seeing 1.11 MJD 57412.375 object MzLS_709451_z k4m_160125_090250_ooi_zd_ls9.fits.fz k4m_160125_090250_ooi_zd_ls9-CCD1 z exptime 120.104 propid 2016B-0453 seeing 1.08 MJD 57412.377 object MzLS_710850_z k4m_160320_061101_ooi_zd_ls9.fits.fz k4m_160320_061101_ooi_zd_ls9-CCD4 z exptime 91.104 propid 2016A-0453 seeing 0.83 MJD 57467.258 object MzLS_709920_z k4m_160317_055448_ooi_zd_ls9.fits.fz k4m_160317_055448_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.19 MJD 57464.246 object MzLS_710387_z Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 90prime get_fwhm: self.fwhm = 4.27 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 90prime get_fwhm: self.fwhm = 5.25 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 90prime get_fwhm: self.fwhm = 3.39 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 90prime get_fwhm: self.fwhm = 4.55 WARNING: EXPNUM None!=160125090017 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090017_ooi_zd_ls9.fits.fz header WARNING: EXPNUM None!=160125090250 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090250_ooi_zd_ls9.fits.fz header mosaic get_fwhm: self.fwhm = 3.21 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 90prime get_fwhm: self.fwhm = 3.31 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 90prime get_fwhm: self.fwhm = 2.89 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value AssertionError Something went wrong; please check the logfile. ERROR: galaxy UGC05029_GROUP; please check the logfile. Finished galaxy UGC05029_GROUP in 0.064 minutes. Started working on galaxy UGC05029_GROUP at Sun Feb 9 11:02:18 2020 python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.99361442372376 68.41695527450153 --width 1015 --height 1015 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-09T11:02:19.400993 legacypipe git version: dr9e-pre1-7-g54c974a3 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '141.99361442372376', '68.41695527450153', '--width', '1015', '--height', '1015', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.99361442372376 68.41695527450153 --width 1015 --height 1015 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 141.99361442372376 68.41695527450153 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 58717 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB Starting process 58718 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 58719 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 58720 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB Starting process 58721 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB Starting process 58722 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 58723 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 58724 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB Starting process 58725 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Starting process 58726 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB Starting process 58727 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 58728 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 58729 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB Starting process 58730 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 58731 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 58732 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB Starting process 58733 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071192 MB Starting process 58734 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072204 MB Starting process 58735 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072204 MB Starting process 58736 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071912 MB Starting process 58737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071912 MB Starting process 58738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB Starting process 58739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB Starting process 58740 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB Starting process 58741 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB Starting process 58742 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB Starting process 58743 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB Starting process 58744 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB Starting process 58745 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB Starting process 58746 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07148 MB Starting process 58747 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB Starting process 58748 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071484 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-09T11:02:21.388075 Keeping 11 CCDs: ksb_190128_103155_ooi_r_ls9.fits.fz ksb_190128_103155_ooi_r_ls9-CCD1 r exptime 144.023 propid NOTBASS seeing 1.31 MJD 58511.439 object ksb_190111_110456_ooi_g_ls9.fits.fz ksb_190111_110456_ooi_g_ls9-CCD1 g exptime 123.643 propid NOTBASS seeing 2.06 MJD 58494.462 object ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD3 g exptime 178.794 propid BASS seeing 1.94 MJD 58219.275 object 44282 ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD3 r exptime 112.96 propid NOTBASS seeing 1.50 MJD 58514.475 object ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD4 g exptime 212.212 propid NOTBASS seeing 2.38 MJD 58510.289 object ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD4 r exptime 142.272 propid NOTBASS seeing 1.54 MJD 58523.380 object k4m_160320_062048_ooi_zd_ls9.fits.fz k4m_160320_062048_ooi_zd_ls9-CCD2 z exptime 89.102 propid 2016A-0453 seeing 0.80 MJD 57467.264 object MzLS_709921_z k4m_160125_090017_ooi_zd_ls9.fits.fz k4m_160125_090017_ooi_zd_ls9-CCD2 z exptime 116.103 propid 2016B-0453 seeing 1.11 MJD 57412.375 object MzLS_709451_z k4m_160125_090250_ooi_zd_ls9.fits.fz k4m_160125_090250_ooi_zd_ls9-CCD1 z exptime 120.104 propid 2016B-0453 seeing 1.08 MJD 57412.377 object MzLS_710850_z k4m_160320_061101_ooi_zd_ls9.fits.fz k4m_160320_061101_ooi_zd_ls9-CCD4 z exptime 91.104 propid 2016A-0453 seeing 0.83 MJD 57467.258 object MzLS_709920_z k4m_160317_055448_ooi_zd_ls9.fits.fz k4m_160317_055448_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.19 MJD 57464.246 object MzLS_710387_z WARNING: EXPNUM None!=160125090017 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090017_ooi_zd_ls9.fits.fz header WARNING: EXPNUM None!=160125090250 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090250_ooi_zd_ls9.fits.fz header Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 90prime get_fwhm: self.fwhm = 3.31 mosaic get_fwhm: self.fwhm = 3.09 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 90prime get_fwhm: self.fwhm = 5.25 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 90prime get_fwhm: self.fwhm = 3.39 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 90prime get_fwhm: self.fwhm = 4.27 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 90prime get_fwhm: self.fwhm = 2.89 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 90prime get_fwhm: self.fwhm = 4.55 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value AssertionError Something went wrong; please check the logfile. ERROR: galaxy UGC05029_GROUP; please check the logfile. Finished galaxy UGC05029_GROUP in 0.073 minutes. Started working on galaxy UGC05029_GROUP at Mon Feb 10 06:17:36 2020 python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.99361442372376 68.41695527450153 --width 1015 --height 1015 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p --unwise-coadds runbrick.py starting at 2020-02-10T06:17:36.803336 legacypipe git version: dr9e-pre1-9-g4a51be93 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '141.99361442372376', '68.41695527450153', '--width', '1015', '--height', '1015', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p', '--unwise-coadds'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.99361442372376 68.41695527450153 --width 1015 --height 1015 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC05029_GROUP/UGC05029_GROUP-runbrick-%%(stage)s.p --unwise-coadds WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky Parsed RA,Dec 141.99361442372376 68.41695527450153 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data] Starting process 15400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07112 MB Starting process 15401 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07112 MB Starting process 15402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07112 MB Starting process 15403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07112 MB Starting process 15404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071124 MB Starting process 15405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB Starting process 15406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB Starting process 15407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071132 MB Starting process 15408 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071132 MB Starting process 15409 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071132 MB Starting process 15410 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 15411 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 15412 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB Starting process 15413 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB Starting process 15414 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB Starting process 15415 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB Starting process 15416 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071144 MB Starting process 15417 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072156 MB Starting process 15418 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072156 MB Starting process 15419 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071864 MB Starting process 15420 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071864 MB Starting process 15421 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB Starting process 15422 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB Starting process 15423 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB Starting process 15424 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB Starting process 15425 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB Starting process 15426 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB Starting process 15427 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB Starting process 15428 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB Starting process 15429 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07144 MB Starting process 15430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB Starting process 15431 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage largegalaxies Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-02-10T06:17:38.063751 Keeping 11 CCDs: ksb_190128_103155_ooi_r_ls9.fits.fz ksb_190128_103155_ooi_r_ls9-CCD1 r exptime 144.023 propid NOTBASS seeing 1.31 MJD 58511.439 object ksb_190111_110456_ooi_g_ls9.fits.fz ksb_190111_110456_ooi_g_ls9-CCD1 g exptime 123.643 propid NOTBASS seeing 2.06 MJD 58494.462 object ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD3 g exptime 178.794 propid BASS seeing 1.94 MJD 58219.275 object 44282 ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD3 r exptime 112.96 propid NOTBASS seeing 1.50 MJD 58514.475 object ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD4 g exptime 212.212 propid NOTBASS seeing 2.38 MJD 58510.289 object ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD4 r exptime 142.272 propid NOTBASS seeing 1.54 MJD 58523.380 object k4m_160320_062048_ooi_zd_ls9.fits.fz k4m_160320_062048_ooi_zd_ls9-CCD2 z exptime 89.102 propid 2016A-0453 seeing 0.80 MJD 57467.264 object MzLS_709921_z k4m_160125_090017_ooi_zd_ls9.fits.fz k4m_160125_090017_ooi_zd_ls9-CCD2 z exptime 116.103 propid 2016B-0453 seeing 1.11 MJD 57412.375 object MzLS_709451_z k4m_160125_090250_ooi_zd_ls9.fits.fz k4m_160125_090250_ooi_zd_ls9-CCD1 z exptime 120.104 propid 2016B-0453 seeing 1.08 MJD 57412.377 object MzLS_710850_z k4m_160320_061101_ooi_zd_ls9.fits.fz k4m_160320_061101_ooi_zd_ls9-CCD4 z exptime 91.104 propid 2016A-0453 seeing 0.83 MJD 57467.258 object MzLS_709920_z k4m_160317_055448_ooi_zd_ls9.fits.fz k4m_160317_055448_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.19 MJD 57464.246 object MzLS_710387_z WARNING: EXPNUM None!=160125090250 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090250_ooi_zd_ls9.fits.fz header WARNING: EXPNUM None!=160125090017 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_090017_ooi_zd_ls9.fits.fz header mosaic get_fwhm: self.fwhm = 3.09 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 Faked up EXPNUM 85230149 90prime get_fwhm: self.fwhm = 3.39 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 Faked up EXPNUM 82190088 90prime get_fwhm: self.fwhm = 4.27 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 Faked up EXPNUM 85100122 90prime get_fwhm: self.fwhm = 5.25 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 Faked up EXPNUM 85140220 90prime get_fwhm: self.fwhm = 3.31 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 Faked up EXPNUM 84940074 90prime get_fwhm: self.fwhm = 4.55 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 Faked up EXPNUM 85110236 90prime get_fwhm: self.fwhm = 2.89 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) [Previous line repeated 6 more times] File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims tims = list(mp.map(read_one_tim, args)) File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map return self.pool.map(f, args, cs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value AssertionError Something went wrong; please check the logfile. ERROR: galaxy UGC05029_GROUP; please check the logfile. Finished galaxy UGC05029_GROUP in 0.059 minutes.