Started working on galaxy NGC2959_GROUP at Sat Feb  8 08:34:23 2020
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 146.3090650539803 68.59986162890779 --width 1221 --height 1221 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-08T08:34:24.237911
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '146.3090650539803', '68.59986162890779', '--width', '1221', '--height', '1221', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 146.3090650539803 68.59986162890779 --width 1221 --height 1221 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 146.3090650539803 68.59986162890779
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 1454 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 1455 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 1456 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 1457 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 1458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 1459 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 1460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 1461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-08T08:34:25.559598
Keeping 16 CCDs:
   ksb_190128_063416_ooi_g_ls9.fits.fz ksb_190128_063416_ooi_g_ls9-CCD4 g exptime 110.595 propid NOTBASS    seeing 1.34 MJD 58511.274 object 
   ksb_190209_094735_ooi_r_ls9.fits.fz ksb_190209_094735_ooi_r_ls9-CCD4 r exptime 129.274 propid NOTBASS    seeing 1.55 MJD 58523.408 object 
   ksb_180410_063935_ooi_g_ls9.fits.fz ksb_180410_063935_ooi_g_ls9-CCD3 g exptime 224.25 propid BASS       seeing 1.48 MJD 58218.277 object 44302
   ksb_190131_115514_ooi_r_ls9.fits.fz ksb_190131_115514_ooi_r_ls9-CCD3 r exptime 200.6 propid NOTBASS    seeing 1.59 MJD 58514.497 object 
   ksb_190131_113812_ooi_r_ls9.fits.fz ksb_190131_113812_ooi_r_ls9-CCD1 r exptime 116.707 propid NOTBASS    seeing 1.59 MJD 58514.485 object 
   ksb_180411_071357_ooi_g_ls9.fits.fz ksb_180411_071357_ooi_g_ls9-CCD1 g exptime 219.186 propid BASS       seeing 1.69 MJD 58219.301 object 44292
   ksb_190128_062355_ooi_g_ls9.fits.fz ksb_190128_062355_ooi_g_ls9-CCD2 g exptime 118.43 propid NOTBASS    seeing 1.38 MJD 58511.267 object 
   ksb_190209_092322_ooi_r_ls9.fits.fz ksb_190209_092322_ooi_r_ls9-CCD2 r exptime 140.178 propid NOTBASS    seeing 1.56 MJD 58523.391 object 
   ksb_190112_101522_ooi_g_ls9.fits.fz ksb_190112_101522_ooi_g_ls9-CCD2 g exptime 124.63 propid NOTBASS    seeing 1.48 MJD 58495.427 object 
   ksb_190128_105804_ooi_r_ls9.fits.fz ksb_190128_105804_ooi_r_ls9-CCD2 r exptime 163.914 propid NOTBASS    seeing 1.35 MJD 58511.457 object 
   k4m_160125_092739_ooi_zd_ls9.fits.fz k4m_160125_092739_ooi_zd_ls9-CCD1 z exptime 128.103 propid 2016B-0453 seeing 1.10 MJD 57412.394 object MzLS_710853_z
   k4m_160320_060607_ooi_zd_ls9.fits.fz k4m_160320_060607_ooi_zd_ls9-CCD2 z exptime 94.104 propid 2016A-0453 seeing 0.88 MJD 57467.254 object MzLS_710390_z
   k4m_171028_104055_ooi_zd_ls9.fits.fz k4m_171028_104055_ooi_zd_ls9-CCD1 z exptime 135.306 propid 2016A-0453 seeing 1.02 MJD 58054.445 object MzLS_711310_z
   k4m_170307_072650_ooi_zd_ls9.fits.fz k4m_170307_072650_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 0.87 MJD 57819.310 object MzLS_709923_z
   k4m_160125_091939_ooi_zd_ls9.fits.fz k4m_160125_091939_ooi_zd_ls9-CCD3 z exptime 128.104 propid 2016B-0453 seeing 0.93 MJD 57412.389 object MzLS_710852_z
   k4m_160317_060522_ooi_zd_ls9.fits.fz k4m_160317_060522_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 1.17 MJD 57464.254 object MzLS_710389_z
Faked up EXPNUM 85230163
Faked up EXPNUM 85230163
Faked up EXPNUM 85230163
90prime get_fwhm: self.fwhm = 3.41
WARNING: EXPNUM None!=160125091939 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_091939_ooi_zd_ls9.fits.fz header
Faked up EXPNUM 85140230
Faked up EXPNUM 85140230
Faked up EXPNUM 85140230
90prime get_fwhm: self.fwhm = 3.51
Faked up EXPNUM 85230154
Faked up EXPNUM 85230154
Faked up EXPNUM 85230154
90prime get_fwhm: self.fwhm = 3.43
Faked up EXPNUM 84950057
Faked up EXPNUM 84950057
Faked up EXPNUM 84950057
90prime get_fwhm: self.fwhm = 3.27
Faked up EXPNUM 82180085
Faked up EXPNUM 82180085
Faked up EXPNUM 82180085
90prime get_fwhm: self.fwhm = 3.27
mosaic get_fwhm: self.fwhm = 4.49
Faked up EXPNUM 85140225
Faked up EXPNUM 85140225
Faked up EXPNUM 85140225
90prime get_fwhm: self.fwhm = 3.51
Faked up EXPNUM 85110243
Faked up EXPNUM 85110243
Faked up EXPNUM 85110243
90prime get_fwhm: self.fwhm = 2.97
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
AssertionError
Something went wrong; please check the logfile.
ERROR: galaxy NGC2959_GROUP; please check the logfile.
Finished galaxy NGC2959_GROUP in 0.087 minutes.
Started working on galaxy NGC2959_GROUP at Sat Feb  8 12:51:59 2020
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 146.3090650539803 68.59986162890779 --width 1221 --height 1221 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-08T12:51:59.852607
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '146.3090650539803', '68.59986162890779', '--width', '1221', '--height', '1221', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 146.3090650539803 68.59986162890779 --width 1221 --height 1221 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 146.3090650539803 68.59986162890779
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 31903 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 31904 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 31905 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 31906 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 31907 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 31908 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 31909 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 31910 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-08T12:52:01.087479
Keeping 16 CCDs:
   ksb_190128_063416_ooi_g_ls9.fits.fz ksb_190128_063416_ooi_g_ls9-CCD4 g exptime 110.595 propid NOTBASS    seeing 1.34 MJD 58511.274 object 
   ksb_190209_094735_ooi_r_ls9.fits.fz ksb_190209_094735_ooi_r_ls9-CCD4 r exptime 129.274 propid NOTBASS    seeing 1.55 MJD 58523.408 object 
   ksb_180410_063935_ooi_g_ls9.fits.fz ksb_180410_063935_ooi_g_ls9-CCD3 g exptime 224.25 propid BASS       seeing 1.48 MJD 58218.277 object 44302
   ksb_190131_115514_ooi_r_ls9.fits.fz ksb_190131_115514_ooi_r_ls9-CCD3 r exptime 200.6 propid NOTBASS    seeing 1.59 MJD 58514.497 object 
   ksb_190131_113812_ooi_r_ls9.fits.fz ksb_190131_113812_ooi_r_ls9-CCD1 r exptime 116.707 propid NOTBASS    seeing 1.59 MJD 58514.485 object 
   ksb_180411_071357_ooi_g_ls9.fits.fz ksb_180411_071357_ooi_g_ls9-CCD1 g exptime 219.186 propid BASS       seeing 1.69 MJD 58219.301 object 44292
   ksb_190128_062355_ooi_g_ls9.fits.fz ksb_190128_062355_ooi_g_ls9-CCD2 g exptime 118.43 propid NOTBASS    seeing 1.38 MJD 58511.267 object 
   ksb_190209_092322_ooi_r_ls9.fits.fz ksb_190209_092322_ooi_r_ls9-CCD2 r exptime 140.178 propid NOTBASS    seeing 1.56 MJD 58523.391 object 
   ksb_190112_101522_ooi_g_ls9.fits.fz ksb_190112_101522_ooi_g_ls9-CCD2 g exptime 124.63 propid NOTBASS    seeing 1.48 MJD 58495.427 object 
   ksb_190128_105804_ooi_r_ls9.fits.fz ksb_190128_105804_ooi_r_ls9-CCD2 r exptime 163.914 propid NOTBASS    seeing 1.35 MJD 58511.457 object 
   k4m_160125_092739_ooi_zd_ls9.fits.fz k4m_160125_092739_ooi_zd_ls9-CCD1 z exptime 128.103 propid 2016B-0453 seeing 1.10 MJD 57412.394 object MzLS_710853_z
   k4m_160320_060607_ooi_zd_ls9.fits.fz k4m_160320_060607_ooi_zd_ls9-CCD2 z exptime 94.104 propid 2016A-0453 seeing 0.88 MJD 57467.254 object MzLS_710390_z
   k4m_171028_104055_ooi_zd_ls9.fits.fz k4m_171028_104055_ooi_zd_ls9-CCD1 z exptime 135.306 propid 2016A-0453 seeing 1.02 MJD 58054.445 object MzLS_711310_z
   k4m_170307_072650_ooi_zd_ls9.fits.fz k4m_170307_072650_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 0.87 MJD 57819.310 object MzLS_709923_z
   k4m_160125_091939_ooi_zd_ls9.fits.fz k4m_160125_091939_ooi_zd_ls9-CCD3 z exptime 128.104 propid 2016B-0453 seeing 0.93 MJD 57412.389 object MzLS_710852_z
   k4m_160317_060522_ooi_zd_ls9.fits.fz k4m_160317_060522_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 1.17 MJD 57464.254 object MzLS_710389_z
Faked up EXPNUM 85110144
Faked up EXPNUM 85110144
Faked up EXPNUM 85110144
90prime get_fwhm: self.fwhm = 2.95
Faked up EXPNUM 82180085
Faked up EXPNUM 82180085
Faked up EXPNUM 82180085
90prime get_fwhm: self.fwhm = 3.27
WARNING: EXPNUM None!=160125091939 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_091939_ooi_zd_ls9.fits.fz header
Faked up EXPNUM 85140230
Faked up EXPNUM 85140230
Faked up EXPNUM 85140230
90prime get_fwhm: self.fwhm = 3.51
mosaic get_fwhm: self.fwhm = 4.49
Faked up EXPNUM 82190098
Faked up EXPNUM 82190098
Faked up EXPNUM 82190098
90prime get_fwhm: self.fwhm = 3.73
Faked up EXPNUM 85110243
Faked up EXPNUM 85110243
Faked up EXPNUM 85110243
90prime get_fwhm: self.fwhm = 2.97
Faked up EXPNUM 85230154
Faked up EXPNUM 85230154
Faked up EXPNUM 85230154
90prime get_fwhm: self.fwhm = 3.43
Faked up EXPNUM 84950057
Faked up EXPNUM 84950057
Faked up EXPNUM 84950057
90prime get_fwhm: self.fwhm = 3.27
Faked up EXPNUM 85110140
Faked up EXPNUM 85110140
Faked up EXPNUM 85110140
90prime get_fwhm: self.fwhm = 3.05
mosaic get_fwhm: self.fwhm = 3.93
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
AssertionError
Something went wrong; please check the logfile.
ERROR: galaxy NGC2959_GROUP; please check the logfile.
Finished galaxy NGC2959_GROUP in 0.073 minutes.
Started working on galaxy NGC2959_GROUP at Sun Feb  9 11:28:50 2020
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 146.3090650539803 68.59986162890779 --width 1221 --height 1221 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-09T11:28:50.686144
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '146.3090650539803', '68.59986162890779', '--width', '1221', '--height', '1221', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 146.3090650539803 68.59986162890779 --width 1221 --height 1221 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 146.3090650539803 68.59986162890779
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 60585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 60586 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 60587 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 60588 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 60589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 60590 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 60591 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 60593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 60594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 60595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 60596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 60597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 60598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 60599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 60600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 60601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB
Starting process 60602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071196 MB
Starting process 60603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072208 MB
Starting process 60604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072212 MB
Starting process 60605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07192 MB
Starting process 60606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07192 MB
Starting process 60607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071556 MB
Starting process 60608 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071492 MB
Starting process 60609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071556 MB
Starting process 60610 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071492 MB
Starting process 60611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071492 MB
Starting process 60612 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071492 MB
Starting process 60613 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071492 MB
Starting process 60614 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071492 MB
Starting process 60615 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Starting process 60616 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Starting process 60617 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-09T11:28:51.987938
Keeping 16 CCDs:
   ksb_190128_063416_ooi_g_ls9.fits.fz ksb_190128_063416_ooi_g_ls9-CCD4 g exptime 110.595 propid NOTBASS    seeing 1.34 MJD 58511.274 object 
   ksb_190209_094735_ooi_r_ls9.fits.fz ksb_190209_094735_ooi_r_ls9-CCD4 r exptime 129.274 propid NOTBASS    seeing 1.55 MJD 58523.408 object 
   ksb_180410_063935_ooi_g_ls9.fits.fz ksb_180410_063935_ooi_g_ls9-CCD3 g exptime 224.25 propid BASS       seeing 1.48 MJD 58218.277 object 44302
   ksb_190131_115514_ooi_r_ls9.fits.fz ksb_190131_115514_ooi_r_ls9-CCD3 r exptime 200.6 propid NOTBASS    seeing 1.59 MJD 58514.497 object 
   ksb_190131_113812_ooi_r_ls9.fits.fz ksb_190131_113812_ooi_r_ls9-CCD1 r exptime 116.707 propid NOTBASS    seeing 1.59 MJD 58514.485 object 
   ksb_180411_071357_ooi_g_ls9.fits.fz ksb_180411_071357_ooi_g_ls9-CCD1 g exptime 219.186 propid BASS       seeing 1.69 MJD 58219.301 object 44292
   ksb_190128_062355_ooi_g_ls9.fits.fz ksb_190128_062355_ooi_g_ls9-CCD2 g exptime 118.43 propid NOTBASS    seeing 1.38 MJD 58511.267 object 
   ksb_190209_092322_ooi_r_ls9.fits.fz ksb_190209_092322_ooi_r_ls9-CCD2 r exptime 140.178 propid NOTBASS    seeing 1.56 MJD 58523.391 object 
   ksb_190112_101522_ooi_g_ls9.fits.fz ksb_190112_101522_ooi_g_ls9-CCD2 g exptime 124.63 propid NOTBASS    seeing 1.48 MJD 58495.427 object 
   ksb_190128_105804_ooi_r_ls9.fits.fz ksb_190128_105804_ooi_r_ls9-CCD2 r exptime 163.914 propid NOTBASS    seeing 1.35 MJD 58511.457 object 
   k4m_160125_092739_ooi_zd_ls9.fits.fz k4m_160125_092739_ooi_zd_ls9-CCD1 z exptime 128.103 propid 2016B-0453 seeing 1.10 MJD 57412.394 object MzLS_710853_z
   k4m_160320_060607_ooi_zd_ls9.fits.fz k4m_160320_060607_ooi_zd_ls9-CCD2 z exptime 94.104 propid 2016A-0453 seeing 0.88 MJD 57467.254 object MzLS_710390_z
   k4m_171028_104055_ooi_zd_ls9.fits.fz k4m_171028_104055_ooi_zd_ls9-CCD1 z exptime 135.306 propid 2016A-0453 seeing 1.02 MJD 58054.445 object MzLS_711310_z
   k4m_170307_072650_ooi_zd_ls9.fits.fz k4m_170307_072650_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 0.87 MJD 57819.310 object MzLS_709923_z
   k4m_160125_091939_ooi_zd_ls9.fits.fz k4m_160125_091939_ooi_zd_ls9-CCD3 z exptime 128.104 propid 2016B-0453 seeing 0.93 MJD 57412.389 object MzLS_710852_z
   k4m_160317_060522_ooi_zd_ls9.fits.fz k4m_160317_060522_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 1.17 MJD 57464.254 object MzLS_710389_z
WARNING: EXPNUM None!=160125092739 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_092739_ooi_zd_ls9.fits.fz header
WARNING: EXPNUM None!=160125091939 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_091939_ooi_zd_ls9.fits.fz header
Faked up EXPNUM 85110144
Faked up EXPNUM 85110144
Faked up EXPNUM 85110144
90prime get_fwhm: self.fwhm = 2.95
mosaic get_fwhm: self.fwhm = 4.49
Faked up EXPNUM 85110243
Faked up EXPNUM 85110243
Faked up EXPNUM 85110243
90prime get_fwhm: self.fwhm = 2.97
mosaic get_fwhm: self.fwhm = 3.93
Faked up EXPNUM 82190098
Faked up EXPNUM 82190098
Faked up EXPNUM 82190098
90prime get_fwhm: self.fwhm = 3.73
Faked up EXPNUM 85110140
Faked up EXPNUM 85110140
Faked up EXPNUM 85110140
90prime get_fwhm: self.fwhm = 3.05
Faked up EXPNUM 85140225
Faked up EXPNUM 85140225
Faked up EXPNUM 85140225
90prime get_fwhm: self.fwhm = 3.51
Faked up EXPNUM 84950057
Faked up EXPNUM 84950057
Faked up EXPNUM 84950057
90prime get_fwhm: self.fwhm = 3.27
Faked up EXPNUM 85230154
Faked up EXPNUM 85230154
Faked up EXPNUM 85230154
90prime get_fwhm: self.fwhm = 3.43
Faked up EXPNUM 85230163
Faked up EXPNUM 85230163
Faked up EXPNUM 85230163
90prime get_fwhm: self.fwhm = 3.41
Faked up EXPNUM 85140230
Faked up EXPNUM 85140230
Faked up EXPNUM 85140230
90prime get_fwhm: self.fwhm = 3.51
Faked up EXPNUM 82180085
Faked up EXPNUM 82180085
Faked up EXPNUM 82180085
90prime get_fwhm: self.fwhm = 3.27
mosaic get_fwhm: self.fwhm = 3.39
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
AssertionError
Something went wrong; please check the logfile.
ERROR: galaxy NGC2959_GROUP; please check the logfile.
Finished galaxy NGC2959_GROUP in 0.067 minutes.
Started working on galaxy NGC2959_GROUP at Mon Feb 10 06:18:02 2020
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 146.3090650539803 68.59986162890779 --width 1221 --height 1221 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-10T06:18:02.643517
legacypipe git version: dr9e-pre1-9-g4a51be93
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '146.3090650539803', '68.59986162890779', '--width', '1221', '--height', '1221', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 146.3090650539803 68.59986162890779 --width 1221 --height 1221 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/146/NGC2959_GROUP/NGC2959_GROUP-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 146.3090650539803 68.59986162890779
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 15721 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15722 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15723 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15724 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15725 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071128 MB
Starting process 15726 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071132 MB
Starting process 15727 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071132 MB
Starting process 15728 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB
Starting process 15729 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB
Starting process 15730 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071136 MB
Starting process 15731 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07114 MB
Starting process 15732 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15733 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15734 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15735 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15736 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071148 MB
Starting process 15737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071152 MB
Starting process 15738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072164 MB
Starting process 15739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072168 MB
Starting process 15740 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071876 MB
Starting process 15741 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071876 MB
Starting process 15742 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB
Starting process 15743 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB
Starting process 15744 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB
Starting process 15745 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB
Starting process 15746 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB
Starting process 15747 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB
Starting process 15748 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB
Starting process 15749 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB
Starting process 15750 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071448 MB
Starting process 15751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071452 MB
Starting process 15752 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071452 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-10T06:18:03.895661
Keeping 16 CCDs:
   ksb_190128_063416_ooi_g_ls9.fits.fz ksb_190128_063416_ooi_g_ls9-CCD4 g exptime 110.595 propid NOTBASS    seeing 1.34 MJD 58511.274 object 
   ksb_190209_094735_ooi_r_ls9.fits.fz ksb_190209_094735_ooi_r_ls9-CCD4 r exptime 129.274 propid NOTBASS    seeing 1.55 MJD 58523.408 object 
   ksb_180410_063935_ooi_g_ls9.fits.fz ksb_180410_063935_ooi_g_ls9-CCD3 g exptime 224.25 propid BASS       seeing 1.48 MJD 58218.277 object 44302
   ksb_190131_115514_ooi_r_ls9.fits.fz ksb_190131_115514_ooi_r_ls9-CCD3 r exptime 200.6 propid NOTBASS    seeing 1.59 MJD 58514.497 object 
   ksb_190131_113812_ooi_r_ls9.fits.fz ksb_190131_113812_ooi_r_ls9-CCD1 r exptime 116.707 propid NOTBASS    seeing 1.59 MJD 58514.485 object 
   ksb_180411_071357_ooi_g_ls9.fits.fz ksb_180411_071357_ooi_g_ls9-CCD1 g exptime 219.186 propid BASS       seeing 1.69 MJD 58219.301 object 44292
   ksb_190128_062355_ooi_g_ls9.fits.fz ksb_190128_062355_ooi_g_ls9-CCD2 g exptime 118.43 propid NOTBASS    seeing 1.38 MJD 58511.267 object 
   ksb_190209_092322_ooi_r_ls9.fits.fz ksb_190209_092322_ooi_r_ls9-CCD2 r exptime 140.178 propid NOTBASS    seeing 1.56 MJD 58523.391 object 
   ksb_190112_101522_ooi_g_ls9.fits.fz ksb_190112_101522_ooi_g_ls9-CCD2 g exptime 124.63 propid NOTBASS    seeing 1.48 MJD 58495.427 object 
   ksb_190128_105804_ooi_r_ls9.fits.fz ksb_190128_105804_ooi_r_ls9-CCD2 r exptime 163.914 propid NOTBASS    seeing 1.35 MJD 58511.457 object 
   k4m_160125_092739_ooi_zd_ls9.fits.fz k4m_160125_092739_ooi_zd_ls9-CCD1 z exptime 128.103 propid 2016B-0453 seeing 1.10 MJD 57412.394 object MzLS_710853_z
   k4m_160320_060607_ooi_zd_ls9.fits.fz k4m_160320_060607_ooi_zd_ls9-CCD2 z exptime 94.104 propid 2016A-0453 seeing 0.88 MJD 57467.254 object MzLS_710390_z
   k4m_171028_104055_ooi_zd_ls9.fits.fz k4m_171028_104055_ooi_zd_ls9-CCD1 z exptime 135.306 propid 2016A-0453 seeing 1.02 MJD 58054.445 object MzLS_711310_z
   k4m_170307_072650_ooi_zd_ls9.fits.fz k4m_170307_072650_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 0.87 MJD 57819.310 object MzLS_709923_z
   k4m_160125_091939_ooi_zd_ls9.fits.fz k4m_160125_091939_ooi_zd_ls9-CCD3 z exptime 128.104 propid 2016B-0453 seeing 0.93 MJD 57412.389 object MzLS_710852_z
   k4m_160317_060522_ooi_zd_ls9.fits.fz k4m_160317_060522_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 1.17 MJD 57464.254 object MzLS_710389_z
WARNING: EXPNUM None!=160125092739 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_092739_ooi_zd_ls9.fits.fz header
WARNING: EXPNUM None!=160125091939 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_091939_ooi_zd_ls9.fits.fz header
mosaic get_fwhm: self.fwhm = 4.49
Faked up EXPNUM 85110140
Faked up EXPNUM 85110140
Faked up EXPNUM 85110140
90prime get_fwhm: self.fwhm = 3.05
Faked up EXPNUM 85230154
Faked up EXPNUM 85230154
Faked up EXPNUM 85230154
90prime get_fwhm: self.fwhm = 3.43
Faked up EXPNUM 85140225
Faked up EXPNUM 85140225
Faked up EXPNUM 85140225
90prime get_fwhm: self.fwhm = 3.51
Faked up EXPNUM 82190098
Faked up EXPNUM 82190098
Faked up EXPNUM 82190098
90prime get_fwhm: self.fwhm = 3.73
Faked up EXPNUM 85110144
Faked up EXPNUM 85110144
Faked up EXPNUM 85110144
90prime get_fwhm: self.fwhm = 2.95
Faked up EXPNUM 84950057
Faked up EXPNUM 84950057
Faked up EXPNUM 84950057
90prime get_fwhm: self.fwhm = 3.27
Faked up EXPNUM 85230163
Faked up EXPNUM 85230163
Faked up EXPNUM 85230163
90prime get_fwhm: self.fwhm = 3.41
Faked up EXPNUM 85110243
Faked up EXPNUM 85110243
Faked up EXPNUM 85110243
90prime get_fwhm: self.fwhm = 2.97
Faked up EXPNUM 85140230
Faked up EXPNUM 85140230
Faked up EXPNUM 85140230
90prime get_fwhm: self.fwhm = 3.51
mosaic get_fwhm: self.fwhm = 3.39
Faked up EXPNUM 82180085
Faked up EXPNUM 82180085
Faked up EXPNUM 82180085
90prime get_fwhm: self.fwhm = 3.27
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
AssertionError
Something went wrong; please check the logfile.
ERROR: galaxy NGC2959_GROUP; please check the logfile.
Finished galaxy NGC2959_GROUP in 0.065 minutes.