Started working on galaxy UGC04981 at Sat Feb  8 08:49:39 2020
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.00825 68.56236109999999 --width 805 --height 805 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-08T08:49:40.029661
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '141.00825', '68.56236109999999', '--width', '805', '--height', '805', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.00825 68.56236109999999 --width 805 --height 805 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 141.00825 68.56236109999999
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 12333 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 12334 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 12335 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 12336 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 12337 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 12338 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 12339 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071168 MB
Starting process 12340 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-08T08:49:41.328503
Keeping 11 CCDs:
   ksb_190117_102440_ooi_r_ls9.fits.fz ksb_190117_102440_ooi_r_ls9-CCD2 r exptime 250.0 propid NOTBASS    seeing 1.58 MJD 58500.434 object 
   ksb_190111_104852_ooi_g_ls9.fits.fz ksb_190111_104852_ooi_g_ls9-CCD2 g exptime 198.403 propid NOTBASS    seeing 1.64 MJD 58494.451 object 
   ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD3 g exptime 178.794 propid BASS       seeing 1.94 MJD 58219.275 object 44282
   ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD3 r exptime 112.96 propid NOTBASS    seeing 1.50 MJD 58514.475 object 
   ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD4 g exptime 212.212 propid NOTBASS    seeing 2.38 MJD 58510.289 object 
   ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD4 r exptime 142.272 propid NOTBASS    seeing 1.54 MJD 58523.380 object 
   ksb_190115_120612_ooi_g_ls9.fits.fz ksb_190115_120612_ooi_g_ls9-CCD1 g exptime 210.276 propid NOTBASS    seeing 1.46 MJD 58498.504 object 
   ksb_160217_045609_ooi_r_ls9.fits.fz ksb_160217_045609_ooi_r_ls9-CCD1 r exptime 250.0 propid 2015A-0801 seeing 1.52 MJD 57435.206 object 44272
   k4m_170522_050359_ooi_zd_ls9.fits.fz k4m_170522_050359_ooi_zd_ls9-CCD4 z exptime 184.104 propid 2016A-0453 seeing 1.37 MJD 57895.211 object MzLS_710386_z
   k4m_160125_085418_ooi_zd_ls9.fits.fz k4m_160125_085418_ooi_zd_ls9-CCD3 z exptime 124.104 propid 2016B-0453 seeing 0.95 MJD 57412.371 object MzLS_710849_z
   k4m_160320_061101_ooi_zd_ls9.fits.fz k4m_160320_061101_ooi_zd_ls9-CCD2 z exptime 91.104 propid 2016A-0453 seeing 0.83 MJD 57467.258 object MzLS_709920_z
Faked up EXPNUM 85100122
Faked up EXPNUM 85100122
Faked up EXPNUM 85100122
90prime get_fwhm: self.fwhm = 5.25
Faked up EXPNUM 85000182
Faked up EXPNUM 85000182
Faked up EXPNUM 85000182
90prime get_fwhm: self.fwhm = 3.49
WARNING: EXPNUM None!=160125085418 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_085418_ooi_zd_ls9.fits.fz header
Faked up EXPNUM 74350063
Faked up EXPNUM 74350063
Faked up EXPNUM 74350063
90prime get_fwhm: self.fwhm = 3.35
Faked up EXPNUM 84980160
Faked up EXPNUM 84980160
Faked up EXPNUM 84980160
90prime get_fwhm: self.fwhm = 3.23
Faked up EXPNUM 85230149
Faked up EXPNUM 85230149
Faked up EXPNUM 85230149
90prime get_fwhm: self.fwhm = 3.39
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
AssertionError
Something went wrong; please check the logfile.
ERROR: galaxy UGC04981; please check the logfile.
Finished galaxy UGC04981 in 0.080 minutes.
Started working on galaxy UGC04981 at Sat Feb  8 12:46:11 2020
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.00825 68.56236109999999 --width 805 --height 805 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-08T12:46:12.357967
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '141.00825', '68.56236109999999', '--width', '805', '--height', '805', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.00825 68.56236109999999 --width 805 --height 805 --pixscale 0.262 --threads 8 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 141.00825 68.56236109999999
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 63578 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 63579 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 63580 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 63581 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 63582 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 63583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 63584 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 63585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-08T12:46:13.672225
Keeping 11 CCDs:
   ksb_190117_102440_ooi_r_ls9.fits.fz ksb_190117_102440_ooi_r_ls9-CCD2 r exptime 250.0 propid NOTBASS    seeing 1.58 MJD 58500.434 object 
   ksb_190111_104852_ooi_g_ls9.fits.fz ksb_190111_104852_ooi_g_ls9-CCD2 g exptime 198.403 propid NOTBASS    seeing 1.64 MJD 58494.451 object 
   ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD3 g exptime 178.794 propid BASS       seeing 1.94 MJD 58219.275 object 44282
   ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD3 r exptime 112.96 propid NOTBASS    seeing 1.50 MJD 58514.475 object 
   ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD4 g exptime 212.212 propid NOTBASS    seeing 2.38 MJD 58510.289 object 
   ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD4 r exptime 142.272 propid NOTBASS    seeing 1.54 MJD 58523.380 object 
   ksb_190115_120612_ooi_g_ls9.fits.fz ksb_190115_120612_ooi_g_ls9-CCD1 g exptime 210.276 propid NOTBASS    seeing 1.46 MJD 58498.504 object 
   ksb_160217_045609_ooi_r_ls9.fits.fz ksb_160217_045609_ooi_r_ls9-CCD1 r exptime 250.0 propid 2015A-0801 seeing 1.52 MJD 57435.206 object 44272
   k4m_170522_050359_ooi_zd_ls9.fits.fz k4m_170522_050359_ooi_zd_ls9-CCD4 z exptime 184.104 propid 2016A-0453 seeing 1.37 MJD 57895.211 object MzLS_710386_z
   k4m_160125_085418_ooi_zd_ls9.fits.fz k4m_160125_085418_ooi_zd_ls9-CCD3 z exptime 124.104 propid 2016B-0453 seeing 0.95 MJD 57412.371 object MzLS_710849_z
   k4m_160320_061101_ooi_zd_ls9.fits.fz k4m_160320_061101_ooi_zd_ls9-CCD2 z exptime 91.104 propid 2016A-0453 seeing 0.83 MJD 57467.258 object MzLS_709920_z
Faked up EXPNUM 84980160
Faked up EXPNUM 84980160
Faked up EXPNUM 84980160
90prime get_fwhm: self.fwhm = 3.23
Faked up EXPNUM 74350063
Faked up EXPNUM 74350063
Faked up EXPNUM 74350063
90prime get_fwhm: self.fwhm = 3.35
WARNING: EXPNUM None!=160125085418 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_085418_ooi_zd_ls9.fits.fz header
Faked up EXPNUM 85140220
Faked up EXPNUM 85140220
Faked up EXPNUM 85140220
90prime get_fwhm: self.fwhm = 3.31
Faked up EXPNUM 85230149
Faked up EXPNUM 85230149
Faked up EXPNUM 85230149
90prime get_fwhm: self.fwhm = 3.39
Faked up EXPNUM 82190088
Faked up EXPNUM 82190088
Faked up EXPNUM 82190088
90prime get_fwhm: self.fwhm = 4.27
Faked up EXPNUM 85100122
Faked up EXPNUM 85100122
Faked up EXPNUM 85100122
90prime get_fwhm: self.fwhm = 5.25
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
AssertionError
Something went wrong; please check the logfile.
ERROR: galaxy UGC04981; please check the logfile.
Finished galaxy UGC04981 in 0.076 minutes.
Started working on galaxy UGC04981 at Sun Feb  9 08:13:37 2020
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.00825 68.56236109999999 --width 805 --height 805 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-09T08:13:37.810236
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '141.00825', '68.56236109999999', '--width', '805', '--height', '805', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.00825 68.56236109999999 --width 805 --height 805 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 141.00825 68.56236109999999
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 27754 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 27755 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 27756 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 27757 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 27758 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071164 MB
Starting process 27759 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 27760 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071172 MB
Starting process 27761 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 27762 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 27763 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 27764 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07118 MB
Starting process 27765 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB
Starting process 27766 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071192 MB
Starting process 27767 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 27768 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 27769 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 27770 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 27771 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.0722 MB
Starting process 27772 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.0722 MB
Starting process 27773 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071912 MB
Starting process 27774 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071908 MB
Starting process 27775 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 27776 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB
Starting process 27777 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 27778 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB
Starting process 27779 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB
Starting process 27780 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB
Starting process 27781 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071544 MB
Starting process 27782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB
Starting process 27783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB
Starting process 27784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071552 MB
Starting process 27785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071548 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-09T08:13:39.075229
Keeping 11 CCDs:
   ksb_190117_102440_ooi_r_ls9.fits.fz ksb_190117_102440_ooi_r_ls9-CCD2 r exptime 250.0 propid NOTBASS    seeing 1.58 MJD 58500.434 object 
   ksb_190111_104852_ooi_g_ls9.fits.fz ksb_190111_104852_ooi_g_ls9-CCD2 g exptime 198.403 propid NOTBASS    seeing 1.64 MJD 58494.451 object 
   ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD3 g exptime 178.794 propid BASS       seeing 1.94 MJD 58219.275 object 44282
   ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD3 r exptime 112.96 propid NOTBASS    seeing 1.50 MJD 58514.475 object 
   ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD4 g exptime 212.212 propid NOTBASS    seeing 2.38 MJD 58510.289 object 
   ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD4 r exptime 142.272 propid NOTBASS    seeing 1.54 MJD 58523.380 object 
   ksb_190115_120612_ooi_g_ls9.fits.fz ksb_190115_120612_ooi_g_ls9-CCD1 g exptime 210.276 propid NOTBASS    seeing 1.46 MJD 58498.504 object 
   ksb_160217_045609_ooi_r_ls9.fits.fz ksb_160217_045609_ooi_r_ls9-CCD1 r exptime 250.0 propid 2015A-0801 seeing 1.52 MJD 57435.206 object 44272
   k4m_170522_050359_ooi_zd_ls9.fits.fz k4m_170522_050359_ooi_zd_ls9-CCD4 z exptime 184.104 propid 2016A-0453 seeing 1.37 MJD 57895.211 object MzLS_710386_z
   k4m_160125_085418_ooi_zd_ls9.fits.fz k4m_160125_085418_ooi_zd_ls9-CCD3 z exptime 124.104 propid 2016B-0453 seeing 0.95 MJD 57412.371 object MzLS_710849_z
   k4m_160320_061101_ooi_zd_ls9.fits.fz k4m_160320_061101_ooi_zd_ls9-CCD2 z exptime 91.104 propid 2016A-0453 seeing 0.83 MJD 57467.258 object MzLS_709920_z
Faked up EXPNUM 74350063
Faked up EXPNUM 74350063
Faked up EXPNUM 74350063
90prime get_fwhm: self.fwhm = 3.35
Faked up EXPNUM 84980160
Faked up EXPNUM 84980160
Faked up EXPNUM 84980160
90prime get_fwhm: self.fwhm = 3.23
Faked up EXPNUM 85000182
Faked up EXPNUM 85000182
Faked up EXPNUM 85000182
90prime get_fwhm: self.fwhm = 3.49
WARNING: EXPNUM None!=160125085418 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_085418_ooi_zd_ls9.fits.fz header
Faked up EXPNUM 85140220
Faked up EXPNUM 85140220
Faked up EXPNUM 85140220
90prime get_fwhm: self.fwhm = 3.31
Faked up EXPNUM 82190088
Faked up EXPNUM 82190088
Faked up EXPNUM 82190088
90prime get_fwhm: self.fwhm = 4.27
Faked up EXPNUM 84940070
Faked up EXPNUM 84940070
Faked up EXPNUM 84940070
90prime get_fwhm: self.fwhm = 3.61
Faked up EXPNUM 85100122
Faked up EXPNUM 85100122
Faked up EXPNUM 85100122
90prime get_fwhm: self.fwhm = 5.25
Faked up EXPNUM 85230149
Faked up EXPNUM 85230149
Faked up EXPNUM 85230149
90prime get_fwhm: self.fwhm = 3.39
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
AssertionError
Something went wrong; please check the logfile.
ERROR: galaxy UGC04981; please check the logfile.
Finished galaxy UGC04981 in 0.066 minutes.
Started working on galaxy UGC04981 at Sun Feb  9 10:27:38 2020
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.00825 68.56236109999999 --width 805 --height 805 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-09T10:27:39.481000
legacypipe git version: dr9e-pre1-7-g54c974a3
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '141.00825', '68.56236109999999', '--width', '805', '--height', '805', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.00825 68.56236109999999 --width 805 --height 805 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 141.00825 68.56236109999999
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 44491 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 44492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 44493 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 44494 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 44495 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071176 MB
Starting process 44496 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 44497 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071184 MB
Starting process 44498 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 44499 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 44500 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071188 MB
Starting process 44501 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB
Starting process 44502 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB
Starting process 44503 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB
Starting process 44504 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB
Starting process 44505 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071196 MB
Starting process 44506 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0712 MB
Starting process 44507 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071204 MB
Starting process 44508 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072216 MB
Starting process 44509 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.072216 MB
Starting process 44510 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071924 MB
Starting process 44511 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07192 MB
Starting process 44512 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.07156 MB
Starting process 44513 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Starting process 44514 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Starting process 44515 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Starting process 44516 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Starting process 44517 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Starting process 44518 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Starting process 44519 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Starting process 44520 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Starting process 44521 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071496 MB
Starting process 44522 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.0715 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-09T10:27:42.131608
Keeping 11 CCDs:
   ksb_190117_102440_ooi_r_ls9.fits.fz ksb_190117_102440_ooi_r_ls9-CCD2 r exptime 250.0 propid NOTBASS    seeing 1.58 MJD 58500.434 object 
   ksb_190111_104852_ooi_g_ls9.fits.fz ksb_190111_104852_ooi_g_ls9-CCD2 g exptime 198.403 propid NOTBASS    seeing 1.64 MJD 58494.451 object 
   ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD3 g exptime 178.794 propid BASS       seeing 1.94 MJD 58219.275 object 44282
   ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD3 r exptime 112.96 propid NOTBASS    seeing 1.50 MJD 58514.475 object 
   ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD4 g exptime 212.212 propid NOTBASS    seeing 2.38 MJD 58510.289 object 
   ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD4 r exptime 142.272 propid NOTBASS    seeing 1.54 MJD 58523.380 object 
   ksb_190115_120612_ooi_g_ls9.fits.fz ksb_190115_120612_ooi_g_ls9-CCD1 g exptime 210.276 propid NOTBASS    seeing 1.46 MJD 58498.504 object 
   ksb_160217_045609_ooi_r_ls9.fits.fz ksb_160217_045609_ooi_r_ls9-CCD1 r exptime 250.0 propid 2015A-0801 seeing 1.52 MJD 57435.206 object 44272
   k4m_170522_050359_ooi_zd_ls9.fits.fz k4m_170522_050359_ooi_zd_ls9-CCD4 z exptime 184.104 propid 2016A-0453 seeing 1.37 MJD 57895.211 object MzLS_710386_z
   k4m_160125_085418_ooi_zd_ls9.fits.fz k4m_160125_085418_ooi_zd_ls9-CCD3 z exptime 124.104 propid 2016B-0453 seeing 0.95 MJD 57412.371 object MzLS_710849_z
   k4m_160320_061101_ooi_zd_ls9.fits.fz k4m_160320_061101_ooi_zd_ls9-CCD2 z exptime 91.104 propid 2016A-0453 seeing 0.83 MJD 57467.258 object MzLS_709920_z
WARNING: EXPNUM None!=160125085418 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_085418_ooi_zd_ls9.fits.fz header
Faked up EXPNUM 85140220
Faked up EXPNUM 85140220
Faked up EXPNUM 85140220
90prime get_fwhm: self.fwhm = 3.31
Faked up EXPNUM 74350063
Faked up EXPNUM 74350063
Faked up EXPNUM 74350063
90prime get_fwhm: self.fwhm = 3.35
Faked up EXPNUM 82190088
Faked up EXPNUM 82190088
Faked up EXPNUM 82190088
90prime get_fwhm: self.fwhm = 4.27
Faked up EXPNUM 84980160
Faked up EXPNUM 84980160
Faked up EXPNUM 84980160
90prime get_fwhm: self.fwhm = 3.23
Faked up EXPNUM 85100122
Faked up EXPNUM 85100122
Faked up EXPNUM 85100122
90prime get_fwhm: self.fwhm = 5.25
Faked up EXPNUM 85230149
Faked up EXPNUM 85230149
Faked up EXPNUM 85230149
90prime get_fwhm: self.fwhm = 3.39
Faked up EXPNUM 84940070
Faked up EXPNUM 84940070
Faked up EXPNUM 84940070
90prime get_fwhm: self.fwhm = 3.61
Faked up EXPNUM 85000182
Faked up EXPNUM 85000182
Faked up EXPNUM 85000182
90prime get_fwhm: self.fwhm = 3.49
mosaic get_fwhm: self.fwhm = 3.21
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
AssertionError
Something went wrong; please check the logfile.
ERROR: galaxy UGC04981; please check the logfile.
Finished galaxy UGC04981 in 0.081 minutes.
Started working on galaxy UGC04981 at Mon Feb 10 06:17:21 2020
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.00825 68.56236109999999 --width 805 --height 805 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p --unwise-coadds 

runbrick.py starting at 2020-02-10T06:17:22.261745
legacypipe git version: dr9e-pre1-9-g4a51be93
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '141.00825', '68.56236109999999', '--width', '805', '--height', '805', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981', '--survey-dir', '/global/cscratch1/sd/desimpp/dr9e', '--run', '90prime-mosaic', '--largegalaxy-preburner', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p', '--pickle', '/global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p', '--unwise-coadds']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 141.00825 68.56236109999999 --width 805 --height 805 --pixscale 0.262 --threads 32 --outdir /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981 --survey-dir /global/cscratch1/sd/desimpp/dr9e --run 90prime-mosaic --largegalaxy-preburner --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-checkpoint.p --pickle /global/projecta/projectdirs/desi/users/ioannis/LSLGA-data-dr9e/141/UGC04981/UGC04981-runbrick-%%(stage)s.p --unwise-coadds

WARNING: no WISE sky background maps in /global/cscratch1/sd/desimpp/dr9e/calib/wise/modelsky
Parsed RA,Dec 141.00825 68.56236109999999
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/home/legacyhalos/.astropy/cache/download/py3/lock' [astropy.utils.data]
Starting process 15217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071124 MB
Starting process 15218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB
Starting process 15219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB
Starting process 15220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB
Starting process 15221 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071128 MB
Starting process 15222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071132 MB
Starting process 15223 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071136 MB
Starting process 15224 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB
Starting process 15225 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.07114 MB
Starting process 15226 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071144 MB
Starting process 15227 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB
Starting process 15228 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB
Starting process 15229 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB
Starting process 15230 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB
Starting process 15231 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071148 MB
Starting process 15232 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 69 MB, VmData: 140 MB, maxrss: 0.071152 MB
Starting process 15233 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 71 MB, VmData: 140 MB, maxrss: 0.071152 MB
Starting process 15234 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072164 MB
Starting process 15235 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.072164 MB
Starting process 15236 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071884 MB
Starting process 15237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071964 MB
Starting process 15238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071148 MB
Starting process 15239 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB
Starting process 15240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB
Starting process 15241 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB
Starting process 15242 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071504 MB
Starting process 15243 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB
Starting process 15244 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB
Starting process 15245 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB
Starting process 15246 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB
Starting process 15247 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB
Starting process 15248 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 70 MB, VmData: 140 MB, maxrss: 0.071508 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage largegalaxies
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-02-10T06:17:23.516555
Keeping 11 CCDs:
   ksb_190117_102440_ooi_r_ls9.fits.fz ksb_190117_102440_ooi_r_ls9-CCD2 r exptime 250.0 propid NOTBASS    seeing 1.58 MJD 58500.434 object 
   ksb_190111_104852_ooi_g_ls9.fits.fz ksb_190111_104852_ooi_g_ls9-CCD2 g exptime 198.403 propid NOTBASS    seeing 1.64 MJD 58494.451 object 
   ksb_180411_063614_ooi_g_ls9.fits.fz ksb_180411_063614_ooi_g_ls9-CCD3 g exptime 178.794 propid BASS       seeing 1.94 MJD 58219.275 object 44282
   ksb_190131_112335_ooi_r_ls9.fits.fz ksb_190131_112335_ooi_r_ls9-CCD3 r exptime 112.96 propid NOTBASS    seeing 1.50 MJD 58514.475 object 
   ksb_190127_065527_ooi_g_ls9.fits.fz ksb_190127_065527_ooi_g_ls9-CCD4 g exptime 212.212 propid NOTBASS    seeing 2.38 MJD 58510.289 object 
   ksb_190209_090746_ooi_r_ls9.fits.fz ksb_190209_090746_ooi_r_ls9-CCD4 r exptime 142.272 propid NOTBASS    seeing 1.54 MJD 58523.380 object 
   ksb_190115_120612_ooi_g_ls9.fits.fz ksb_190115_120612_ooi_g_ls9-CCD1 g exptime 210.276 propid NOTBASS    seeing 1.46 MJD 58498.504 object 
   ksb_160217_045609_ooi_r_ls9.fits.fz ksb_160217_045609_ooi_r_ls9-CCD1 r exptime 250.0 propid 2015A-0801 seeing 1.52 MJD 57435.206 object 44272
   k4m_170522_050359_ooi_zd_ls9.fits.fz k4m_170522_050359_ooi_zd_ls9-CCD4 z exptime 184.104 propid 2016A-0453 seeing 1.37 MJD 57895.211 object MzLS_710386_z
   k4m_160125_085418_ooi_zd_ls9.fits.fz k4m_160125_085418_ooi_zd_ls9-CCD3 z exptime 124.104 propid 2016B-0453 seeing 0.95 MJD 57412.371 object MzLS_710849_z
   k4m_160320_061101_ooi_zd_ls9.fits.fz k4m_160320_061101_ooi_zd_ls9-CCD2 z exptime 91.104 propid 2016A-0453 seeing 0.83 MJD 57467.258 object MzLS_709920_z
WARNING: EXPNUM None!=160125085418 in /global/cscratch1/sd/desimpp/dr9e/images/mosaic/CP/V4.3/CP20160124/k4m_160125_085418_ooi_zd_ls9.fits.fz header
Faked up EXPNUM 82190088
Faked up EXPNUM 82190088
Faked up EXPNUM 82190088
90prime get_fwhm: self.fwhm = 4.27
Faked up EXPNUM 85100122
Faked up EXPNUM 85100122
Faked up EXPNUM 85100122
90prime get_fwhm: self.fwhm = 5.25
Faked up EXPNUM 85140220
Faked up EXPNUM 85140220
Faked up EXPNUM 85140220
90prime get_fwhm: self.fwhm = 3.31
Faked up EXPNUM 85230149
Faked up EXPNUM 85230149
Faked up EXPNUM 85230149
90prime get_fwhm: self.fwhm = 3.39
mosaic get_fwhm: self.fwhm = 3.21
mosaic get_fwhm: self.fwhm = 5.29
Faked up EXPNUM 84980160
Faked up EXPNUM 84980160
Faked up EXPNUM 84980160
90prime get_fwhm: self.fwhm = 3.23
Faked up EXPNUM 74350063
Faked up EXPNUM 74350063
Faked up EXPNUM 74350063
90prime get_fwhm: self.fwhm = 3.35
Faked up EXPNUM 84940070
Faked up EXPNUM 84940070
Faked up EXPNUM 84940070
90prime get_fwhm: self.fwhm = 3.61
Traceback (most recent call last):
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3605, in <module>
    sys.exit(main())
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3575, in main
    run_brick(opt.brick, survey, **kwargs)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3161, in run_brick
    initial_args=initargs, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage
    write=write, initial_args=initial_args, **kwargs)
  [Previous line repeated 6 more times]
  File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage
    R = stagefunc(stage, **Px)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3150, in mystagefunc
    R = stagefunc(stage, mp=mp, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__
    rtn = super(CallGlobalTime, self).__call__(stage, **kwargs)
  File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__
    return func(*self.args, **kwa)
  File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 271, in stage_tims
    tims = list(mp.map(read_one_tim, args))
  File "/usr/local/lib/python/astrometry/util/multiproc.py", line 89, in map
    return self.pool.map(f, args, cs)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
AssertionError
Something went wrong; please check the logfile.
ERROR: galaxy UGC04981; please check the logfile.
Finished galaxy UGC04981 in 0.064 minutes.