unwise_coadd.py starting: args: ['/global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py', '--tile', '1792m197', '--band', '1', '--outdir', '/global/cscratch1/sd/ameisner/unwise-coadds/tr_neo2/e000', '--recover_warped', '--no_irsa_dl', '--reference_dir', '/global/cscratch1/sd/ameisner/unwise-coadds/fulldepth_neo2_ref_w1', '--epoch', '0', '--warp_all', '--no_output_masks'] PBS_ARRAYID: 0 opt: {'threads1': None, 'reference_dir': '/global/cscratch1/sd/ameisner/unwise-coadds/fulldepth_neo2_ref_w1', 'plotprefix': None, 'force': False, 'no_sanity_check': False, 'height': 0, 'hi_lo_rej': False, 'medfilt': None, 'minmax': None, 'size': 2048, 'plots2': False, 'cube1': False, 'bgmatch': False, 'pixscale': 2.75, 'int_gz': False, 'nframes': 0, 'width': 0, 'epoch': 0, 'ra': None, 'dsky': False, 'preprocess': False, 'try_download': False, 'before': 100000.0, 'do_rebin': True, 'md5': False, 'dataset': 'sequels', 'cube': False, 'after': None, 'tile': '1792m197', 'threads': None, 'allmd5': False, 'rchi_fraction': 0.01, 'plots': False, 'frame0': 0, 'wishlist': False, 'maxmem': 0, 'compare_moon_all': False, 'center': False, 'band': [1], 'output_masks': False, 'use_zp_meta': False, 'outdir': '/global/cscratch1/sd/ameisner/unwise-coadds/tr_neo2/e000', 'pdf': False, 'warp_all': True, 'dec': None, 'outdir2': None, 'recover_warped': True} ['__cmp__', '__doc__', '__init__', '__module__', '__repr__', '__str__', '_update', '_update_careful', '_update_loose', 'after', 'allmd5', 'band', 'before', 'bgmatch', 'center', 'compare_moon_all', 'cube', 'cube1', 'dataset', 'dec', 'do_rebin', 'dsky', 'ensure_value', 'epoch', 'force', 'frame0', 'height', 'hi_lo_rej', 'int_gz', 'maxmem', 'md5', 'medfilt', 'minmax', 'nframes', 'no_sanity_check', 'outdir', 'outdir2', 'output_masks', 'pdf', 'pixscale', 'plotprefix', 'plots', 'plots2', 'preprocess', 'ra', 'rchi_fraction', 'read_file', 'read_module', 'recover_warped', 'reference_dir', 'size', 'threads', 'threads1', 'tile', 'try_download', 'use_zp_meta', 'warp_all', 'width', 'wishlist'] Running on host: nid02270 Running as user: ameisner MKL_NUM_THREADS: 1 Tile RA,Dec 179.2 -19.7 Looking for file 1792m197-atlas.fits Reading /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/wise_allsky_4band_p3as_cdd.fits Read 18240 Atlas tiles cosdec: 0.941464661246 Cut to 1 Atlas tiles near RA,Dec box Wrote 1792m197-atlas.fits Read 7904572 WISE L1b frames from /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/WISE-index-L1b_w1.fits /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_utils.py:268: VisibleDeprecationWarning: converting an array with ndim > 0 to an index will result in an error in the future dangle = degrees_between(ra[ind[0]:ind[1]], dec[ind[0]:ind[1]], racen, deccen) /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_utils.py:270: VisibleDeprecationWarning: converting an array with ndim > 0 to an index will result in an error in the future nearby[ind[0]:ind[1]] = (dangle <= margin) figuring out which frames are nearby took 1.29439902306 seconds Cut to 1241 WISE frames near RA,Dec box Reading /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/WISE-l1b-metadata-4band.fits Read 1491686 from /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/WISE-l1b-metadata-4band.fits Cut to 857 near RA,Dec box Matched 217 WISE-index-L1b scan_id: |S6 frame_num: >i8 WISE-metadata scan_id: |S6 frame_num: >i8 Cut to 205 matching scan/frame Band 1 : 205 Band 2 : 0 Band 3 : 0 Band 4 : 0 Reading /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/WISE-l1b-metadata-3band.fits Read 392879 from /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/WISE-l1b-metadata-3band.fits Cut to 0 near RA,Dec box Reading /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/WISE-l1b-metadata-2band.fits Read 901271 from /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/WISE-l1b-metadata-2band.fits Cut to 1016 near RA,Dec box Matched 295 WISE-index-L1b scan_id: |S6 frame_num: >i8 WISE-metadata scan_id: |S6 frame_num: >i8 Cut to 271 matching scan/frame Band 1 : 271 Band 2 : 0 Reading /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/WISE-l1b-metadata-neowiser.fits Read 2497867 from /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/WISE-l1b-metadata-neowiser.fits Cut to 1534 near RA,Dec box Matched 422 WISE-index-L1b scan_id: |S6 frame_num: >i8 WISE-metadata scan_id: |S6 frame_num: >i2 Cut to 380 matching scan/frame Band 1 : 380 Band 2 : 0 Reading /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/WISE-l1b-metadata-neowiser2.fits Read 2620896 from /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/WISE-l1b-metadata-neowiser2.fits Cut to 1656 near RA,Dec box Matched 415 WISE-index-L1b scan_id: |S6 frame_num: >i8 WISE-metadata scan_id: |S6 frame_num: >i4 Cut to 385 matching scan/frame Band 1 : 385 Band 2 : 0 1241 of 1241 matched to metadata tables Doing coadd tile 1792m197 band 1 Coadd tile 1792m197 RA,Dec 179.200353 -19.687778 Band 1 "git describe" version info: v3.5-15-gdebad9c will attempt to recover frames using per-quadrant polynomial warps ... mkdir /global/cscratch1/sd/ameisner/unwise-coadds/tr_neo2/e000/179/1792m197 Coadd IWC polygon: [[ 7.89479167e-01 3.18085660e-15] [ 7.89479167e-01 7.89479167e-01] [ 0.00000000e+00 7.89479167e-01] [ -7.89479167e-01 7.89479167e-01] [ -7.89479167e-01 -6.36171320e-15] [ -7.89479167e-01 -7.89479167e-01] [ -9.94017687e-17 -7.89479167e-01] [ 7.89479167e-01 -7.89479167e-01]] Found 1241 WISE frames in range and in band W1 cut to 971 in RA,Dec box Defined epoch breaks [55284.81127749, 55465.032709755003, 56109.436509464998, 56746.185776525002, 56928.313990170005, 57107.709382100002] Found 6 epoch breaks Cut to 1 within epoch Cut to 1 frames before MJD 100000.0 Cut out qual_frame = 0; 1 remaining Cut out planets != 0; 1 remaining 0 of 1 frames are not moon_masked /global/common/cori/software/python/2.7-anaconda/lib/python2.7/site-packages/numpy/core/_methods.py:59: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /global/common/cori/software/python/2.7-anaconda/lib/python2.7/site-packages/numpy/core/_methods.py:70: RuntimeWarning: invalid value encountered in true_divide ret = ret.dtype.type(ret / rcount) Median nan MAD nan 1 of 1 moon-masked frames have large pixel variance Cut to 1 on moon Frames: 0 00716a 59 MJD 55203.2237211 Reading L1b top-level directory locations from /global/cscratch1/sd/ameisner/code/unwise-coadds/etc_p9/l1b_dirs.yml L1b top-level directories are: {'2band': '/global/cscratch1/sd/desiproc/run_unwise/staging/2band_p1bm_frm', '3band': '/global/cscratch1/sd/desiproc/run_unwise/staging/3band_p1bm_frm', '4band': '/global/cscratch1/sd/desiproc/run_unwise/staging/4band_p1bm_frm', 'missing': 'merge_p1bm_frm', 'neo1': '/global/cscratch1/sd/desiproc/run_unwise/staging/p1bm_frm', 'neo2': '/global/cscratch1/sd/desiproc/run_unwise/staging/p1bm_frm'} 1 of 1 scan 00716a frame 59 band 1 intfn /global/cscratch1/sd/desiproc/run_unwise/staging/4band_p1bm_frm/6a/00716a/059/00716a059-w1-int-1b.fits XTENSION: '(null)' Image extent: [ 874 1015 170 563] Coadd extent: [ 0 156 0 344] Quadrant 2 does not intersect target Quadrant 3 does not intersect target Total pixels in coadd space: 54165.0 Cut to 1 frames intersecting target Up to coadd_wise: Wall: 0.42 s, CPU: 0.02 s, VmPeak: 845 MB, VmSize: 373 MB, VmRSS: 75 MB, VmData: 59 MB, maxrss: 0.560264 MB Creating reference image from files: /global/cscratch1/sd/ameisner/unwise-coadds/fulldepth_neo2_ref_w1/179/1792m197/unwise-1792m197-w1-img-u.fits /global/cscratch1/sd/ameisner/unwise-coadds/fulldepth_neo2_ref_w1/179/1792m197/unwise-1792m197-w1-std-u.fits /global/cscratch1/sd/ameisner/unwise-coadds/fulldepth_neo2_ref_w1/179/1792m197/unwise-1792m197-w1-n-u.fits /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:2575: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future coimg = np.zeros((H,W)) /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:2576: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future coimgsq = np.zeros((H,W)) /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:2577: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future cow = np.zeros((H,W)) /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:2578: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future con1 = np.zeros((H,W)) Reading zero point polynomial coefficients for phase : 3band, W1 Reading zero point polynomial coefficients for phase : 2band, W1 Reading zero point polynomial coefficients for phase : neowiser, W1 Reading zero point polynomial coefficients for phase : neowiser2, W1 Warping all quadrants relative to reference image Creating per-quadrant FirstRoundImage objects Creating per-quadrant FirstRoundImage objects Coadd round 1, image 1 of 1 intfn /global/cscratch1/sd/desiproc/run_unwise/staging/4band_p1bm_frm/6a/00716a/059/00716a059-w1-int-1b.fits uncfn /global/cscratch1/sd/desiproc/run_unwise/staging/4band_p1bm_frm/6a/00716a/059/00716a059-w1-unc-1b.fits.gz maskfn /global/cscratch1/sd/desiproc/run_unwise/staging/4band_p1bm_frm/6a/00716a/059/00716a059-w1-msk-1b.fits.gz Zeropoint: 20.752 -> scale 5.00264862421 sig1: 4.25830078125 Pixels to patch: 404 Estimated sky: 29.2614595813 Image median: 31.4379 Image median w/ noise: 32.1614 Pixels in range: 21694 Wall: 0.34 s, CPU: 0.27 s, VmPeak: 845 MB, VmSize: 603 MB, VmRSS: 143 MB, VmData: 254 MB, maxrss: 0.560264 MB not rebinning !! time to fit warp = 0.000204086303711 seconds, number of pixels = 60 total time in do_one_warp 0.000427007675171 seconds, number of pixels = 60 Subtracted polynomial warp from quadrant deleting x, y coordinates for quadrant 1 Skipping quadrant 2 Skipping quadrant 3 time to fit warp = 0.00202202796936 seconds, number of pixels = 21467 total time in do_one_warp 0.00693607330322 seconds, number of pixels = 21467 deleting x, y coordinates for quadrant 4 deleting x, y coordinates for quadrant -1 Accumulating first-round coadds... Wall: 0.00 s, CPU: 0.00 s, VmPeak: 845 MB, VmSize: 603 MB, VmRSS: 145 MB, VmData: 254 MB, maxrss: 0.560264 MB Before garbage collection: Wall: 0.00 s, CPU: 0.00 s, VmPeak: 845 MB, VmSize: 667 MB, VmRSS: 241 MB, VmData: 318 MB, maxrss: 0.560264 MB After garbage collection: Wall: 0.01 s, CPU: 0.01 s, VmPeak: 845 MB, VmSize: 667 MB, VmRSS: 241 MB, VmData: 318 MB, maxrss: 0.560264 MB /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:1746: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future self.coimg = np.zeros((H,W)) /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:1747: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future self.coimgsq = np.zeros((H,W)) /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:1748: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future self.cow = np.zeros((H,W)) /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:1749: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future self.con = np.zeros((H,W), np.int16) /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:1750: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future self.coimgb = np.zeros((H,W)) /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:1751: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future self.coimgsqb = np.zeros((H,W)) /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:1752: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future self.cowb = np.zeros((H,W)) /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:1753: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future self.conb = np.zeros((H,W), np.int16) Coadd round 2, image 1 of 1 /global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py:1593: VisibleDeprecationWarning: using a non-integer number instead of an integer will result in an error in the future badpixmask.dtype) Wall: 0.00 s, CPU: 0.00 s, VmPeak: 859 MB, VmSize: 859 MB, VmRSS: 241 MB, VmData: 511 MB, maxrss: 0.560264 MB Before garbage collection: Wall: 0.00 s, CPU: 0.00 s, VmPeak: 859 MB, VmSize: 859 MB, VmRSS: 242 MB, VmData: 511 MB, maxrss: 0.560264 MB After garbage collection: Wall: 0.01 s, CPU: 0.01 s, VmPeak: 859 MB, VmSize: 859 MB, VmRSS: 242 MB, VmData: 511 MB, maxrss: 0.560264 MB /global/cscratch1/sd/ameisner/code/astrometry.net-0.64/astrometry/util/miscutils.py:56: RuntimeWarning: invalid value encountered in double_scalars mx = -X[1] / (2. * X[2]) Estimated coadd sky: nan coadd_wise: Wall: 2.02 s, CPU: 1.11 s, VmPeak: 995 MB, VmSize: 675 MB, VmRSS: 280 MB, VmData: 326 MB, maxrss: 0.560264 MB Updating metadata based on quadrant SecondRoundImage objects. Traceback (most recent call last): File "/global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py", line 3135, in sys.exit(main()) File "/global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py", line 3129, in main output_masks=opt.output_masks): File "/global/cscratch1/sd/ameisner/code/unwise-coadds/unwise_coadd.py", line 1229, in one_coadd fitsio.write(ofn, coim.astype(np.float32), header=hdr, clobber=True, extname='coadded image, outliers patched') File "/global/cscratch1/sd/ameisner/code/lib/python2.7/site-packages/fitsio/fitslib.py", line 215, in write **keys) File "/global/cscratch1/sd/ameisner/code/lib/python2.7/site-packages/fitsio/fitslib.py", line 443, in write header=header) File "/global/cscratch1/sd/ameisner/code/lib/python2.7/site-packages/fitsio/fitslib.py", line 497, in write_image self[-1].write_keys(header) File "/global/cscratch1/sd/ameisner/code/lib/python2.7/site-packages/fitsio/fitslib.py", line 1281, in write_keys self.write_key(name,value,comment=comment) File "/global/cscratch1/sd/ameisner/code/lib/python2.7/site-packages/fitsio/fitslib.py", line 1215, in write_key str(comment)) IOError: FITSIO status = 402: bad float to string conversion Error in ffd2e: double value is a NaN or INDEF