/home/sdss3/products/Linux64/sqlalchemy/0.7.10/lib/python2.7/site-packages/sqlalchemy/engine/reflection.py:49: SAWarning: Skipped unsupported reflection of expression-based index q3c_field_idx ret = fn(self, con, *args, **kw) 2014-06-04 16:55:50.427Z root 30 Actor.py:110 reading config file /home/sdss3/products/Linux64/apogeeql/v1_5_3/etc/apogeeql.cfg new rollover = 51369.56 s from now, at time.struct_time(tm_year=2014, tm_mon=6, tm_mday=5, tm_hour=7, tm_min=12, tm_sec=0, tm_wday=3, tm_yday=156, tm_isdst=0) 2014-06-04 16:55:50.479Z root 30 sdss3logging.py:280 checking for stderr on ,', mode 'w' at 0x7f0e547421e0> 2014-06-04 16:55:50.479Z root 30 sdss3logging.py:287 disabling all but critical stderr output on ,', mode 'w' at 0x7f0e547421e0> % Compiled module: APQR_WRAPPER. % Compiled module: APQL_WRAPPER. % Compiled module: APWAVECAL_CHIP. % Compiled module: APGETDIR. % Compiled module: APQL_DEFSYS. % Compiled module: APGETDIR. % Compiled module: APGUNDEF. % Compiled module: ADDSLASH. % Compiled module: CALDAT. % Compiled module: APFILEINFO. % Compiled module: STRSPLIT. % Compiled module: FIRST_EL. % Compiled module: HEADFITS. % Compiled module: FXPOSIT. % Compiled module: FXMOVE. % Compiled module: MRD_HREAD. % Compiled module: FXPAR. % Compiled module: APFILEINFO. % Compiled module: STRSPLIT. % Compiled module: FIRST_EL. % Compiled module: HEADFITS. % Compiled module: FXPOSIT. % Compiled module: FXMOVE. % Compiled module: MRD_HREAD. % Compiled module: GETTOK. % Compiled module: VALID_ UM. % Compiled module: GETTOK. % Compiled module: VALID_NUM. % Compiled module: MRD_SKIP. % Compiled module: SXPAR. % Compiled module: SXPAR. % Compiled module: GETMJD5. % Compiled module: GETMJD5. % Compiled module: JULDAY. % Compiled module: DATE2JD % Compiled module: DATE2JD. % Compiled module: CHECK_DATEFORMAT. % Compiled module: REVERSE. Connecting from apqr_wrapper to apogeeql through: localhost 10039 % Compiled module: MRDFITS. % Compiled module: MATCH. % Compiled module: MRD_STRUCT. % Loaded DLM: IDL_IDLBRIDGE. % Error opening file. File: 1 qr Message = PING % Compiled module: WRITELINE. % Compiled module: IMPORTASCII. 2 qr Message = STARTING % Compiled module: STRESS. % Compiled module: STREP. % Compiled module: READ_ASCII. % Compiled module: QUERY_ASCII. % Compiled module: UNIQ. Connecting from apql_wrapper to apogeeql through: localhost 10038 % Loaded DLM: IDL_IDLBRIDGE. % Error opening file. File: 1 ql Message = PING % Compiled module: WRITELINE. 2 ql Message = STARTING 3 ql Message = ditherPosition=12.994020,A 0 - namedDitherPos=A 4 ql Message = ditherPosition=12.994020,A 0 - namedDitherPos=A 5 ql Message = ditherPosition=12.994020,A 0 - namedDitherPos=A 6 ql Message = ditherPosition=12.994020,A 0 - namedDitherPos=A Card is too long, comment will be truncated. Card is too long, comment will be truncated. Card is too long, comment will be truncated. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFX' card to meet the FITS standard. Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFY' card to meet the FITS standard. Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFX' card to meet the FITS standard. Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFY' card to meet the FITS standard. Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFR' card to meet the FITS standard. Note: PyFITS uses zero-based indexing. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Note: PyFITS uses zero-based indexing. 7 ql Message = UTR=/data-ql/data/56813/apRaw-12510001-001.fits,68768,1,3 % Compiled module: FITS_READ. % Compiled module: FITS_OPEN. % Compiled module: SXDELPAR. % Compiled module: FITS_CLOSE. % Compiled module: GET_SQL_COL. % Compiled module: GET_SQL_SETUP. Card is too long, comment will be truncated. Card is too long, comment will be truncated. Card is too long, comment will be truncated. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFX' card to meet the FITS standard. Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFY' card to meet the FITS standard. Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFX' card to meet the FITS standard. Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFY' card to meet the FITS standard. Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFR' card to meet the FITS standard. Note: PyFITS uses zero-based indexing. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Note: PyFITS uses zero-based indexing. 8 ql Message = UTR=/data-ql/data/56813/apRaw-12510001-002.fits,68768,2,3 % Compiled module: APQL. Processing /data-ql/data/56813/apRaw-12510001-002.fits APQL_FITSHEADER ... % Compiled module: APQL_FITSHEADER. dt = 0.13513207 sec % Compiled module: PUSH. % Compiled module: FILEPATH. % Compiled module: APQL_DBINSERT. % Compiled module: GET_SQL_COL. % Compiled module: GET_SQL_SETUP. % Compiled module: IDL_SQL_DEFSYSV. % Restored file: IDL_IDLBRIDGE::EXECUTETIMER. libGL error: failed to load driver: swrast libGL error: Try again with LIBGL_DEBUG=verbose for more details. Inserting basic information for -> apRaw-12510001-002.fits % Compiled module: EXEC_SQL. Inserting S/N information Inserting exposure_pk information 68768 % Compiled module: XMANAGER. % Compiled module: AVG. STRUCT = -> Array[1] Inserting required fits keywords error information Card is too long, comment will be truncated. Card is too long, comment will be truncated. Card is too long, comment will be truncated. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFX' card to meet the FITS standard. Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFY' card to meet the FITS standard. Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFX' card to meet the FITS standard. Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFY' card to meet the FITS standard. Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFR' card to meet the FITS standard. Note: PyFITS uses zero-based indexing. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Note: PyFITS uses zero-based indexing. 3 qr Message = UTR=DONE,12510001,56813,68768 Number of running qrBridge processes: 1 Number of valid qrBridge objects: 1 res= 1 % Restored file: IDL_IDLBRIDGE::EXECUTETIMER. % Compiled module: APQUICKRED. in APQUICKRED % Compiled module: APGUNDEF. =============================== Running APOGEE QUICK REDUCTION =============================== Wed Jun 4 17:15:31 2014 % Compiled module: APGETDIR. % Compiled module: ADDSLASH. libGL error: failed to load driver: swrast libGL error: Try again with LIBGL_DEBUG=verbose for more details. Directory /data/apogee/quickred/56813/ does NOT exist. Creating it. % Compiled module: XMANAGER. Using BPM = /data-ql/spectro/v0.6//cal/bpm/55577-00000037 Using PSF = /data-ql/spectro/v0.6//cal/psf/09710014 ----------------------------------------------------------- Processing Frame = 12510001 Nreads=3 ----------------------------------------------------------- Directory /data/apogee/archive/56813/ does NOT exist. Creating it. APQL_FITSHEADER ... dt = 0.14642811 sec % Compiled module: APQL_DBINSERT_CALLBACK. Array[1] 10 ql Message = UTR=DONE % Compiled module: APQBUNDLE. Nfiles = 3 for 12510001 % Compiled module: FITS_READ. % Compiled module: FITS_OPEN. % Compiled module: SXPAR. % Compiled module: GETTOK. % Compiled module: SXDELPAR. Inserting S/N information Inserting exposure_pk information 68768 % Compiled module: FITS_CLOSE. Writing bundled file to /data/apogee/archive/56813/apR-[abc]-12510001.fits % Compiled module: SXADDPAR. % Compiled module: FITS_ADD_CHECKSUM. Inserting required fits keywords error information % Compiled module: CHECKSUM32. % Compiled module: N_BYTES. % Compiled module: IS_IEEE_BIG. % Compiled module: FITS_ASCII_ENCODE. % Compiled module: MWRFITS. % Compiled module: FXPAR. % Compiled module: FXADDPAR. % Compiled module: VALID_NUM. % Compiled module: FITS_TEST_CHECKSUM. % Compiled module: HOST_TO_IEEE. % Compiled module: REVERSE. % Compiled module: DETABIFY. dt = 3.3900659 sec Step 2 - Collapsing the datacube -------------------------------- % Compiled module: AP3DQUICK. % Compiled module: HEADFITS. % Compiled module: FXPOSIT. % Compiled module: MRD_HREAD. Processing /data/apogee/archive/56813/apR-a-12510001.fits Nreads=3 Using BPM file = /data-ql/spectro/v0.6//cal/bpm/apBPM-a-55577-00000037.fits % Compiled module: MAD. Using FOWLER sampling. NFOWLER=1 % Compiled module: MEAN. % Compiled module: MOMENT. % Compiled module: SXADDHIST. Writing output to: /data/apogee/quickred/56813/ap2D-a-12510001.fits Saving FLUX/ERR as LONG instead of FLOAT % Compiled module: FITS_WRITE. % Compiled module: MKHDR. dt = 1.6291521 sec % Compiled module: PUSH. Processing /data/apogee/archive/56813/apR-b-12510001.fits Nreads=3 Using BPM file = /data-ql/spectro/v0.6//cal/bpm/apBPM-b-55577-00000037.fits Using FOWLER sampling. NFOWLER=1 Writing output to: /data/apogee/quickred/56813/ap2D-b-12510001.fits Saving FLUX/ERR as LONG instead of FLOAT dt = 1.5061932 sec Processing /data/apogee/archive/56813/apR-c-12510001.fits Nreads=3 Using BPM file = /data-ql/spectro/v0.6//cal/bpm/apBPM-c-55577-00000037.fits Using FOWLER sampling. NFOWLER=1 Writing output to: /data/apogee/quickred/56813/ap2D-c-12510001.fits Saving FLUX/ERR as LONG instead of FLOAT dt = 2.0819960 sec Step 3 - Extracting the spectra ------------------------------- Cannot do extraction for EXPTYPE=DARK % Compiled module: APFILEINFO. % Compiled module: STRSPLIT. % Compiled module: FIRST_EL. % Compiled module: FXMOVE. % Compiled module: MRD_SKIP. % Compiled module: GETMJD5. % Compiled module: JULDAY. % Compiled module: DATE2JD. % Compiled module: CHECK_DATEFORMAT. Step 4 - Compressing files -------------------------- Compressing the bundled files % Compiled module: APZIP. % Compiled module: LOADINPUT. 3 Files input 1/3 Compressing >>/data/apogee/archive/56813/apR-a-12510001.fits<< (31.50 MB) Nreads = 3 Step I: Making dCounts temporary file % Compiled module: MKTEMP. Step II: Subtracting average dCounts % Compiled module: MRDFITS. Step III: Compressing with fpack Input file size = 31504320 bytes Output file size = 20007360 bytes Compression ratio = 1.57464 dt = 4.4434121 sec 2/3 Compressing >>/data/apogee/archive/56813/apR-b-12510001.fits<< (31.50 MB) Nreads = 3 Step I: Making dCounts temporary file Step II: Subtracting average dCounts Step III: Compressing with fpack Input file size = 31504320 bytes Output file size = 19419840 bytes Compression ratio = 1.62227 dt = 4.1773000 sec 3/3 Compressing >>/data/apogee/archive/56813/apR-c-12510001.fits<< (31.50 MB) Nreads = 3 Step I: Making dCounts temporary file Step II: Subtracting average dCounts Step III: Compressing with fpack Input file size = 31504320 bytes Output file size = 19313280 bytes Compression ratio = 1.63123 dt = 4.0558391 sec Compressing the 2D images with FPACK Compressing /data/apogee/quickred/56813/ap2D-a-12510001.fits Compressing /data/apogee/quickred/56813/ap2D-b-12510001.fits Compressing /data/apogee/quickred/56813/ap2D-c-12510001.fits Deleting Bundled files % FILE_DELETE: Removed file: /data/apogee/archive/56813/apR-a-12510001.fits. % FILE_DELETE: Removed file: /data/apogee/archive/56813/apR-b-12510001.fits. % FILE_DELETE: Removed file: /data/apogee/archive/56813/apR-c-12510001.fits. Step 5 - Database prep and insert -------------------------- % Compiled module: APQUICKRED_DBPREP. % Compiled module: ZSCALE. % Compiled module: GOODPOLY. % Compiled module: BADPAR. % Compiled module: POLY_FIT. % Compiled module: STDEV. % Compiled module: POLY. % Compiled module: APQUICKRED_DBINSERT. starting apquickred_dbinsert ... % Compiled module: GET_SQL_COL. % Compiled module: GET_SQL_SETUP. % Compiled module: IDL_SQL_DEFSYSV. Inserting Quickred data % Compiled module: REPSTR. % Compiled module: EXEC_SQL. % Compiled module: SET_SQL_COLARRAY. Inserting Quickred IMBINZOOM Inserting exposure header information apquickred_dbinsert completed dt = 5.3407202 sec. dt = 29.780153 sec Error reading apqlactor_lun -> testing the socket connection 11 ql Message = % PRINTF: Error encountered writing to file. Unit: 100 File: localhost.10038 Broken pipe % PRINTF: Error encountered writing to file. Unit: 100 File: localhost.10038 Broken pipe Error reading apqlactor_lun -> testing the socket connection % PRINTF: Error encountered writing to file. Unit: 100 File: localhost.10038 Broken pipe socket is close -> EXITING apql_wrapper % Error encountered writing to file. Unit: 100 File: localhost.10038 Broken pipe apqr_wrapper -> Connection from 127.0.0.1 38747 Connection from 127.0.0.1 44143