2014-06-04 17:23:14.744Z root 30 Actor.py:110 reading config file /home/sdss3/products/Linux64/apogeeql/v1_5_3/etc/apogeeql.cfg new rollover = 49725.25 s from now, at time.struct_time(tm_year=2014, tm_mon=6, tm_mday=5, tm_hour=7, tm_min=12, tm_sec=0, tm_wday=3, tm_yday=156, tm_isdst=0) 2014-06-04 17:23:14.768Z root 30 sdss3logging.py:280 checking for stderr on ,', mode 'w' at 0x7f825080b1e0> 2014-06-04 17:23:14.768Z root 30 sdss3logging.py:287 disabling all but critical stderr output on ,', mode 'w' at 0x7f825080b1e0> % Compiled module: APQR_WRAPPER. % Compiled module: APQL_WRAPPER. % Compiled module: APWAVECAL_CHIP. % Compiled module: APGETDIR. % Compiled module: APGUNDEF. % Compiled module: ADDSLASH. % Compiled module: APWAVECAL_CHIP. % Compiled module: APQL_DE SYS. % Compiled module: APGETDIR. % Compiled module: APGUNDEF. % Compiled module: ADDSLASH. % Compiled module: CALDAT. FO. % Compiled module: STRSPLIT. % Compiled module: FIRST_EL. % Compiled module: HEADFITS. % Compiled module: FXPOSIT. O. % Compiled module: STRSPLIT. % Compiled module: FIRST_EL. % Compiled module: HEADFIT . % Compiled module: FXPOSIT. % Compiled module: FXMOVE. % Compiled module: MRD_HREAD. % Compiled module: FXPAR. % Compiled module: GETTOK. % Compiled module: VALID_ UM. % Compiled module: GETTOK. % Compiled module: VALID_NUM % Compiled module: MRD_SKIP. % Compiled module: SXPAR. % Compiled module: GETMJD5. % Compiled module: JULDAY. % Compiled module: DATE2JD % Compiled module: CHECK_DATEFORMAT. % Compiled module: DATE2JD. % Compiled module: CHECK_DATEFORMAT. % Compiled module: REVERSE. Connecting from apqr_wrapper to apogeeql through: localhost 10039 % Loaded DLM: IDL_IDLBRIDGE. % Compiled module: MRDFITS. % Compiled module: MATCH. % Compiled module: MRD_STRUCT. % Compiled module: IMPORTASCII. % Compiled module: STRESS. % Compiled module: STREP. % Compiled module: READ_ASCII. % Compiled module: QUERY_ASCII. % Error opening file. File: 1 qr Message = PING % Compiled module: WRITELINE. % Compiled module: UNIQ. 2 qr Message = STARTING Connecting from apql_wrapper to apogeeql through: localhost 10038 % Loaded DLM: IDL_IDLBRIDGE. % Error opening file. File: 1 ql Message = PING % Compiled module: WRITELINE. 2 ql Message = STARTING 3 ql Message = ditherPosition=12.994020,A 0 - namedDitherPos=A Card is too long, comment will be truncated. Card is too long, comment will be truncated. Card is too long, comment will be truncated. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFX' card to meet the FITS standard. Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFY' card to meet the FITS standard. Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFX' card to meet the FITS standard. Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFY' card to meet the FITS standard. Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFR' card to meet the FITS standard. Note: PyFITS uses zero-based indexing. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Note: PyFITS uses zero-based indexing. 4 ql Message = UTR=/data-ql/data/56813/apRaw-12510003-001.fits,68769,1,3 % Compiled module: FITS_READ. % Compiled module: FITS_OPEN. % Compiled module: SXDELPAR. % Compiled module: FITS_CLOSE. % Compiled module: GET_SQL_COL. % Compiled module: GET_SQL_SETUP. Card is too long, comment will be truncated. Card is too long, comment will be truncated. Card is too long, comment will be truncated. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFX' card to meet the FITS standard. Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFY' card to meet the FITS standard. Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFX' card to meet the FITS standard. Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFY' card to meet the FITS standard. Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFR' card to meet the FITS standard. Note: PyFITS uses zero-based indexing. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Note: PyFITS uses zero-based indexing. 5 ql Message = UTR=/data-ql/data/56813/apRaw-12510003-002.fits,68769,2,3 % Compiled module: APQL. Processing /data-ql/data/56813/apRaw-12510003-002.fits APQL_FITSHEADER ... % Compiled module: APQL_FITSHEADER. dt = 0.13629317 sec % Compiled module: PUSH. % Compiled module: FILEPATH. % Restored file: IDL_IDLBRIDGE::EXECUTETIMER. % Compiled module: APQL_DBINSERT. % Compiled module: GET_SQL_COL. % Compiled module: GET_SQL_SETUP. % Compiled module: IDL_SQL_DEFSYSV. libGL error: failed to load driver: swrast libGL error: Try again with LIBGL_DEBUG=verbose for more details. % Compiled module: XMANAGER. % Compiled module: AVG. STRUCT = -> Array[1] Inserting basic information for -> apRaw-12510003-002.fits % Compiled module: EXEC_SQL. Inserting S/N information Inserting exposure_pk information 68769 Inserting required fits keywords error information Card is too long, comment will be truncated. Card is too long, comment will be truncated. Card is too long, comment will be truncated. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFX' card to meet the FITS standard. Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Fixed 'BOREOFFY' card to meet the FITS standard. Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFX' card to meet the FITS standard. Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFY' card to meet the FITS standard. Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Fixed 'CALOFFR' card to meet the FITS standard. Note: PyFITS uses zero-based indexing. Output verification result: HDU 0: Card 84: Card 'BOREOFFX' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 85: Card 'BOREOFFY' is not FITS standard (invalid value string: NAN.0 / TCC Boresight offset, deg). Card 90: Card 'CALOFFX' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 91: Card 'CALOFFY' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Card 92: Card 'CALOFFR' is not FITS standard (invalid value string: NAN.0 / TCC CalibOff, deg). Note: PyFITS uses zero-based indexing. 3 qr Message = UTR=DONE,12510003,56813,68769 Number of running qrBridge processes: 1 Number of valid qrBridge objects: 1 res= 1 % Restored file: IDL_IDLBRIDGE::EXECUTETIMER. % Compiled module: APQUICKRED. in APQUICKRED % Compiled module: APGUNDEF. =============================== Running APOGEE QUICK REDUCTION =============================== Wed Jun 4 17:24:40 2014 % Compiled module: APGETDIR. % Compiled module: ADDSLASH. Using BPM = /data-ql/spectro/v0.6//cal/bpm/55577-00000037 Using PSF = /data-ql/spectro/v0.6//cal/psf/09710014 ----------------------------------------------------------- Processing Frame = 12510003 Nreads=3 ----------------------------------------------------------- Step 1 - Bundling ----------------- % Compiled mofailed to load driver: swrast libGL error: Try again with LIBGL_DEBUG=verbose for more details. Nfiles = 3 for 12510003 % Compiled module: FITS_READ. % Compiled module: FITS_OPEN. % Compiled module: SXPAR. % Compiled module: GETTOK. % Compiled module: SXDELPAR. % Compiled module: XMANAGER. % Compiled module: FITS_CLOSE. Writing bundled file to /data/apogee/archive/56813/apR-[abc]-12510003.fits % Compiled module: SXADDPAR. % Compiled module: FITS_ADD_CHECKSUM. % Compiled module: CHECKSUM32. % Compiled module: N_BYTES. % Compiled module: IS_IEEE_BIG. % Compiled module: FITS_ASCII_ENCODE. % Compiled module: MWRFITS. % Compiled module: FXPAR. % Compiled module: FXADDPAR. % Compiled module: VALID_NUM. APQL_FITSHEADER ... dt = 0.15857315 sec % Compiled module: APQL_DBINSERT_CALLBACK. STRUCT = -> Array[1] 7 ql Message = UTR=DONE Inserting basic information for -> ap % Compiled module: HOST_TO_IEEE. Inserting S/N information Inserting exposure_pk information 68769 Inserting required fits keywords error information % Compiled module: REVERSE. % Compiled module: DETABIFY. dt = 3.2471519 sec Step 2 - Collapsing the datacube -------------------------------- % Compiled module: AP3DQUICK. % Compiled module: HEADFITS. % Compiled module: FXPOSIT. % Compiled module: MRD_HREAD. Processing /data/apogee/archive/56813/apR-a-12510003.fits Nreads=3 Using BPM file = /data-ql/spectro/v0.6//cal/bpm/apBPM-a-55577-00000037.fits % Compiled module: MAD. Using FOWLER sampling. NFOWLER=1 % Compiled module: MEAN. % Compiled module: MOMENT. % Compiled module: SXADDHIST. Writing output to: /data/apogee/quickred/56813/ap2D-a-12510003.fits Saving FLUX/ERR as LONG instead of FLOAT % Compiled module: FITS_WRITE. % Compiled module: MKHDR. dt = 1.9234509 sec % Compiled module: PUSH. Processing /data/apogee/archive/56813/apR-b-12510003.fits Nreads=3 Using BPM file = /data-ql/spectro/v0.6//cal/bpm/apBPM-b-55577-00000037.fits Using FOWLER sampling. NFOWLER=1 Writing output to: /data/apogee/quickred/56813/ap2D-b-12510003.fits Saving FLUX/ERR as LONG instead of FLOAT dt = 3.4844940 sec Processing /data/apogee/archive/56813/apR-c-12510003.fits Nreads=3 Using BPM file = /data-ql/spectro/v0.6//cal/bpm/apBPM-c-55577-00000037.fits Using FOWLER sampling. NFOWLER=1 Writing output to: /data/apogee/quickred/56813/ap2D-c-12510003.fits Saving FLUX/ERR as LONG instead of FLOAT dt = 3.6386912 sec Step 3 - Extracting the spectra ------------------------------- Cannot do extraction for EXPTYPE=DARK % Compiled module: APFILEINFO. % Compiled module: STRSPLIT. % Compiled module: FIRST_EL. % Compiled module: FXMOVE. % Compiled module: MRD_SKIP. % Compiled module: GETMJD5. % Compiled module: JULDAY. % Compiled module: DATE2JD. % Compiled module: CHECK_DATEFORMAT. Step 4 - Compressing files -------------------------- Compressing the bundled files % Compiled module: APZIP. % Compiled module: LOADINPUT. 3 Files input 1/3 Compressing >>/data/apogee/archive/56813/apR-a-12510003.fits<< (31.50 MB) Nreads = 3 Step I: Making dCounts temporary file % Compiled module: MKTEMP. Step II: Subtracting average dCounts % Compiled module: MRDFITS. Step III: Compressing with fpack Input file size = 31504320 bytes Output file size = 19992960 bytes Compression ratio = 1.57577 dt = 6.7660630 sec 2/3 Compressing >>/data/apogee/archive/56813/apR-b-12510003.fits<< (31.50 MB) Nreads = 3 Step I: Making dCounts temporary file Step II: Subtracting average dCounts Step III: Compressing with fpack Input file size = 31504320 bytes Output file size = 19422720 bytes Compression ratio = 1.62203 dt = 8.3406210 sec 3/3 Compressing >>/data/apogee/archive/56813/apR-c-12510003.fits<< (31.50 MB) Nreads = 3 Step I: Making dCounts temporary file Step II: Subtracting average dCounts Step III: Compressing with fpack Input file size = 31504320 bytes Output file size = 19238400 bytes Compression ratio = 1.63757 dt = 7.0064931 sec Compressing the 2D images with FPACK Compressing /data/apogee/quickred/56813/ap2D-a-12510003.fits Compressing /data/apogee/quickred/56813/ap2D-b-12510003.fits Compressing /data/apogee/quickred/56813/ap2D-c-12510003.fits Deleting Bundled files % FILE_DELETE: Removed file: /data/apogee/archive/56813/apR-a-12510003.fits. % FILE_DELETE: Removed file: /data/apogee/archive/56813/apR-b-12510003.fits. % FILE_DELETE: Removed file: /data/apogee/archive/56813/apR-c-12510003.fits. Step 5 - Database prep and insert -------------------------- % Compiled module: APQUICKRED_DBPREP. % Compiled module: ZSCALE. % Compiled module: GOODPOLY. % Compiled module: BADPAR. % Compiled module: POLY_FIT. % Compiled module: STDEV. % Compiled module: POLY. % Compiled module: APQUICKRED_DBINSERT. starting apquickred_dbinsert ... % Compiled module: GET_SQL_COL. % Compiled module: GET_SQL_SETUP. % Compiled module: IDL_SQL_DEFSYSV. Inserting Quickred data % Compiled module: REPSTR. % Compiled module: EXEC_SQL. % Compiled module: SET_SQL_COLARRAY. Inserting Quickred IMBINZOOM Inserting exposure header information apquickred_dbinsert completed dt = 5.5015171 sec. dt = 44.605346 sec Error reading apqlactor_lun -> testing the socket connection 8 ql Message = % PRINTF: Error encountered writing to file. Unit: 100 File: localhost.10038 Broken pipe % PRINTF: Error encountered writing to file. Unit: 100 File: localhost.10038 Broken pipe Error reading apqlactor_lun -> testing the socket connection % PRINTF: Error encountered writing to file. Unit: 100 File: localhost.10038 Broken pipe socket is close -> EXITING apql_wrapper % Error encountered writing to file. Unit: 100 File: localhost.10038 Broken pipe apqr_wrapper -> Connection from 127.0.0.1 38949 Connection from 127.0.0.1 44345