APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Thursday February 27, 2003 (MJD 52698) ---=== OBSERVING TEAM ===--- Mike Harvanek (APO) Pete Newman (APO) Howard Brewington (APO) French Leger (FNAL/APO) ---=== OBSERVING PLAN ===--- Science! ---=== OBSERVING SUMMARY ===--- Clouds, snow flurries and high humidity shut us out again. That makes 9 straight nights. ---=== OBSERVING LOG ===--- We had repeated ptVME errors during the afternoon. This _may_ be due to a jiggling of the SCSI cables by Craig. We tried using ptvmeReset, but eventually had to reboot the crates, and then do another ptvmeReset after that before we got going. See the PROBLEMS section for a sample of the errors we got (around 00:30Z). The was a makeRunLog error after the doghouse bias. See the PROBLEMS section for details. Should a PR be filed on this? It was clear at sunset and we were hoping the coming front would stall/dissipate so we started with imaging. French was working on the sp2 shutter problem so our opening was slightly delayed but we were open 40 minutes after sunset. Unfortunately, the front did not stall or dissipate and clouds began to appear about 30 minutes after opening. We quickly switched to spectroscopy but the clouds had thickened and become threatening so we closed. While installing/removing the imager, Pete noticed that the external reinforcement cord that is wrapped around the first foot or so of the umbilical (as it comes out of the imager) is beginning to unwind. Pete tied it off in an effort to prevent further unwrapping. The umbilical is also showing signs of external wear at the location where it comes into contact with the j-hook. French was notified about both problems. While exercising the spectrograph shutters, it was noticed that sp2's shutter was not functioning properly. The shutter was found to be in an indeterminate state. French fiddled with it and was finally able to get the sensor to read that the shutter was closed. French believes that the shutter sensor is loose. He will remove the blue sp2 camera tomorrow during the day so he can fix the problem. Details of the shutter error can be found in the PROBLEMS section. Clouds, snow flurries and high humidity remained with us the rest of the night and we did not open again. That makes 9 nights in a row lost to weather. Ouch! ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 3688 01:02Z 01:15Z 100 O -117.80 -114.52 36 ignore 3689 01:52Z 02:10Z 100 O -105.19 -100.75 44 bias on telescope ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): yes QA Procedures Done (y/n): no UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 19500, plate -9999 ------- 01:50 19500 0.0 bias 01:56 19501 0.0 bias 02:02 19502 0.0 bias 02:39 19503 0.0 bias ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: None Stays: None ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 23:56Z 31 15 11 269 (W) 371 - clear 00:59Z 26 17 11 206 (SSW) 414 - " 01:33Z 25 18 13 196 (SSW) 419 - " 02:05Z 25 18 14 214 (SW) 501 - pcl 02:37Z 26 18 12 241 (WSW) 491 - mcl 03:10Z 26 19 19 216 (SW) 460 - tcl 03:42Z 26 20 17 217 (SW) 488 - " 04:14Z 26 19 20 232 (SW) 477 - " , flurries 04:46Z 26 20 28 236 (SW) 491 - " 05:19Z 27 20 23 239 (WSW) 395 - " 05:51Z 27 20 16 242 (WSW) 385 - " , flurries 06:23Z 26 21 24 234 (SW) 368 - " 06:55Z 25 21 26 266 (W) 401 - " 07:27Z 23 23 20 276 (W) 24842 - " 08:00Z 23 23 22 269 (W) 1938 - " , flurries 08:32Z 23 22 28 274 (W) 1380 - " 09:04Z 22 21 29 274 (W) 988 - " 09:36Z 21 20 19 289 (WNW) 5649 - " 10:09Z 21 19 19 268 (W) 372 - " 10:41Z 20 19 16 268 (W) 393 - " , flurries 11:13Z 20 19 14 263 (W) 396 - " [pmt]cl = partly, mostly, totally cloudy ---=== TELESCOPE STATUS ===--- 00:45Z Enclosure doors opened, fans and blowers on, louvers opened. 01:40Z Enclosure off. 02:30Z Enclosure on (clouds). 04:05Z Doors closed, fans and blowers off, louvers closed (snow flurries). Never reopened due to clouds, snow flurries and high humidity. Telescope stowed at 30 degrees with cartridge 3 (plate 1210) mounted. Counterweights at 280. Spectro auto-fill connected. Imager dewar 11:12 102 lb Spectro dewar 11:12 132 lb No interlocks bypassed. ---=== SOFTWARE USED ===--- IOP/SOP: v3_109_3 Watcher: v2_21_0 MCP: v5_18_0 TPM: tpm_v2_27_0 AstroDa: v14_47 TCC: 2.6.8 sdssProcedures: v1_64 tccMon: v2_0 SoS: v4_9_13 hoggPT: v1_5_8 plate-mapper: v4_2_0 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.0920 0.0790 Axial B 0.7950 0.7970 Axial C 0.8170 0.8240 Trans D -9.0760 -9.1130 Lateral E 1.8790 1.8870 Lateral F 0.0000 1.4300 GALILS Commanded: 5400. -3700. 900. -200. 31550. 30650. Actual: 5400. -3700. 900. -200. 31550. 30650. SETMIR VALUES PriDesOrient: 0.00 -11.80 23.00 1256.90 642.10 PriOrient: 0.00 -12.16 22.81 1257.41 642.19 SECONDARY: ---------- Focus: 0.00 Air Temp.: -2.8 Alt.: 30.016836 MIGS TONIGHT NOMINAL Axial A 1.5150 1.5170 Axial B 1.1530 1.1560 Axial C 1.1030 1.0990 Trans D -0.6970 -0.7070 GALILS Commanded: 1619661. 1555271. 1576348. -3400. -7900. Actual: 1619650. 1555250. 1576350. -3400. -7900. SETMIR VALUES SecDesOrient: 1257.00 0.00 -20.00 0.00 130.98 SecOrient: 1257.01 0.00 -20.01 -0.48 130.88 ---=== PROBLEMS IN DETAIL ===--- PTVME problems: --------------- Here is a sample of the errors we got (around 00:30Z): prn:sdsshost:/data/astro/ > iop Switching umask from 02 to 002 dscRun using system v14_47 Executing commands in /p/dervish/v8_7/etc/dervishStartup.tcl: Executing commands in /p/astrotools/v5_6/etc/astrotoolsStartup.tcl astroda OAC version v14_47 Using HVE link to ICC Error mapping shared data area (memory) mmap failed for /dev/mmem for offset 0xB8000000 (0x00200000 bytes) ******************************************************************************** * * * Backplane communications with the ICC are not possible. * * * * Observers! Check: * * * * o Connections between the machines. * * - ping sdssid1 (or sdsssd1 for sop, sdssmd1 for mop) * * - If connection is down check power switch on crates and reboot. * * o PTVME communications * * - sdsshost>ptvmeTest -n 1 -a 0x18000000 * * - If all errno = 0 All is Ok. * * - Else file any non-zero errno as bug report, * * - kill all iop processes (ps -elf) * * - sdsshost> ptvmeReset * * o Restart this (OAC) program. (IOP, SOP or MOP) -E.K. 18 Feb 2000 * * * ******************************************************************************** prn:sdsshost:/data/astro/ > ptvmeTest -n 1 -a 0x18000000 PID: 38031 IOPB size: 64 bytes ping: no operation: read loopCnt: 1 (defaulted) 100 loops per dot LWordCnt: 0x00000001 (defaulted) controller: 0 (defaulted) remNode: 1 --> /dev/ptvme0n1 remAddr: 0x18000000 (defaulted) IxferMode: 0x00 (defaulted) TxferMode: 0x00 (defaulted) errno = 0: open ("/dev/ptvme0n1", O_RDWR) = 3 errno = 0: ioctl (fd=3, PT_IOCTL_GET_PRIORITY, &ptPriority) = 0 ptPriority = 0x03 errno = 0: ioctl (fd=3, PT_IOCTL_GET_VECTOR, &ptVector) = 0 ptVector = 0x01 errno = 0: ioctl (fd=3, PT_IOCTL_GET_TIMEOUT, &ptTimeoutSave) = 0 ptTimeout = 900 ticks errno = 0: ioctl (fd=3, PT_IOCTL_GET_OP_MODE, &ptOpMode) = 0 ptOpMode = 1 SINGLE_IO errno = 0: ioctl (fd=3, PT_IOCTL_GET_DEBUG_MODE, &ptDebugMode) = 0 ptDebugMode = 0 NORMAL errno = 0: ioctl (fd=3, PT_IOCTL_GET_DEBUG, &ptDebugSave) = 0 ptDebug = 0x00000000 errno = 5: ioctl (fd=3, PT_IOCTL_GET_NODE_ID, 0) = 0xFFFFFFFF (I/O error) . 0 2 ms 17:28 errno = 16: read (fd=3, 0x7F7F2B20, 0x00000004) = -1 (Resource busy) CSB status: 0x00000000 AUX = (unknown) CMP = (Never Used) INNA = 0 errno = 0: lseek (fd=3, 0x00000000, SEEK_CUR) = 0x00000000 00000000: 00 01 02 03 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F <................> 00000010: 10 11 12 13 14 15 16 17 18 19 1A 1B 1C 1D 1E 1F <................> 00000020: 20 21 22 23 24 25 26 27 28 29 2A 2B 2C 2D 2E 2F < !"#$%&'()*+,-./> 00000030: 30 31 32 33 34 35 36 37 38 39 3A 3B 3C 3D 3E 3F <0123456789:;<=>?> prn:sdsshost:/data/astro/ > ptvmeReset ptvmeMode: INFO: controller 0 reset (/dev/ptvme0n0) ptvmeMode: INFO: cur debug mode: 0 NORMAL ptvmeMode: INFO: cur debug: 0x00000000 ptvmeMode: INFO: cur timeout: 900 ticks ptvmeMode: INFO: def T/I xfer mode: 0x22 A32:D32 Program, Non-Privileged / A32:D32 Program, Non-Privileged ptvmeMode: INFO: op mode: 1 SINGLE_IO ptvmeMode: INFO: VMEbus priority: 0x03 ptvmeMode: INFO: VMEbus vector: 0x01 ptvmeMode: INFO: intern sem val: 1 ptvmeMode: INFO: user sem val: 1 ptvmeMode: INFO: PT-VME940 node: 0 prn:sdsshost:/data/astro/ > ptvmeTest -n 1 -a 0x18000000 PID: 38065 IOPB size: 64 bytes ping: no operation: read loopCnt: 1 (defaulted) 100 loops per dot LWordCnt: 0x00000001 (defaulted) controller: 0 (defaulted) remNode: 1 --> /dev/ptvme0n1 remAddr: 0x18000000 (defaulted) IxferMode: 0x00 (defaulted) TxferMode: 0x00 (defaulted) errno = 0: open ("/dev/ptvme0n1", O_RDWR) = 3 errno = 0: ioctl (fd=3, PT_IOCTL_GET_PRIORITY, &ptPriority) = 0 ptPriority = 0x03 errno = 0: ioctl (fd=3, PT_IOCTL_GET_VECTOR, &ptVector) = 0 ptVector = 0x01 errno = 0: ioctl (fd=3, PT_IOCTL_GET_TIMEOUT, &ptTimeoutSave) = 0 ptTimeout = 900 ticks errno = 0: ioctl (fd=3, PT_IOCTL_GET_OP_MODE, &ptOpMode) = 0 ptOpMode = 1 SINGLE_IO errno = 0: ioctl (fd=3, PT_IOCTL_GET_DEBUG_MODE, &ptDebugMode) = 0 ptDebugMode = 0 NORMAL errno = 0: ioctl (fd=3, PT_IOCTL_GET_DEBUG, &ptDebugSave) = 0 ptDebug = 0x00000000 errno = 0: ioctl (fd=3, PT_IOCTL_GET_NODE_ID, 0) = 0x00 . 1 3 ms 17:29 errno = 0: lseek (fd=3, 0x00000000, SEEK_CUR) = 0x00000000 00000000: 01 AE F0 70 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F <...p............> 00000010: 10 11 12 13 14 15 16 17 18 19 1A 1B 1C 1D 1E 1F <................> 00000020: 20 21 22 23 24 25 26 27 28 29 2A 2B 2C 2D 2E 2F < !"#$%&'()*+,-./> 00000030: 30 31 32 33 34 35 36 37 38 39 3A 3B 3C 3D 3E 3F <0123456789:;<=>?> prn:sdsshost:/data/astro/ > prn:sdsshost:/data/spectro/ > ptvmeTest -n 1 -a 0x18000000 PID: 38926 IOPB size: 64 bytes ping: no operation: read loopCnt: 1 (defaulted) 100 loops per dot LWordCnt: 0x00000001 (defaulted) controller: 0 (defaulted) remNode: 1 --> /dev/ptvme0n1 remAddr: 0x18000000 (defaulted) IxferMode: 0x00 (defaulted) TxferMode: 0x00 (defaulted) errno = 0: open ("/dev/ptvme0n1", O_RDWR) = 3 errno = 0: ioctl (fd=3, PT_IOCTL_GET_PRIORITY, &ptPriority) = 0 ptPriority = 0x03 errno = 0: ioctl (fd=3, PT_IOCTL_GET_VECTOR, &ptVector) = 0 ptVector = 0x01 errno = 0: ioctl (fd=3, PT_IOCTL_GET_TIMEOUT, &ptTimeoutSave) = 0 ptTimeout = 900 ticks errno = 0: ioctl (fd=3, PT_IOCTL_GET_OP_MODE, &ptOpMode) = 0 ptOpMode = 1 SINGLE_IO errno = 0: ioctl (fd=3, PT_IOCTL_GET_DEBUG_MODE, &ptDebugMode) = 0 ptDebugMode = 0 NORMAL errno = 0: ioctl (fd=3, PT_IOCTL_GET_DEBUG, &ptDebugSave) = 0 ptDebug = 0x00000000 errno = 5: ioctl (fd=3, PT_IOCTL_GET_NODE_ID, 0) = 0xFFFFFFFF (I/O error) . 0 2 ms 17:31 errno = 16: read (fd=3, 0x7F7F2B20, 0x00000004) = -1 (Resource busy) CSB status: 0x00000000 AUX = (unknown) CMP = (Never Used) INNA = 0 errno = 0: lseek (fd=3, 0x00000000, SEEK_CUR) = 0x00000000 00000000: 00 01 02 03 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F <................> 00000010: 10 11 12 13 14 15 16 17 18 19 1A 1B 1C 1D 1E 1F <................> 00000020: 20 21 22 23 24 25 26 27 28 29 2A 2B 2C 2D 2E 2F < !"#$%&'()*+,-./> 00000030: 30 31 32 33 34 35 36 37 38 39 3A 3B 3C 3D 3E 3F <0123456789:;<=>?> prn:sdsshost:/data/spectro/ > ptvmeReset ptvmeMode: INFO: controller 0 reset (/dev/ptvme0n0) ptvmeMode: INFO: cur debug mode: 0 NORMAL ptvmeMode: INFO: cur debug: 0x00000000 ptvmeMode: INFO: cur timeout: 900 ticks ptvmeMode: INFO: def T/I xfer mode: 0x22 A32:D32 Program, Non-Privileged / A32:D32 Program, Non-Privileged ptvmeMode: INFO: op mode: 1 SINGLE_IO ptvmeMode: INFO: VMEbus priority: 0x03 ptvmeMode: INFO: VMEbus vector: 0x01 ptvmeMode: INFO: intern sem val: 1 ptvmeMode: INFO: user sem val: 1 ptvmeMode: INFO: PT-VME940 node: 0 prn:sdsshost:/data/spectro/ > ptvmeTest -n 1 -a 0x18000000 PID: 38789 IOPB size: 64 bytes ping: no operation: read loopCnt: 1 (defaulted) 100 loops per dot LWordCnt: 0x00000001 (defaulted) controller: 0 (defaulted) remNode: 1 --> /dev/ptvme0n1 remAddr: 0x18000000 (defaulted) IxferMode: 0x00 (defaulted) TxferMode: 0x00 (defaulted) errno = 0: open ("/dev/ptvme0n1", O_RDWR) = 3 errno = 0: ioctl (fd=3, PT_IOCTL_GET_PRIORITY, &ptPriority) = 0 ptPriority = 0x03 errno = 0: ioctl (fd=3, PT_IOCTL_GET_VECTOR, &ptVector) = 0 ptVector = 0x01 errno = 0: ioctl (fd=3, PT_IOCTL_GET_TIMEOUT, &ptTimeoutSave) = 0 ptTimeout = 900 ticks errno = 0: ioctl (fd=3, PT_IOCTL_GET_OP_MODE, &ptOpMode) = 0 ptOpMode = 1 SINGLE_IO errno = 0: ioctl (fd=3, PT_IOCTL_GET_DEBUG_MODE, &ptDebugMode) = 0 ptDebugMode = 0 NORMAL errno = 0: ioctl (fd=3, PT_IOCTL_GET_DEBUG, &ptDebugSave) = 0 ptDebug = 0x00000000 errno = 0: ioctl (fd=3, PT_IOCTL_GET_NODE_ID, 0) = 0x00 . 1 3 ms 17:31 errno = 0: lseek (fd=3, 0x00000000, SEEK_CUR) = 0x00000000 00000000: 01 AE F0 70 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F <...p............> 00000010: 10 11 12 13 14 15 16 17 18 19 1A 1B 1C 1D 1E 1F <................> 00000020: 20 21 22 23 24 25 26 27 28 29 2A 2B 2C 2D 2E 2F < !"#$%&'()*+,-./> 00000030: 30 31 32 33 34 35 36 37 38 39 3A 3B 3C 3D 3E 3F <0123456789:;<=>?> prn:sdsshost:/data/spectro/ > makeRunLog error: ----------------- After the doghouse bias, we got: im> endDrift 2003-02-28 01:14:48Z: stopping drift with: iccExec id1 id2 id3 id4 id5 id6 ad1 ad2 ad3 ad4 readoutEnd 2003-02-28 01:15:16Z: closed shutters 2003-02-28 01:15:16Z: endData completed Flavor of this run (science, bias, calibration, engineering, ignore, help) [bias]: ignore Stripe, Strip (e.g, 22,N or SS,N) [100,O]: Mountain estimate of the overall data quality (unknown, bad, acceptable, good) [unknown]: leap seconds = 32 Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 3688 01:02Z 01:15Z 100 O -117.80 -114.52 36 ignore Doing a cameraDetach spawning makeRunLog im> pgxwin_server: Another server is already active. filling out runlog /astrolog/52698/runlog-3688.txt for run 3688. makeRunLog failed for run 3688. I have the following diagnostics plus check the murmur log and your screen history: ipVectorGetFromRegion: row/col out of range im> sp2 shutter problem: -------------------- sp1> goStare 0 -init -bias PlateId [-9999]: Flushing charge for 15 sec creating BEGIN 2003-02-28 01:49:31Z: Original command was !S! 2003-02-28 01:49:31Z: expected reply was !S OK ! 2003-02-28 01:49:35Z: Original command was !A0! 2003-02-28 01:49:35Z: expected reply was !A0 OK ! appending END EXPOSURE TIME is: 0 1046396965 1046396975 Seq 19500 Exp 19500 Frame 19500 Do not schedule startFlushCharge sp1 200 Do not schedule startFlushCharge sp2 200 A subsequent "mechSend s" on sp2 showed both the shutter_open and shutter_closed sensors as "Off".