APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Friday February 8, 2008 (MJD 54505) ---=== OBSERVING TEAM ===--- Dmitry Bizyaev Dan Oravetz Shannon Watters (afternoon) ---=== OBSERVING PLAN ===--- Science! ---=== OBSERVING SUMMARY ===--- Acquired signal on: cartridge 4, 2946 cartridge 8, 1795 Finished: cartridge 2, 2945 cartridge 5, 2873 cartridge 1, 2661 cartridge 7, 2650 cartridge 6, 2662 logViewer doesn't seem to be working correctly. See log. We had a small problem where the telescope stopped slewing on its way to instChange and we think it's related to the laptop mouse entering gibberish into the TCC because the phone bumped into the mouse when the black cloth was being untucked from underneath the phone. See log. 12:42Z - scaleChange timed out. See log for messages. Miscellaneous Watcher errors in Problems Section. ---=== OBSERVING LOG ===--- Afternoon: --------- All systems checked and working. Spectro focus set for -1.5C. 23:55Z Doors opened, fans and blowers on, louvers opened. Night: ----- 00:45Z - Enclosure off. 00:47Z - Sunset. Cartridge 4, 2946, seguefaint182 ******************************** 01:10Z - gotoField. Used an fk5 to acquire the field. There was a relatively large initial percent scale change (0.03) required. 01:38Z - Pre-Calibs. Declared bad. 01:47Z - There are yellow and red xsigma and wsigma values, so we issued 'mechPiston' commands for sp1 and sp2 of +2500 steps each since the spectrographs are still warmer than what the collimation was set for. The 'mechSend s' median temperatures for sp1 and sp2 were 4.6C and 2.9C, respectively. 01:50Z - Pre-Calibs. 02:00Z - 1500-second exposure. Sos warned of whopping fibers in this exposure. Cartridge 2, 2945, seguefaint182 ******************************** 02:31Z - gotoField. Guide stars found on gotoField. 02:36Z - Pre-Calibs. 02:43Z - 1500-second exposure. 03:11Z - 1500-second exposure. 03:39Z - 1500-second exposure. 04:07Z - Mid-Calibs. 04:14Z - 1500-second exposure. 04:41Z - 1500-second exposure. Increased to 1750 seconds. SoS warned of whopping fibers in this exposure. 05:14Z - Post-Calibs. THIS PLATE IS FINISHED. Cartridge 4, 2946, seguefaint182 ******************************** 05:24Z - gotoField. Used an fk5 to acquire the field. 05:36Z - Pre-Calibs. 05:43Z - 900-second exposure. 06:01Z - 900-second exposure. 06:18Z - 900-second exposure. 06:36Z - 900-second exposure. 06:54Z - Post-Calibs. Cartridge 5, 2873, seguefaint170 ******************************** 07:03Z - gotoField. Used an fk5 to acquire the field. 07:13Z - Pre-Calibs. 07:20Z - 1500-second exposure. THIS PLATE IS FINISHED. Cartridge 1, 2661, chuck153 *************************** 07:56Z - gotoField. Guide stars found on gotoField. 08:05Z - Pre-Calibs. 08:12Z - 1200-second exposure. 08:39Z - 1200-second exposure. Increased to 1500 seconds. 09:07Z - 1500-second exposure. Decreased to 1200 seconds. THIS PLATE IS FINISHED. Cartridge 7, 2650, chunk153 *************************** 09:35Z - gotoField. Guide stars found on gotoField. 09:39Z - Pre-Calibs. 09:46Z - 1200-second exposure. 10:09Z - 1200-second exposure. Increased to 1500 seconds. THIS PLATE IS FINISHED. 10:45Z - We had a small problem during the telescope's slew to 'instChange.' I had already engaged the altitude locking pin and the telescope was still slewing in the azimuth and rotator axes. I was untucking the black cloth from underneath the phone at the laptop and the phone slid into the mouse and the mouse (double or even triple?) clicked as I was untucking and the telescope subsequently stopped slewing. I tried to use the up-arrow in the TCC window and see what was entered and then tried to issue 'axis init,' but I could not type anything in the TCC session. I called to the control room and Dmitry issued many 'axis init' and 'axis stop' commands, but as soon as the breaks were released, they re-engaged. The TCCMon was reporting that the SlewType was "Slew Superceeded." The interlocks for altitude, azimuth, and rotator were also red in the interlocks window. We disengaged the altitude locking pin, tried 'axis stop' and 'axis init' again, but all three were red in the interlocks window again (no stop buttons were engaged when we were checking out the interlocks). The motor permissions (up/down for altitude and clockwise/counterclockwise for rotator and azimuth) were red. We tried re-issuing 'axis init' and then the breaks cleared and were fine. We went to 'instChange' and everything proceeded normally. In the TCC session at the laptop, before I issued 'axis init' and handed it off to Dmitry for the next cartridge, I tried the up-arrow to see what was there and, forgive me for not remembering, there was a long line that started with something about "Rotator Status" or "Rotator Offset" and ended with "; RotID = 1, 0"? Please note that I am always careful to move the cursor below the TCC xterm session and onto just blank desktop. This makes this whole occurrence even more suspicious. This Watcher error was around the time things began having problems: TCC -> Facil="COPY":VMSMsg:"NOMSG" (2008-02-09 10:42:54Z) I came back and checked the murmur logs to see what might have been entered, but the events for the time around 10:45Z had already gone through, so I opened a logViewer to try and see if I could find any indication of what might have happened in there, and the logViewer also exhibited problems. The logViewer opened fine, but I had no control over anything. I could not click on anything within logViewer, except the left-right scrollbar, I could not quit with the 'quit' button, or by trying to 'X' the window closed, and I also lost control of the log. The IOP session that I opened logViewer from was frozen as well. Dmitry experienced this problem last night as well. So, make sure the log is saved before trying to open logViewer. After we regained control of the telescope, the rotator and azimuth axes needed fiducial corrections manually applied. This worked fine and we had guide stars in the guide fibers of cartridge 6. Cartridge 6, 2662, chunk153 *************************** 11:12Z - gotoField. Guide stars found on gotoField. 11:24Z - 1200-second exposure. 11:45Z - When I took focus and offsets, the plate ID was not recognized and '0' was put in place of the actual plate number '2662.' For example, this is what the focus line looked like "11:46Z 6 0 1.00007 -691 651 100 -60 75.1 -0.5 12 9" I corrected the plate number in the Focus and Offsets section, but wanted to mention this strange occurrence. 11:46Z - 1200-second exposure. 12:09Z - 600-second exposure. SoS recommended Post-calibs, but it was too late because we were already in the process of changing cartridges. THIS PLATE IS FINISHED. Cartridge 8, 1795, chunk94 ************************** 12:27Z - gotoField. Guide stars found on gotoField. 12:30Z - Pre-Calibs. 12:37Z - 600-second exposure. 12:42Z - "scaleChange timed out after 40 seconds waiting for scaleChange to complete. Check scale on TCC; it should be 1.000030." We tried again and then got "scaleChange complete with new scale=0.999990." 13:00Z - Enclosure on. Doors and louvers closed, fans off. 13:05Z - endNight rejoiced. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 7318 23:16Z 23:24Z 100 O -163.25 -161.23 28 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): y QA Procedures Done (y/n): y UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 49730, plate -9999 ------- 23:17 49730 0.0 bias ----- sequence 49731, plate 2650 ------- 23:21 49731 10.0 flat 23:24 49732 2.0 arc 23:29 49733 3.0 arc 23:31 49734 3.0 arc ----- sequence 49735, plate -9999 ------- 23:54 49735 0.0 bias 00:12 49736 0.0 bias ----- sequence 49737, plate 2946 ------- see below 01:40 49737 10.0 flat bad 01:43 49738 2.0 arc bad 01:53 49739 10.0 flat 01:55 49740 2.0 arc 02:27 49741 1501.0 target 13.4 4.6 13.9 7.3 ----- sequence 49742, plate 2945 ------- 88.1 53.1 105.7 73.3 02:39 49742 10.0 flat 02:41 49743 2.0 arc 03:10 49744 1500.0 target 10.2 5.3 12.5 8.1 03:38 49745 1500.0 target 11.8 6.0 14.5 9.9 04:06 49746 1500.0 target 12.7 7.5 16.0 9.8 04:09 49747 10.0 flat 04:12 49748 2.0 arc 04:41 49749 1501.0 target 12.6 6.9 16.3 10.0 05:13 49750 1751.0 target 16.1 10.1 19.2 11.9 05:16 49751 10.0 flat 05:19 49752 2.0 arc ----- sequence 49753, plate 2946 ------- 43.7 22.7 47.0 35.2 05:38 49753 10.0 flat 05:41 49754 2.0 arc 06:00 49755 901.0 target 7.7 4.4 8.4 7.0 06:18 49756 901.0 target 7.7 4.6 8.3 7.0 06:36 49757 900.0 target 7.2 4.5 8.0 6.9 06:53 49758 900.0 target 7.2 4.7 8.4 7.1 06:56 49759 10.0 flat 06:59 49760 2.0 arc ----- sequence 49761, plate 2873 ------- 73.2 53.5 77.5 54.0 07:15 49761 10.0 flat 07:18 49762 2.0 arc 07:47 49763 1501.0 target 8.1 6.8 8.8 7.1 ----- sequence 49764, plate 2661 ------- 25.0 17.2 25.7 19.2 08:08 49764 10.0 flat 08:10 49765 2.0 arc 08:34 49766 1201.0 target 6.3 4.4 6.3 5.3 09:06 49767 1502.0 target 9.9 6.8 10.1 7.4 09:29 49768 1202.0 target 8.8 6.0 9.2 6.5 ----- sequence 49769, plate 2650 ------- 20.5 14.3 25.0 16.2 09:42 49769 10.0 flat 09:44 49770 2.0 arc 10:08 49771 1200.0 target 7.4 6.0 8.5 6.0 10:23 49772 1502.0 target 10.4 6.2 12.7 7.9 ----- sequence 49773, plate 2662 ------- 24.3 17.3 27.3 19.8 11:18 49773 10.0 flat 11:22 49774 2.0 arc 11:46 49775 1200.0 target 9.6 6.5 10.9 7.6 12:09 49776 1201.0 target 10.1 7.4 11.7 8.6 12:22 49777 601.0 target 4.2 3.5 4.7 3.6 ----- sequence 49778, plate 1795 ------- 2.5 2.0 2.2 2.0 12:33 49778 10.0 flat 12:35 49779 2.0 arc 12:49 49780 600.0 target 2.5 2.0 2.2 2.0 ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 02:01Z 4 2946 111.05 0.0035 50.61 0.0015 -97.95 0.0249 1.000300 02:44Z 2 2945 71.19 0.0015 42.35 0.0022 233.81 0.0339 1.000230 05:45Z 4 2946 230.94 0.0075 81.91 -0.0016 55.55 0.0353 1.000110 07:22Z 5 2873 162.16 0.0033 51.88 -0.0008 -41.04 -0.0063 0.999910 08:41Z 1 2661 80.82 0.0048 62.83 0.0007 246.15 0.0265 1.000180 11:44Z 6 2660 -58.65 -0.0010 75.48 0.0003 127.87 0.0422 1.000070 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 02:01Z 4 2946 1.00030 -2963 -1123 150 111 50.6 1.2 12 324 ---- 1.4" 02:44Z 2 2945 1.00023 -2271 -522 150 71 42.3 1.8 13 323 ---- 1.5" 05:45Z 4 2946 1.00011 -1086 318 100 231 82.0 0.8 8 348 ---- 1.3" 07:22Z 5 2873 0.99991 889 2011 100 162 51.9 0.6 18 13 ---- 1.9" 08:41Z 1 2661 1.00018 -1778 -325 0 81 62.8 1.4 13 322 ---- 1.6" 11:44Z 6 2662 1.00007 -691 651 100 -59 75.5 -0.6 15 353 ---- 1.5" ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 23:02Z 36 4 5 12 (NNE) 279 - clear 23:32Z 36 4 14 335 (NNW) 438 - clear 00:03Z 35 5 14 327 (NNW) 345 - clear 01:31Z 34 5 10 352 (NNW) 347 - clear 02:05Z 34 5 14 319 (NW) 241 - clear 02:36Z 35 4 10 327 (NNW) 240 - clear 03:08Z 34 4 4 3 (N) 194 - clear 03:39Z 34 3 12 353 (NNW) 184 - clear 04:09Z 33 3 11 12 (NNE) 129 - clear 04:41Z 33 3 11 358 (NNW) 269 - clear 05:14Z 32 4 13 1 (N) 293 - clear 05:45Z 33 2 12 340 (NNW) 304 - clear 06:17Z 34 0 15 334 (NNW) 288 - clear 06:47Z 34 0 2 15 (NNE) 291 - clear 07:17Z 32 0 8 3 (N) 289 - clear 07:47Z 34 -1 18 316 (NW) 325 - clear 08:18Z 35 -3 23 334 (NNW) 302 - clear 08:50Z 34 -2 11 355 (NNW) 267 - clear 09:22Z 33 -1 10 35 (NE) 296 - clear 09:53Z 32 0 15 4 (N) 267 - clear 11:46Z 31 1 13 330 (NNW) 181 - clear 12:16Z 32 2 15 37 (NE) 134 - clear 12:48Z 32 3 19 18 (NNE) 112 - clear ---=== TELESCOPE STATUS ===--- 23:55Z Doors opened, fans and blowers on, louvers opened. 00:45Z - Enclosure off. 13:00Z - Enclosure on, doors and louvers closed, fans off. No interlocks bypassed. Status at: 13:06Z Telescope stowed at: 30,121,00 mount Instrument mounted: Cartridge 8 Counterweights at: 270 lbs LN2 autofill systems: Connected and turned on. 180L LN2 dewar scales: Spectro 134.60 lbs, 21.05 psi Imager 87.00 lbs, 14.74 psi ---=== SOFTWARE USED ===--- IOP/SOP: v4_38_0 Watcher: v2_36_0 MCP: v6_4_0 TPM: tpm_v3_5_0 AstroDa: v15_13_1 TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: v2_38 SoS: v5_1_8 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A -5.2150 -5.2160 Axial B -0.2142 -0.2142 Axial C -0.0015 -0.0016 Trans D 11.8320 11.8540 Lateral E 10.0584 10.0584 Lateral F 11.6459 11.6586 GALILS Commanded: 4600. -2000. 2650. -12450. -6500. -6550. Actual: 4600. -2000. 2650. -12439. -6477. -6546. SETMIR VALUES PriDesOrient: 0.00 0.00 0.00 100.00 -200.00 PriOrient: 0.00 0.00 0.00 99.59 -200.69 SECONDARY: ---------- Focus: 0.00 Air Temp.: 2.8 Alt.: 30.001019 MIGS TONIGHT NOMINAL Axial A 0.8028 0.8025 Axial B 0.6126 0.6120 Axial C 0.5475 0.5474 Trans D 0.6167 0.6008 GALILS Commanded: 1627365. 1653142. 1470862. -5900. -7800. Actual: 1627496. 1653168. 1470885. -5887. -7780. SETMIR VALUES SecDesOrient: 1257.00 60.00 -4.00 -20.00 118.90 SecOrient: 1256.95 59.99 -3.97 -19.89 119.29 ---=== PROBLEMS IN DETAIL ===--- Spectro Focus (using cart 7): ---------------------------- caget tpm_TM_PMSSAvg tpm_TM_TelairAvg.VALA tpm_TM_PMSSAvg 3.01714 tpm_TM_TelairAvg.VALA 4.4675 sp1: Coll_motor_A -3755 01P-0000003755 Coll_motor_B -4031 02P-0000004031 Coll_motor_C -4169 01P-0000004169 Temp_Median 6.4 Temp_Hartmann_Top 5.9 (0xFF07) Temp_Red_Cam_Bot 6.5 (0xFEF1) Temp_Red_Cam_Top 6.7 (0xFEE8) Temp_Blue_Cam_Bot 6.9 (0xFEE1) Temp_Blue_Cam_Top 6.4 (0xFEF3) sp2: Coll_motor_A 7473 01P0000007473 Coll_motor_B 6810 02P0000006810 Coll_motor_C 6851 01P0000006851 Temp_Median 4.4 Temp_Hartmann_Top 4.9 (0xFF34) Temp_Red_Cam_Bot 5.2 (0xFF28) Temp_Red_Cam_Top 4.2 (0xFF50) Temp_Blue_Cam_Bot 4.6 (0xFF40) Temp_Blue_Cam_Top 4.4 (0xFF48) IDL 5.5a> collimate, 49733 Reading /data/spectro/54505/sdR-b1-00049733.fit Reading /data/spectro/54505/sdR-b1-00049734.fit COLLIMATE: Min offset = -0.39 pix COLLIMATE: Max offset = 1.50 pix COLLIMATE: RMS across CCD = 0.46 pix COLLIMATE: Mean offset = 0.58 pix COLLIMATE: Camera b1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -20.9 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-54505-b1-00049733.log PostScript file = Collimate-54505-b1-00049733.ps Reading /data/spectro/54505/sdR-b2-00049733.fit Reading /data/spectro/54505/sdR-b2-00049734.fit COLLIMATE: Min offset = 0.07 pix COLLIMATE: Max offset = 0.64 pix COLLIMATE: RMS across CCD = 0.13 pix COLLIMATE: Mean offset = 0.44 pix COLLIMATE: Camera b2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -15.7 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-54505-b2-00049733.log PostScript file = Collimate-54505-b2-00049733.ps Reading /data/spectro/54505/sdR-r1-00049733.fit Reading /data/spectro/54505/sdR-r1-00049734.fit COLLIMATE: Min offset = -1.14 pix COLLIMATE: Max offset = -0.32 pix COLLIMATE: RMS across CCD = 0.23 pix COLLIMATE: Mean offset = -0.83 pix COLLIMATE: Camera r1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of 7565 steps for spectro-1 COLLIMATE: Issue SOP command: "sp1; mechPiston 7565" Log file = Collimate-54505-r1-00049733.log PostScript file = Collimate-54505-r1-00049733.ps Reading /data/spectro/54505/sdR-r2-00049733.fit Reading /data/spectro/54505/sdR-r2-00049734.fit COLLIMATE: Min offset = -1.21 pix COLLIMATE: Max offset = -0.16 pix COLLIMATE: RMS across CCD = 0.28 pix COLLIMATE: Mean offset = -0.58 pix COLLIMATE: Camera r2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of 5290 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston 5290" Log file = Collimate-54505-r2-00049733.log PostScript file = Collimate-54505-r2-00049733.ps cart 7 offsets are -350 and -700 ==> Focus set for -1.5 C ---------------------------------------------------------------------- IDL 5.5a> apo_plotbias, 49736 Filename 02% 05% 10% 50% 90% 95% 98% ------------------- ------ ------ ------ ------ ------ ------ ------ sdR-b1-00049736.fit -5.5 -4.4 -2.6 2.2 6.8 8.8 10.0 sdR-b2-00049736.fit -7.8 -6.3 -5.0 1.1 7.4 9.7 11.1 sdR-r1-00049736.fit -7.2 -5.2 -4.2 1.6 6.8 8.1 10.3 sdR-r2-00049736.fit -7.9 -5.8 -4.7 0.5 5.8 7.9 9.9 ---------------------------------------------------------------------- Mechanical Systems: not connected (1:) Axes: AxisNoSlew:rot (axis cannot slew: 2008-02-09 11:08:57Z) AxisNoSlew:az (axis cannot slew: 2008-02-09 11:08:02Z) AxisStat:alt (out_closed_loop amp_bad: 2008-02-09 12:50:51Z) AxisStat:az (semCmdPort_taken: 2008-02-09 12:50:51Z) AxisNoSlew:alt (axis cannot slew: 2008-02-09 11:08:02Z) AxisStat:rot (semCmdPort_taken: 2008-02-09 12:50:51Z) TCC: Modu="tut AdjVAXClock" (2008-02-09 02:00:45Z) Text="failed to move one or more axes":AxisNoTrack:"TTT" (2008-02-09 11:02:27Z) Text="Could not queue a write to user:message output dies": (2008-02-09 05:23:46Z) Facil="SYSTEM":VMSMsg:"DEVOFFLINE" (2008-02-09 05:23:46Z) Text="pointing error probe does not exist:check inst data": (2008-02-09 01:13:44Z) DeadProc:T AUTOLOUVER (2008-02-09 00:48:54Z) Modu="prt Read" (2008-02-09 10:52:45Z) Facil="SYSTEM":VMSMsg:"HANGUP" (2008-02-09 05:23:46Z) Modu="axe i SchMove" (2008-02-09 11:02:45Z) Modu="axe o Init" (2008-02-09 11:02:45Z) DeadProc="T AUTOLOUVER":: (2008-02-09 00:49:03Z) Text="Write to user failed:output terminates to user8": (2008-02-09 05:23:46Z) Modu="prt ReadMatch" (2008-02-09 10:52:45Z) Facil="COPY":VMSMsg:"NOMSG" (2008-02-09 10:42:54Z)