APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Wednesday December 30, 2009 (MJD 55196) ---=== OBSERVING TEAM ===--- Audrey Simmons Steph Snedden Kaike Pan (afternoon) Robert Lupton (PU) - MCP-ing ---=== OBSERVING PLAN ===--- Flex Engineering and MARVELS Science! ---=== OBSERVING SUMMARY ===--- More icicles discovered on the power rails, but not where the plastic shield is located. They would prevent opening, we think. French was informed. Our "partly cloudy" forecast turned into a couple of inches of new snow. Robert worked on a new MCP version, but more work is needed and no new version is tagged yet. We took another dithered flat sequence for Kyle with tilt steps of 310 actuator counts and 20 second exposure times. We only took three exposures at each step, and can add more on another cloudy night if desired. There were several actuator mirror motion faults, detailed in the log body. The spectro dewar has one fill left and will need changing later in the day. ---=== OBSERVING LOG ===--- Afternoon: ---------- Clearing snow from walks and 2.5m around. Robert is working on mcp that prevents us from moving telescope and take BOSS bias and dark. So fiducial crossing check and getting mirror number is hold off. New plugged plate, 3219 on cartridge 3, is not in the plate DB. It had to be made active. For some reason, cartridge 3 needs to be made active every day. Ticket #468 is updated. Night: ------ 00:13Z - Humid and cloudy. Some blowing snow. Robert continued to work on a new mcp during the early evening, but we still have to give him some on-sky testing time. 00:200 - A steady light snow. 00:30Z - Checked fiducial crossings and took mirror numbers. We all walked down to look at the power rails. Unfortuantely, there are a few new icicles on the power rails in places that are not covered with the plastic shield. I really wonder if the rail heater is working properly. 04:29Z - Rolled back to mcp v6_6_1 for dithered flat tests for Kyle, although in truth we probably didn't need to roll back. Needed a "hub startNubs mcp" and an "mcp info" to get synchronized. Here are the frames for the dithered flats. In this case, each shift in tilt was 310 actuator units (5 pix), as requested by Kyle. We only took three 20 second exposures at each position. If more are needed, we can do another sequence on the next cloudy night. At the end, arcs were taken at the endpoints and middle of the tilt range. Original in-focus positions: sp1: a=10588, b=11236, c=11062 sp2: a=18217, b=17963, c=18046 The collimator motor positions are in the fits headers, so are not recorded here. tilt sequence frames ------------- ------ 1 105798 - 105800 2 105801 - 105803 3 105804 - 105806 4 105807 - 105809 5 105810 - 105812 6 105813 - 105815 7 105816 - 105818 8 105819 - 105821 9 105822 - 105824 10 105825 - 105827 11 105828 - 105830 12 105831 - 105833 13 105834 - 105836 14 105837 - 105839 15 105840 - 105842 16 105843 - 105845 17 105846 - 105848 18 105849 - 105851 19 105852 - 105854 20 105855 - 105857 21 105858 - 105860 22 105861 - 105863 23 105864 - 105866 Arc at upper end of tilt range (+3410 steps) 24 105867 Arc at nominal position 25 105868 Arc at lower end of tilt range (-3410 steps) 26 105869 We had some actuator mirror related errors. The notes follow: ---------- 05:11Z - got a "value for motor c position was bad: NaN" error in the STUI log, although the move did complete successfully. There was very little time delay between the move command and the error. We started out using sop doCalibs for the dithered flats, specifying three flats, but after the first exposure we kept getting this message: 5:17:21 APO.asimmons.sop 403 boss : 05:17:21 .hub 0 cmds d CmdDone=191186 05:17:21 APO.asimmons 57 sop w text="Failed to take flat field" 05:17:21 APO.asimmons 57 sop f I believe this is because sop was trying to change the state of the flat field screens inside the enclosure and couldn't. (?) We wound up just using boss exposure commands to take the flat field exposures. 06:36Z - another "value for motor c" error. Here are the details: 06:36:09 APO.asimmons 101 boss i text="Response parsed." 06:36:09 APO.asimmons 101 boss i text="motors were at {'a': 16977, 'c': 16806, 'b': 16724}" 06:36:09 APO.asimmons 101 boss i text="motors at {'a': 17287, 'c': 17116, 'b': 17034}" 06:36:09 APO.asimmons 101 boss d text="Sending s to sp1mech" 06:36:09 APO.asimmons 101 boss d text="Sending s to sp2mech" 06:36:10 APO.asimmons 101 boss d text="Completed message from sp2mech" 06:36:10 APO.asimmons 101 boss i text="Response parsed." 06:36:10 APO.asimmons 101 boss d text="Noting the status from sp2mech." 06:36:10 APO.asimmons 101 boss d text="Completed message from sp1mech" 06:36:10 APO.asimmons 101 boss w text="value for motor C position was bad: NaN" In between exposures, with NO motor moves at all, we got this error: 07:32:50 APO.asimmons 134 boss w text="value for motor C position was bad: NaN" Then: 7:33:14 APO.asimmons 134 boss i text="Response parsed." 07:33:14 APO.asimmons 134 boss d text="Noting the status from sp2mech." 07:33:14 APO.asimmons 134 boss d text="Completed message from sp1mech" 07:33:14 APO.asimmons 134 boss w text="value for motor A status was bad: NaN" 07:33:14 APO.asimmons 134 boss w text="value for motor B status was bad: NaN" 07:33:14 APO.asimmons 134 boss i text="Response parsed." The following error happened eight seconds after a commanded move, and is likely in specMech. The motor numbers were wrong for c (it didn't move at all), so the move really did fail. On the second attempt, it moved double the requested move. The second move back to the desired position worked: 07:55:03 APO.asimmons 146 boss w text="Failed message from sp1mech, failed: { motor timeout }" 07:55:03 APO.asimmons 146 boss f text="Motor failed to move motor c on sp1mech" The previous error happened again on both sp1 and sp2 during the final arcs: 09:03:54 APO.asimmons 192 boss w text="Failed message from sp1mech, failed: { motor timeout }" 09:03:54 APO.asimmons 192 boss f text="Motor failed to move motor c on sp1mech" 09:03:54 .hub 0 cmds d CmdDone=192092 09:03:54 .boss 1251 boss w text="this command has already been finished!!!! (APO.asimmons 1251): moveColl spec=sp1 a=-1000 b=-1000 c=-1000" 09:03:54 .boss 1251 boss d text="Sending s to sp1mech" 09:03:55 .mcp 0 mcp i aliveAt=1262250235 09:03:55 .boss 1251 boss w text="this command has already been finished!!!! (APO.asimmons 1251): moveColl spec=sp1 a=-1000 b=-1000 c=-1000" 09:03:55 .boss 1251 boss d text="Completed message from sp1mech" 09:03:55 .boss 1251 boss w text="this command has already been finished!!!! (APO.asimmons 1251): moveColl spec=sp1 a=-1000 b=-1000 c=-1000" 09:05:43 APO.asimmons 197 boss w text="Failed message from sp2mech, failed: { motor timeout }" 09:05:43 APO.asimmons 197 boss f text="Motor failed to move motor c on sp2mech" 09:05:43 .hub 0 cmds d CmdDone=192104 09:05:43 .boss 1256 boss w text="this command has already been finished!!!! (APO.asimmons 1256): moveColl spec=sp2 a=-1000 b=-1000 c=-1000" 09:05:43 .boss 1256 boss d text="Sending s to sp2mech" 09:05:44 .boss 1256 boss w text="this command has already been finished!!!! (APO.asimmons 1256): moveColl spec=sp2 a=-1000 b=-1000 c=-1000" 09:05:44 .boss 1256 boss d text="Completed message from sp2mech" 09:05:44 .boss 1256 boss w text="this command has already been finished!!!! (APO.asimmons 1256): moveColl spec=sp2 a=-1000 b=-1000 c=-1000" The double move happened again when the requested move was applied after the timeout. ---------- 10:55Z - Shoveled some snow, but it is still falling. Much more shoveling will have to happen tomorrow. 10:56Z endNight finished. ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): QA Procedures Done (y/n): UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 22:52Z 24 21 17 241 (WSW) 0 - Cloudy 23:24Z 23 21 19 211 (SSW) 0 - ' 23:56Z 23 22 14 240 (WSW) 0 - ' 00:33Z 22 21 19 237 (WSW) 0 - ' 01:05Z 22 21 18 246 (WSW) 0 - '' 01:37Z 22 21 20 248 (WSW) 0 - ' 02:09Z 22 21 13 253 (WSW) 0 - ' 02:41Z 22 21 17 237 (WSW) 0 - ' 03:13Z 23 21 21 246 (WSW) 0 - ' 03:45Z 23 20 22 255 (WSW) 0 - ' 04:18Z 23 20 25 266 (W) 0 - ' 04:50Z 23 21 18 265 (W) 0 - ' 05:22Z 23 20 18 253 (WSW) 0 - '' 05:54Z 23 19 16 262 (W) 0 - ' 06:26Z 23 20 20 266 (W) 0 - ' 06:58Z 23 20 21 267 (W) 0 - ' 07:30Z 23 20 26 266 (W) 0 - ' 08:03Z 22 20 26 267 (W) 1 - ' 08:35Z 22 21 19 267 (W) 0 - ' 09:07Z 22 21 24 270 (W) 0 - ' 09:39Z 21 21 21 270 (W) 0 - ' 10:11Z 21 21 18 271 (W) 0 - ' 10:43Z 21 21 19 275 (W) 0 - ' ---=== TELESCOPE STATUS ===--- Never opened, never ventilated. Telescope is at 30 deg. alt with cartridge 16 mounted; counterweights at 240. Spectro autofill is enabled. No interlocks bypassed. 11:05Z - Spectro dewar: 76 lb; 20 psi ---=== SOFTWARE USED ===--- IOP/SOP: v4_40_0 Watcher: v2_36_0 MCP: (unavailable) TPM: tpm_v3_5_0 AstroDa: v15_13_1 TCC: TCC 2.11.0 2009-06-24 sdssProcedures: SoS: plate-mapper: boss : version="branch_jme-rewrite+svn106210 guider : guiderVersion="v1_0_16" hub : version="Tag: sdss3_v1_1_3" platedb : version="trunk+svn105808" sop : version="v1_0_4" ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A -0.7020 -0.6940 Axial B -0.0240 -0.0410 Axial C -0.3780 -0.3710 Trans D 11.6140 11.6170 Lateral E 10.3759 10.3505 Lateral F 11.9507 11.9253 GALILS Commanded: 9900. 400. 5850. 1200. 2950. 2750. Actual: 9917. 401. 5832. 1205. 2954. 2757. SETMIR VALUES PriDesOrient: 0.00 -3.30 5.10 278.08 178.06 PriOrient: 0.00 -3.04 5.26 277.70 178.07 SECONDARY: ---------- Focus: 0.00 Air Temp.: -5.1 Alt.: 30.000778 MIGS TONIGHT NOMINAL Axial A 18.6180 18.6150 Axial B 15.6240 15.6120 Axial C 13.8230 13.8170 Trans D -11.7750 -11.7780 GALILS Commanded: 1597696. 1566169. 1588115. -7600. -12400. Actual: 1597721. 1566188. 1588095. -7597. -12380. SETMIR VALUES SecDesOrient: 1257.00 -4.00 -9.00 10.00 234.42 SecOrient: 1256.99 -4.01 -9.00 10.19 234.70 ---=== PROBLEMS IN DETAIL ===---