APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Thursday December 31, 2009 (MJD 55197) ---=== OBSERVING TEAM ===--- Steph Snedden Audrey Simmons Kaike Pan (afternoon) Craig Loomis (support) French Leger (support) Wendell Jordan (support) ---=== OBSERVING PLAN ===--- MARVELS Science! ---=== OBSERVING SUMMARY ===--- Happy New Year! We lost the first hour of the night due to high humidity. We lost another hour due to a gcamera actor communication problem (please see log and problem section for details). We observed the following MARVELS plates: Cart 1, plate 3629A Cart 1, plate 3629B (broken fiber corresponding with spectra 105,106) Cart 3, plate 3219B (broken fiber 93,94 and 119,120) Cart 8, plate 3089B (broken fiber 3,4) Cart 4, plate 3707B Cart 7, plate 3704A Cart 5, plate 3714A Cart 5, plate 3714B The altitude brake engaged during a slew to the last field, and would not release. French narrowed down the problem to a broken altitude power relay (?) (one of the four white boxes within the wind baffle control panel). French and Wendell were contacted and both are currently on their way to the site. At the moment, the telescope is at 121,82,0 outside of the enclosure. Please see log for details. The the bottom part of the right door to the lindy cart shed is broken and needs attention. Apologies. I accidentally dropped one of the MARVELS cartridge plugs into the confined space area, next to the cone fan. It belongs to cartridge 1. ---=== OBSERVING LOG ===--- Afternoon: ---------- Cleared snow in 2.5 apron area. All actors and systems were checked. A Boss bias and a dark were taken, but they are not reduced by SoS3 in 40 min. Audrey checked and found that some frames taken last night are not reduced yet. We tried to restarted SoS3, and now SOS is in the process of reducing the frames from yesterday and today. 23:00Z MARVELS ThArc lamps on. 23:00Z started ventilation. Night: ----- 00:01Z - Mounted cart 6, MARVELS plate 3513B. 01:03Z - High humidity. We stopped ventilating. We remounted cart 16 for tests. 01:46Z - Humidity dropped. Began venilating. Mounted cart 9, MARVELS plate 3706B. Opened enclosure. 01:56Z - Began marvels cals. T01:56:01.980.fits[0] 11.000000 44670.273438 T01:58:09.610.fits[0] 160.000000 271.631256 T02:02:46.260.fits[0] 11.000000 43878.453125 02:09Z - goToField. 02:15Z - The uppermost FF lamp on the laptop side is out - error: 02:09:27 APO.snedden.sop 423 mcp ! controlLamps 02:09:27 APO.snedden 13 sop w text="Failed to turn FF lamps on" 02:10:33 APO.snedden 13 sop f text="Failed to close screens, warm up lamps, and slew to field" We tried to issue commands with gcamera but the actor wasn't responding. We tried restarting the gcamera actor (see problem section for details), but reset it under observer@hub25m instead of sdss3@hub25m. Oops. 03:03Z - Wanted to see if operating with 3 FF lamps could be sufficient for running MARVELS. Took a few guider flats with greater exposure times, and we think that it will be ok. 03:08Z - Calibrations. T03:08:53.950.fits[0] 11.000000 39610.816406 T03:11:02.620.fits[0] 160.000000 251.824997 T03:15:40.440.fits[0] 11.000000 41965.816406 03:22Z - Mounted cart 1, MARVELS plate 3629A, HD9407. GSFOGTF. 03:34Z - Began 50 min exposure. Seeing 1.7" T03:34:51.730.fits[0] 3000.000000 45.320000 No broken fibers. At 04:40Z, we just noticed that on the MARVELS planning page, it says that this field needed 2x25min exposures. We are very sorry we missed this! 04:26Z - Calibrations. T04:26:47.750.fits[0] 11.000000 41994.089844 T04:28:56.440.fits[0] 160.000000 251.306244 T04:33:32.020.fits[0] 11.000000 41198.816406 04:29Z - goToField plate 3629B, HD17092. Used large offset +0.006 in dec to find stars. The red x's were covering the wrong fibers. 04:59Z - 50 min exposure. Seeing 1.5" - 2.3". Fiber 4 is broken and needed to be disabled. There might be a little scale issue since we are only guiding on 4 guide stars. T04:59:28.080.fits[0] 3000.000000 22.090334 Broken fiber corresponding with spectra 105,106. 05:51Z - Calibrations. T05:51:59.910.fits[0] 11.000000 38319.453125 T05:54:08.670.fits[0] 160.000000 246.806244 T05:58:43.160.fits[0] 11.000000 41417.183594 06:05Z - Mounted cart 3, MARVELS plate 3219A, HD17156. Used 0.002 offset in dec to find field. 06:08Z - 50 min exposure. Seeing 3.2" T06:07:53.490.fits[0] 3000.000000 21.431334 Broken fibers - 93,94 and 105,106 06:59 - Calibrations. T06:59:46.960.fits[0] 11.000000 39835.089844 T07:01:53.530.fits[0] 160.000000 247.943756 T07:06:29.190.fits[0] 11.000000 38989.363281 07:10Z - Mounted cart 8, MARVELS plate 3089B, XO-2. Used 0.002 offset in dec to find stars. 07:16Z - 50 min exposure. Seeing 2.5" T07:16:34.890.fits[0] 3000.000000 23.954334 Broken fiber - 3,4 08:08Z - Calibrations. T08:08:22.750.fits[0] 11.000000 42028.910156 T08:10:30.490.fits[0] 160.000000 251.343750 T08:15:08.290.fits[0] 11.000000 40298.910156 08:10Z - Mounted cart 4, MARVELS plate 3707B, GL273. Offset the telescope by 0.002 in dec to find stars. 08:24Z - 50 min exposure. Seeing 2.2". There was no star in fiber 10. T08:24:43.590.fits[0] 3000.000000 28.742332 No broken fibers. 09:16Z - Calibrations. T09:16:29.050.fits[0] 11.000000 38960.636719 T09:18:35.490.fits[0] 160.000000 255.056244 T09:23:11.010.fits[0] 11.000000 39452.273438 09:17Z - Mounted cart 7, MARVELS plate 3704A, HD88133. Offset 0.002 in dec. 09:30Z - 50 min exposure. Seeing 1.7" T09:30:31.250.fits[0] 3000.000000 29.511333 No broken fibers. 10:22Z - Calibrations. T10:22:17.200.fits[0] 11.000000 39942.453125 T10:24:23.660.fits[0] 160.000000 252.975006 T10:28:59.230.fits[0] 11.000000 40148.816406 10:23Z - Mounted cart 5, MARVELS plate 3714A, 47UMA. Used offsets to find field, -0.003 in RA. 10:41Z - 50 min exposure. Seeing 2.5" T10:40:54.910.fits[0] 3000.000000 22.141333 No broken fibers. 11:33Z - Calibrations. T11:33:10.680.fits[0] 11.000000 39095.000000 T11:35:18.250.fits[0] 160.000000 249.687500 T11:39:54.970.fits[0] 11.000000 42018.546875 11:35Z - After the gang connector was placed in the floor, the telescope slewed to the next field but the altitude brake came on mid-slew at 82 degrees. We attempted to clear the brake several times with no luck. We checked all interlocks, and verifed that there were no axis slips. We noticed that there was a very large error corresponding with the altitude in the MCP window, suggesting a problem with the wind baffle. There was a strong burning smell that came from inside the wind baffle control panel when we checked it. Note that the azimuth and rotator axes moved without any problem. We contacted French and he guided us through the procedure to manually override the wind baffle axes with the pendant to bring the telescope down, but the telescope did not budge. There was no sound coming from the wind baffle when the e-stop button on the pendant was released. The hand pendant worked with the override on the azimuth axis, but not the altitude. French narrowed down the problem to a broken altitude power relay (?) (one of the four white boxes within the wind baffle control panel). It read 'OU' while the others read 'id 0' (or something like that). French was on his way to the site, and so was Wendell. 13:00Z - Steph hooked up the spectro fill line extenders. 13:12Z - endNight finished. The the bottom part of the right door to the lindy cart shed is broken and needs attention. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): QA Procedures Done (y/n): UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 03:35Z 1 0 193.91 0.0003 51.27 0.0002 34.30 0.0000 0.999970 04:56Z 1 0 222.00 0.0003 63.72 0.0002 60.42 0.0000 1.000090 06:09Z 3 0 197.94 0.0003 44.60 0.0002 56.05 0.0000 0.999860 07:17Z 8 0 154.94 0.0003 70.19 0.0002 -33.66 0.0000 0.999810 08:27Z 4 0 -20.52 0.0003 60.86 0.0002 162.83 0.0000 0.999910 09:31Z 7 0 45.48 0.0003 70.24 0.0002 219.11 0.0000 1.000010 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 03:35Z 1 0 0.99997 296 1782 360 194 51.3 -6.8 6 260 - 1.7 04:56Z 1 0 1.00009 -889 907 500 222 63.7 -6.5 6 359 - 2.0 06:09Z 3 0 0.99986 1381 2843 500 198 44.6 -4.7 10 360 - 3.2 07:17Z 8 0 0.99981 1875 3134 450 155 70.2 -4.2 12 346 - 2.5 08:27Z 4 0 0.99991 889 2236 350 -20 60.9 -2.8 8 332 - 2.2 09:31Z 7 0 1.00001 -99 1299 250 45 70.3 -1.4 13 356 - 1.7 ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 21:58Z 26 15 5 306 (NW) 0 - 22:29Z 26 15 7 278 (W) 0 - 23:01Z 25 15 3 260 (W) 0 - 23:33Z 22 14 2 277 (W) 0 - 00:25Z 19 14 4 33 (NNE) 0 - 00:57Z 19 15 8 343 (NNW) 0 - 01:30Z 20 12 3 256 (WSW) 0 - 02:02Z 18 10 2 248 (WSW) 0 - 02:34Z 21 9 3 249 (WSW) 0 - 03:06Z 21 8 5 239 (WSW) 0 - 03:38Z 19 8 2 250 (WSW) 0 - 04:10Z 20 8 5 316 (NW) 0 - 04:42Z 20 8 8 322 (NW) 0 - 05:15Z 20 1 3 310 (NW) 0 - 05:47Z 20 -6 9 26 (NNE) 0 - 06:19Z 23 -9 11 15 (NNE) 0 - 06:51Z 24 -9 11 340 (NNW) 0 - 07:23Z 25 -8 9 350 (NNW) 0 - 07:55Z 24 -8 10 357 (NNW) 0 - 08:27Z 26 -15 7 331 (NNW) 0 - 09:00Z 27 -14 8 334 (NNW) 0 - 09:32Z 29 -16 12 355 (NNW) 0 - 10:04Z 29 -17 7 307 (NW) 0 - 10:36Z 31 -15 15 352 (NNW) 0 - 11:08Z 29 -16 11 345 (NNW) 0 - 11:40Z 30 -15 7 15 (NNE) 0 - 12:12Z 33 -14 7 356 (NNW) 0 - 12:45Z 33 -13 11 356 (NNW) 0 - 13:17Z 32 -14 7 357 (NNW) 0 - ---=== TELESCOPE STATUS ===--- 23:00Z - Began ventilation. Doors and louvers opened, fans on. 01:03Z - Stopped ventilating. High humidity. 01:46Z - Began ventilating. Opened enclosure. ? - Enclosure is on, doors and louvers are closed, and fans are off. Status at: 13:13Z Telescope stowed at: 30,121,00 mount Instrument mounted: Cartridge 5 Counterweights at: 250 lbs LN2 autofill systems: Connected and turned on. 180L LN2 dewar scales: Spectro 164.10 lbs, 18.69 psi Imager lbs, psi (IMAGER IS WARM) ---=== SOFTWARE USED ===--- IOP/SOP: v4_40_0 Watcher: v2_36_0 MCP: v6_6_1 TPM: tpm_v3_5_0 AstroDa: v15_13_1 TCC: TCC 2.11.0 2009-06-24 sdssProcedures: SoS: plate-mapper: ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A -0.7000 -0.6940 Axial B -0.0220 -0.0410 Axial C -0.3770 -0.3710 Trans D 11.6120 11.6170 Lateral E 10.3759 10.3505 Lateral F 11.9507 11.9253 GALILS Commanded: 9900. 400. 5850. 1200. 2950. 2750. Actual: 9917. 401. 5832. 1205. 2954. 2757. SETMIR VALUES PriDesOrient: 0.00 -3.30 5.10 278.08 178.06 PriOrient: 0.00 -3.04 5.26 277.70 178.07 SECONDARY: ---------- Focus: 0.00 Air Temp.: -4.7 Alt.: 29.999989 MIGS TONIGHT NOMINAL Axial A 18.6190 18.6150 Axial B 15.6260 15.6120 Axial C 13.8250 13.8170 Trans D -11.7750 -11.7780 GALILS Commanded: 1597564. 1566225. 1588178. -7600. -12400. Actual: 1597721. 1566188. 1588095. -7597. -12380. SETMIR VALUES SecDesOrient: 1257.00 -4.00 -9.00 10.00 234.42 SecOrient: 1256.99 -4.04 -8.93 10.23 234.72 ---=== PROBLEMS IN DETAIL ===--- We tried to take a guider flat anyway with the command 'gcamera flat time=0.5 cartridge=9' and got this error: 02:18:36 APO.snedden 16 guider f text="command failed: KeyError('radec',) at /home/sdss3/products/Linux64/actorcore/v1_11_3/python/actorcore/help.py:87" And again with attempting to take a guider dark: 02:23:29 APO.snedden 30 gcamera f text="command failed: AttributeError("'NoneType' object has no attribute 'startswith'",) at /usr/local/lib/python2.6/posixpath.py:65" Tried restarting the gcamera actor, but it wasn't responding. Then we tried 'hub startNubs gcamera' and got the same error: 02:24:38 APO.snedden 32 gcamera f text="command failed: AttributeError("'NoneType' object has no attribute 'startswith'",) at /usr/local/lib/python2.6/posixpath.py:65" Restarted gcamera actor through stageManager and issued the startNubs command, but then recieved the error message: 02:27:32 APO.snedden 37 hub f NoTarget="the target named gcamera is not connected". Tried again, this time '02:28:33 APO.snedden 39 gcamera f text="command failed: OSError(13, 'Permission denied') at /home/sdss3/products/Linux64/gcameraICC/v1_0_5/python/gcameraICC/Commands/Camer aCmd.py:179"' Looked for the correct verison of gcamera to run and restarted it to v1_0_5. 'hub startNubs' connected it, but when we give a command, the same error comes back: 02:34:24 APO.snedden 45 gcamera f text="command failed: OSError(13, 'Permission denied') at /home/sdss3/products/Linux64/gcameraICC/v1_0_5/python/gcameraICC/Commands/CameraCmd. py:179" We called Craig and found out the problem was with restarting the actor under observer@hub25m instead of sdss3@hub25m.