APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Wednesday October 1, 2003 (MJD 52914) ---=== OBSERVING TEAM ===--- Howard Brewington Pete Newman Mike Harvanek (swing) ---=== OBSERVING PLAN ===--- Science! ---=== OBSERVING SUMMARY ===--- We completed five plates, vis., 1030, 1115, 1124, 1498, and 1076. However, we lost some time at the end of the night because the spectro CCDs began to warm. ---=== OBSERVING LOG ===--- Afternoon: __________________________________________________ The afternoon began with critical alerts for the spectro dewars. Opening the spectro 180l dewar valve solved the problem. All the spectro ccd temps were checked and found to be ok. I (MH) tried to send out an email saying that everything was ok but got the following reply: Your mail to 'critical-alerts' with the subject "spectro alarm" is being held until the list moderator can review it for approval. The reason it is being held: Post by non-member to a members-only list. Either the message will get posted to the list, or you will receive notification of the moderator's decision. The first 3 attempts at an imager bias gave the following error: "Can't read "cameraData(lines)": no such element in arra." Logging out the imager port and restarting that iop session solved the problem. An attempt was made at a spectro collimation check but someone turned on the enclosure lights during the check so the exposures were no good. After that, the building was pulled so that French could investigate last night's oscillations and there was not another chance to do a collimation check before dark. French investigated the oscillations that were found last night and got Craig to change the mcp servo parameters in an effort to solve the problem before we get on the sky tonight. Night: _________________________________________________ With a bright moon in the evening sky, we began the night with spectro. And, the Piezo boards are still unplugged as to prevent m2 oscillations. Per French's suggestion, we plan to avoid the AXIS servo oscillations with track commands, which will not move the Alt and Rot at the same time. Because of the AXIS servo oscillations, we will not do any imaging tonight; we do not want to damage the imager. And, we made sure that collimate was enabled as detailed in Russell's e-mail. 01:11Z Cart 02, Plate 1030 (lowz45, required SN^2=30). Field was found with a Fk5 star after we had to forced a fiducial in the Az axis, i.e., "Correction for azimuth -859 is too large." A focus sweep was performed on this plate. For unknown reasons, SOS displayed this plate as "plate 0" (zero). We were able to correct this problem in SOS; however, SDSSHost may still have the wrong ID number for the flat, arc, and first science exposure for this plate. With the SN^2 from last night, this plate was completed in four exposures. 03:40Z Cart 09, Plate 1115 (merged48, required SN^2=18). We had guide stars after goToField. But, as with a couple of large scale changes during setup last night, we lost our guide stars with the needed change in scale of 0.038. We recoverd with a Fk5 after a second goToField did not discover guide stars. Is this problem related to the Piezo boards being unplugged? The lost guide stars increased the setup time for this plate. This plate was completed with four exposures. 05:35Z Cart 07, Plate 1124 (munn49, required SN^2=18). Before mounting this cartridge, French enabled the Piezo boards by attaching the three power cables. We had no m2 oscillations, and we found guide stars by clearing the offsets after reaching the field. Plate completed in three exposures. 06:50Z Cart 05, Plate 1498 (merged73, required SN^2=18). Guide stars found on goToField. And, another focus sweep was performed as part of the setup on this plate. Although we have had to make rather large scale changes on plates since powering-up the Piezo boards, we have not lost the guide stars as with Cart 09 earlier tonight. Plate completed in three exposures. 08:00Z Cart 01, Plate 1076 (merged48, required SN^2=18). Guide stars found with goToField. Two gflats were performed because the first on one looked atypical, i.e., poorly centered with respect to the graphic display. Plate completed in four exposures. 09:40Z Cart 04, Plate 1243 (lowz62, required SN^2=30). Guide stars found with goToField. Although a scale change of 0.031 was needed for this plate, our guide stars were not lost during the process. The efficiency on the guider display is running ~115% on this plate; however, SOS reported a SN^2 of only 3.6 on r2 after a twenty minute exposure. Whereas, b1, b2, and r1 averaged about 12.7 SN^2. We got a report in SOS that the CCDs could be warming; yet, we received no warning from watcher. With a "cc 2 tcheck," we learned that the CCDs was indeed warming, so we stop the exposure and topped off the spectro dewars. We did not top-off the spectro dewars at twilight because we knew that they were filled an hour or so earlier. We've filed a PR about Watcher failing to report this problem. See problems section for additional details. endNight finished, and there was great rejoicing! See problems section for the Watcher Complaints received during the night. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 4162 23:00Z 23:25Z 100 O 64.43 70.75 56 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): y QA Procedures Done (y/n): y UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 22502, plate -9999 ------- 22:42 22502 0.0 bias ----- sequence 22503, plate 1250 ------- 22:50 22503 10.0 flat test 23:00 22504 2.1 arc test - no good 23:03 22505 2.1 arc test - no good 01:46 22506 10.0 flat 01:49 22507 2.0 arc 02:16 22508 1000.1 target ----- sequence 22508, plate 1030 ------- 02:40 22509 1000.1 target 03:00 22510 1000.1 target 03:20 22511 1000.1 target 03:27 22512 240.0 smear 03:30 22513 10.0 flat 03:33 22514 2.0 arc ----- sequence 22515, plate 1115 ------- 03:55 22515 10.0 flat 03:58 22516 2.0 arc 04:19 22517 800.1 target 04:39 22518 1000.1 target 05:00 22519 1000.1 target 05:16 22520 800.1 target 05:27 22521 240.0 smear ----- sequence 22522, plate 1124 ------- 05:44 22522 10.0 flat 05:47 22523 2.0 arc 06:06 22524 900.1 target 06:22 22525 700.1 target 06:37 22526 700.1 target 06:44 22527 240.0 smear ----- sequence 22528, plate 1498 ------- 07:02 22528 10.0 flat 07:05 22529 2.0 arc 07:22 22530 800.1 target 07:39 22531 800.1 target 07:52 22532 600.1 target 07:59 22533 240.0 smear ----- sequence 22534, plate 1076 ------- 08:14 22534 10.0 flat 08:16 22535 2.0 arc 08:33 22536 750.1 target 08:48 22537 750.1 target 09:08 22538 1000.1 target 09:28 22539 1000.1 target 09:35 22540 240.0 smear ----- sequence 22541, plate 1243 ------- 09:53 22541 10.0 flat 09:55 22542 2.0 arc 10:21 22543 1200.1 target 10:44 22544 1200.1 target 11:54 22545 0.0 bias ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 01:36Z spectro 54.50 0.0026 41.94 -0.0011 223.12 0.0235 0.999950 04:07Z spectro -23.08 0.0034 55.03 0.0010 160.67 0.0083 1.000230 05:50Z spectro 28.68 0.0013 53.70 -0.0002 203.71 -0.0113 1.000230 07:08Z spectro 8.39 0.0039 56.92 -0.0010 186.97 -0.0135 1.000020 08:25Z spectro -5.93 0.0049 57.07 0.0011 174.95 -0.0031 1.000180 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL 6820 Stays: JL 6821 ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 01:09Z unknown 1.00000 0 1131 0 70 70.0 13.6 5 191 01:36Z spectro 0.99995 494 1693 75 54 42.0 13.2 6 178 gdr 1.8 04:07Z spectro 1.00023 -2270 -739 -25 -23 55.0 13.1 10 180 gdr 1.3 05:51Z spectro 1.00023 -2270 -735 -25 28 53.8 12.7 9 181 gdr 1.4 07:09Z spectro 1.00002 -198 1017 20 8 56.9 12.3 12 192 gdr 1.4 08:25Z spectro 1.00018 -1778 -291 20 -6 57.1 11.7 11 184 gdr 1.3 ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 22:15Z 71 33 5 240 (WSW) 322 - clear 22:47Z 67 34 7 271 (W) 394 - clear 23:19Z 64 32 7 269 (W) 317 - clear 23:51Z 63 35 6 261 (W) 405 - clear 00:24Z 60 36 3 243 (WSW) 405 - clear 01:21Z 56 38 7 182 (S) 517 - clear 01:53Z 55 39 6 185 (S) 636 - clear 02:25Z 55 39 6 186 (S) 636 - clear 02:58Z 55 40 8 181 (S) 701 - clear 03:28Z 55 40 8 180 (S) 670 - clear 03:58Z 55 39 11 180 (S) 653 - clear 04:31Z 55 38 10 177 (S) 682 - clear 05:03Z 55 39 7 182 (S) 1010 - clear 05:34Z 55 40 9 185 (S) 748 - clear 06:07Z 54 39 5 181 (S) 698 - clear 06:40Z 54 38 9 192 (SSW) 681 - clear 07:12Z 54 37 11 184 (S) 566 - clear 07:43Z 54 34 11 190 (S) 519 - clear 08:17Z 53 36 9 182 (S) 618 - clear 08:49Z 52 37 12 180 (S) 570 - clear 09:21Z 52 36 12 187 (S) 510 - clear 09:54Z 53 35 12 195 (SSW) 509 - clear 10:25Z 52 36 13 183 (S) 505 - clear 10:58Z 51 37 12 185 (S) 518 - clear 11:30Z 50 36 12 213 (SSW) 490 - clear 12:02Z 50 36 9 201 (SSW) 527 - clear ---=== TELESCOPE STATUS ===--- 23:00Z Enclosure off for oscillation investigation. 00:45Z Enclosure doors opened, fans and blowers on, louvers opened. 12:00Z Enclosure on, fans and blower off, louvers closed, LN2 connected and turned on. Imager 159 lb Spectro 216 lb No interlocks bypassed. ---=== SOFTWARE USED ===--- IOP/SOP: v3_119_0 Watcher: v2_24_0 MCP: v5_20_0 TPM: tpm_v2_32_0 AstroDa: v14_47 TCC: 2.7.1 sdssProcedures: v1_74 tccMon: v2_2 SoS: v4_9_13 hoggPT: v1_6_9 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.5470 0.5460 Axial B 0.6300 0.6290 Axial C 1.0930 1.0900 Trans D -8.5730 -8.5750 Lateral E 10.8712 10.9093 Lateral F 10.8458 10.8712 GALILS Commanded: 4600. -2850. 850. -7250. 19000. 18450. Actual: 4600. -2866. 866. -7275. 19011. 18425. SETMIR VALUES PriDesOrient: 0.00 0.00 15.20 829.90 1.60 PriOrient: 0.00 0.00 14.91 830.49 3.19 SECONDARY: ---------- Focus: 0.00 Air Temp.: 18.6 Alt.: 30.018543 MIGS TONIGHT NOMINAL Axial A 1.5130 1.5100 Axial B 1.1040 1.0990 Axial C 1.1080 1.1160 Trans D -0.8280 -0.8210 GALILS Commanded: 1628587. 1548090. 1574377. -3900. -8750. Actual: 1628641. 1548187. 1574504. -3899. -8726. SETMIR VALUES SecDesOrient: 1257.00 0.00 -25.00 0.00 146.27 SecOrient: 1256.93 0.02 -25.02 0.25 146.55 ---=== PROBLEMS IN DETAIL ===--- Spectro CCDs warming: _______________________ On MJD 52914 at about 10:00Z, SoS started reporting: sdR-r2-00022543.fit: WARNING: Scattered light median = 135 electrons (Warm CCD or twi?) sdR-r2-00022543.fit: WARNING: Scattered light max = 245 electrons (Warm CCD or twi?) and the S/N on r2 was MUCH less than on r1. We then noticed that the monitor display of the second science exposure looked odd: greyed out on the right of r2. Pete then did "cc 2 tcheck" in SOP and discovered that r2 had an LN2 temp of 208K (nominal is 90K) and a CCD temp of -33C (nominal is -90C). We forced a fill of the secondary dewars, then issued a "cc 2 startfillseq" which solved the immediate problem. However, when we plotted the temperatures from watcher, it was clear that watcher knew we were way outside the nominal range, but there was no red flag or critical error issued. Why not? That we did not get a room-temperature CCD should not depend on SoS analysis... (Incidentally, the underlying cause was opening the enclosure very early, and topping off the dewars about 3 hours before sunset instead of at sunset while other hardware issues were being addressed. Night shift error for not topping off again when we took over...) Watcher complaints during the night: _____________________________________________ MCP tpm: m1 temp (Excessive M1 - PMSS Temperature Differential:Excessive Telescope - Ambient Temperature Differential:Excessive Temperature Radial Gradient:: 2003-10-02 01:11:03Z ) MCP misc: Too long delay 40012.753255; disabling trace (2003-10-02 03:34:29Z sdssmcp) (Too long delay 40012.753255; disabling trace (2003-10-02 03:34:29Z sdssmcp): 2003-10-02 03:34:44Z ) MCP tpm: m2 mig (Communications Fault: 2003-10-02 04:01:56Z) TCC: Text="pointing error probe does not exist:check inst data": (2003-10-02 01:15:40Z) MCP tpm: tracking (Excessive Az Tracking Error:: 2003-10-02 05:33:57Z) MCP tpm: m1 temp (Excessive Temperature Radial Gradient:: 2003-10-02 08:39:10Z)