APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday January 3, 2009 (MJD 54835) ---=== OBSERVING TEAM ===--- Elena Malanushenko Dmitry Bizyaev Kaike Pan (swing) ---=== OBSERVING PLAN ===--- Science! ---=== OBSERVING SUMMARY ===--- Clear first part of the night, cloudy second part. We closed early because of high humidity. Finished plate 3127 (c. 2). Useful signal added to plate 3178 (c. 8). This was a night of hardware problems. Replaced FF lamp (top left, if to look from the back in the stove position). The bad lamp is in the eng. trailer, on a table. Camera power supply block at spectrograph 2, blue shoulder, got "-15V" red LED. Replaced - one of the spares gave "-5V" red LED. Second spare block worked well. Both bad blocks are in the eng. trailer, with stickers that state symptoms of their sickness. X-session on Landru got locked in the middle of an exposure. As a result, one spectro exposure was lost. One more annoying thing is that all telephones in the control room have nooisy lines, it is very hard to hear the other side at the time when problems require communication to be fixed. ---=== OBSERVING LOG ===--- Afternoon: ----------- All systems were checked and working properly. The spectro focus was checked but no adjustment made. It was set for 3 C. Spectro dewar seems can not hold its pressure. It was reading 10 psi when I checked, I open the pressure building valve and close it after it reach 25. 23:35 started ventilation and mounted cart 2, Filename 02% 05% 10% 50% 90% 95% 98% ------------------- ------ ------ ------ ------ ------ ------ ------ sdR-b1-00057888.fit -6.0 -3.9 -2.7 2.4 7.2 8.3 10.5 sdR-b2-00057888.fit -8.0 -6.1 -4.8 1.3 7.1 8.7 11.2 sdR-r1-00057888.fit -6.6 -5.5 -3.4 1.0 6.5 7.6 9.8 sdR-r2-00057888.fit -8.7 -6.6 -4.7 0.8 6.0 8.1 10.2 Night: ------ Cart 2. plate 3127 (SEGUE) is on 00:48Z gotoField with cart. 2 GSOGTF 01:03Z precal 01:25Z science 1800 02:02Z science 1800 good exposures 02:39Z midcal 02:47Z science 1500 postcal this plate is finished --- 03:25Z plate 3186 cart 5 mounted GSOGTF we noticed that one FF lamp is off. Turned on/off several times. The lamp is gone. 03:32Z - 03:48Z FF lamp was replaced. The bad lamp is put on a table (closest to the entrance) 03:52Z - one of the spectro cameras cannot be read. endStare, endStare -force - same result: sp1> goStare 0 -camCheck 2009-01-04 04:08:58Z: statusEntry daqBusy on node sd1 is not 0 but 1 Error: Aborting: system is already busy IOP running as Backup Relay Server. At the telescope, we found that "blue" power supply box has 1 red LED: -15 V. We power cycled it. Then again. It didn't help. We found two spare blocks , didn't find Dan Long and French, called Steph, called Wendell, and went to replace the block. Sorry, all cable tights were cut around the block by us. The first block we put on gave us a big red LED and one small red LED "-5V". We took it away and put on the next block. The second block works fine! Next, we unlocked ports. Then, around 05:58Z, we rebooted the spectro crate (it had red LEDs on it). Then fixed the DA. 06:07Z we successfully got a bias and a precal. Cart. 5 is missed due to hardware problems. --- 06:23Z cart. 3 plate 3045 mounted (Marvels Preselect) 06:33Z gotoField with side B. fk5 used Doesn't help a lot. Cart 3. is a tough one because of traditionally hiuge offsets and broken fiber 10. Upcoming clouds gave us a bad luck in searches for guide stars. At 07:09Z we switched back to the Segue program. 07:15Z cart. 8 plate 3178 mounted (Segue). 07:30Z watcher complains about lack of connection to spectro server. Crate looks perfect. We restarted the servers. exec micro (UNACKNOWLEDGED : 2009-01-04 07:29:22Z) 07:49Z precal 07:56Z science 1800 a lot of clouds in field, eff ~ 10%. Marked as BAD. 08:30Z science 1800 --> see what happened below .. about 09:32Z X-session at Landru got dead locked. It was some 5 minutes left till the end of the exposure. We were waiting for new spectro files coming but didn't get them. Sop was taken by "mikemonk" and new exposure started: 09:33Z science 1800 At the end of the exposure humidity went up, dew point down. exec micro (UNACKNOWLEDGED : 2009-01-04 10:06:48Z) 10:09Z telescope closed because of high and rising humidity. exec micro (UNACKNOWLEDGED : 2009-01-04 12:08:31Z) At the same time, the spectro crate has all LEDs green, and we are able to take spectra. 12:10Z humidity went up just above 4C dew point difference. We went down to the telescope to check if we can open but observed some moisture on white details of construction. We declare the night as done. 12:15Z endNight finished ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 7890 22:54Z 23:15Z 100 O 156.45 161.71 49 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): QA Procedures Done (y/n): UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 57882, plate -9999 ------- 22:59 57882 0.0 bias ----- sequence 57883, plate 3178 ------- 23:06 57883 10.0 flat 23:09 57884 2.0 arc 23:12 57885 3.0 arc 23:14 57886 3.0 arc 23:54 57888 0.0 bias ----- sequence 57889, plate 3127 ------- 01:05 57889 10.0 flat 01:07 57890 2.0 arc 01:57 57891 1800.0 target 02:34 57892 1800.0 target 02:41 57893 10.0 flat 02:43 57894 2.0 arc 03:14 57895 1500.0 target 03:17 57896 10.0 flat 03:20 57897 2.0 arc 03:20 57898 10.0 flat ----- sequence 57904, plate -9999 ------- 06:03 57904 0.0 bias ----- sequence 57905, plate 3186 ------- 06:11 57906 10.0 flat 06:14 57907 2.0 arc ----- sequence 57908, plate -9999 ------- 06:17 57908 0.0 bias ----- sequence 57909, plate 3178 ------- 07:52 57909 10.0 flat 07:55 57910 2.0 arc 08:28 57911 1800.0 target ----- sequence 57912, plate 3178 ------- 09:26 57912 0.0 bias 10:06 57913 1801.0 target ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 01:29Z 2 3127 28.90 0.0033 53.74 -0.0003 203.99 0.0261 1.000050 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 01:29Z 2 3127 1.00005 -493 1161 400 29 53.7 0.6 18 248 -- 1.3" ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 22:07Z 41 22 16 259 (W) 437 - 22:39Z 40 24 21 253 (WSW) 528 - 23:10Z 39 24 17 264 (W) 548 - 23:40Z 36 23 14 268 (W) 535 - clear 00:02Z 35 24 14 264 (W) 626 - '' 00:34Z 33 24 16 258 (WSW) 722 - '' 01:08Z 33 24 15 253 (WSW) 699 - '' 01:40Z 33 22 19 252 (WSW) 752 - '' 02:10Z 33 21 18 262 (W) 669 - '' 02:40Z 33 21 15 264 (W) 567 - '' 03:12Z 33 20 19 265 (W) 498 - '' 03:45Z 33 21 16 276 (W) 603 - '' 04:16Z 33 22 14 262 (W) 612 - '' 04:48Z 33 22 19 269 (W) 659 - '' 05:20Z 33 21 17 266 (W) 592 - '' 05:53Z 33 22 15 270 (W) 571 - '' 06:24Z 32 23 15 269 (W) 560 - clouds 06:54Z 32 23 15 261 (W) 575 - '' 07:24Z 32 23 13 270 (W) 605 - '''' 07:56Z 32 24 12 277 (W) 618 - '' 08:26Z 31 24 10 264 (W) 664 - ''' 08:56Z 31 24 10 269 (W) 657 - '' 09:28Z 31 25 9 260 (W) 714 - '' 10:00Z 30 26 11 256 (WSW) 769 - '' 10:31Z 29 25 10 258 (WSW) 815 - clear 11:03Z 28 25 8 256 (WSW) 802 - '' 11:35Z 30 24 11 212 (SSW) 724 - '' 12:07Z 30 22 12 227 (SW) 597 - some clouds ---=== TELESCOPE STATUS ===--- 23:35Z - Began ventilation. Doors and louvers opened, fans on. 00:12Z - Enclosure off. 10:09Z - Enclosure on, doors and louvers closed, fans off. No interlocks bypassed. Status at: 12:15Z Telescope stowed at: 30,121,00 mount Instrument mounted: Cartridge 8 Counterweights at: 252 lbs LN2 autofill systems: Connected and turned on. 180L LN2 dewar scales: Spectro 182 lbs, 18.5 psi Imager 111 lbs, 19.8 psi ---=== SOFTWARE USED ===--- IOP/SOP: v4_39_0 Watcher: v2_36_0 MCP: v6_4_0 TPM: tpm_v3_5_0 AstroDa: v15_13_1 TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: v2_43 SoS: v5_1_8 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A -0.0330 -0.0330 Axial B 0.0420 0.0430 Axial C -0.0370 -0.0370 Trans D -0.7600 -0.7600 Lateral E 10.5918 10.5791 Lateral F 12.1793 12.1666 GALILS Commanded: 10450. -100. 5750. 8600. 10350. 10000. Actual: 10471. -76. 5755. 8616. 10374. 10023. SETMIR VALUES PriDesOrient: 0.00 -11.72 8.60 496.70 640.50 PriOrient: 1.06 -11.65 8.77 495.77 639.59 SECONDARY: ---------- Focus: 125.00 Air Temp.: 2.4 Alt.: 90.000064 MIGS TONIGHT NOMINAL Axial A 18.4530 18.5760 Axial B 15.5120 15.6170 Axial C 13.7130 13.8170 Trans D 15.1070 15.1110 GALILS Commanded: 1786968. 1684871. 1751693. -2950. -4550. Actual: 1626627. 1528808. 1595583. -2945. -4561. SETMIR VALUES SecDesOrient: 1257.00 -12.00 -28.00 -39.00 94.77 SecOrient: 1382.02 -11.53 -29.42 -40.18 94.64 PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A -0.0330 -0.0330 Axial B 0.0410 0.0430 Axial C -0.0370 -0.0370 Trans D -0.7600 -0.7600 Lateral E 10.5918 10.5791 Lateral F 12.1793 12.1666 GALILS Commanded: 10450. -100. 5750. 8600. 10350. 10000. Actual: 10471. -76. 5755. 8616. 10374. 10023. SETMIR VALUES PriDesOrient: 0.00 -11.72 8.60 496.70 640.50 PriOrient: 1.06 -11.65 8.77 495.77 639.59 SECONDARY: ---------- Focus: 0.00 Air Temp.: 2.4 Alt.: 30.000001 MIGS TONIGHT NOMINAL Axial A 18.5820 18.5760 Axial B 15.6180 15.6170 Axial C 13.8170 13.8170 Trans D 15.1060 15.1110 GALILS Commanded: 1626616. 1528758. 1595775. -2950. -4550. Actual: 1626627. 1528808. 1595583. -2945. -4561. SETMIR VALUES SecDesOrient: 1257.00 -12.00 -28.00 -39.00 94.77 SecOrient: 1257.03 -12.08 -28.00 -39.19 94.75 ---=== PROBLEMS IN DETAIL ===--- Spectro Focus Infor: -------------------- sp1> mechSend s Dropping at exit spMechVersion v2_9_0 Bootup 870616738 SpectroID 1 SlitID 40 Air On Shutter_open_sensor Off Shutter_closed_sensor On Left_open_sensor Off Left_closed_sensor On Right_open_sensor Off Right_closed_sensor On Coll_motor_A -6567 01P-0000006567 Coll_motor_B -6766 02P-0000006766 Coll_motor_C -6682 01P-0000006682 Coll_motor_A_status 132 01S0132 Coll_motor_B_status 132 02S0132 Coll_motor_C_status 133 01S0133 Requested_exp.time 0 Exp_time_left 0 Last_exp.time 524 Last_open_transit.time 715 Last_close_transit.time 540 Humid_Hartmann 20.0 0xFDB1 Humid_Cen_Optics 13.7 0xFE05 Temp_Median 6.9 sp2> mechSend s Dropping at exit spMechVersion v2_9_0 Bootup 870616738 SpectroID 2 SlitID 8 Air On Shutter_open_sensor Off Shutter_closed_sensor On Left_open_sensor Off Left_closed_sensor On Right_open_sensor Off Right_closed_sensor On Coll_motor_A -4458 01P-0000004458 Coll_motor_B -4937 02P-0000004937 Coll_motor_C -5161 01P-0000005161 Coll_motor_A_status 132 01S0132 Coll_motor_B_status 132 02S0132 Coll_motor_C_status 133 01S0133 Requested_exp.time 0 Exp_time_left 0 Last_exp.time 523 Last_open_transit.time 695 Last_close_transit.time 600 Humid_Hartmann -24.4 0xFFFC Humid_Cen_Optics 17.3 0xFDD4 Temp_Median 4.9 IDL 5.5a> collimate, 57885 Reading /data/spectro/54835/sdR-b1-00057885.fit Reading /data/spectro/54835/sdR-b1-00057886.fit COLLIMATE: Min offset = -0.45 pix COLLIMATE: Max offset = 0.97 pix COLLIMATE: RMS across CCD = 0.37 pix COLLIMATE: Mean offset = 0.26 pix COLLIMATE: Camera b1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -9.2 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-54835-b1-00057885.log PostScript file = Collimate-54835-b1-00057885.ps Reading /data/spectro/54835/sdR-b2-00057885.fit Reading /data/spectro/54835/sdR-b2-00057886.fit COLLIMATE: Min offset = -0.11 pix COLLIMATE: Max offset = 0.38 pix COLLIMATE: RMS across CCD = 0.11 pix COLLIMATE: Mean offset = 0.19 pix COLLIMATE: Camera b2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -6.7 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-54835-b2-00057885.log PostScript file = Collimate-54835-b2-00057885.ps Reading /data/spectro/54835/sdR-r1-00057885.fit Reading /data/spectro/54835/sdR-r1-00057886.fit COLLIMATE: Min offset = -0.79 pix COLLIMATE: Max offset = 0.08 pix COLLIMATE: RMS across CCD = 0.26 pix COLLIMATE: Mean offset = -0.39 pix COLLIMATE: Camera r1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of 3543 steps for spectro-1 COLLIMATE: Issue SOP command: "sp1; mechPiston 3543" Log file = Collimate-54835-r1-00057885.log PostScript file = Collimate-54835-r1-00057885.ps Reading /data/spectro/54835/sdR-r2-00057885.fit Reading /data/spectro/54835/sdR-r2-00057886.fit COLLIMATE: Min offset = -1.02 pix COLLIMATE: Max offset = -0.01 pix COLLIMATE: RMS across CCD = 0.28 pix COLLIMATE: Mean offset = -0.32 pix COLLIMATE: Camera r2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of 2932 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston 2932" ===== Problems: 1. See big block of problems in the "log" section. 2. Status Busy Run 54835 Frame 57898 dead (Frame=57898 Row=0: 2009-01-04 05:38:32Z) exec micro (UNACKNOWLEDGED : 2009-01-04 06:06:13Z) The reported problems are connected to the problem with ccd power supply block, see log. ---