APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Friday December 19, 2008 (MJD 54820) ---=== OBSERVING TEAM ===--- Viktor Malanushenko Steph Snedden Kaike Pan (swing) Support: Jon Brinkmann ---=== OBSERVING PLAN ===--- 19 Dec 2008 54820.0 0.45 BOSS/SEGUE until 07:53 (6.4 h), then SEGUE (4.7 h) ---=== OBSERVING SUMMARY ===--- Clouds for most of the night, followed by a DA hardware problem. No science. Three hours were lost to the DA problem total. Details are in the log body. The spectro dewar only has one more fill. We will check to see if it has been swapped when we wake up. It probably will have been. ---=== OBSERVING LOG ===--- Afternoon: ---------- removed mjd 54783-54790 data from host disk. All systems were checked and no problem to report. Spectro focus was set for about 0 C. Night: ----- 23:58Z - started building ventilation. Mostly cloudy at sunset, becoming completely overcast by end of twilight. 02:41Z - The leftovers from the APO Christmas party arrived on-site. Yum. 09:30Z - The clouds finally cleared out. Cartridge 3, plate 3174 - SEGUE2 Nov 08c ---------------------------------------- Needed an FK5 in fiber 11 (fiber 10 is broken) Viktor's pre-cal failed to read out. We aborted the exposure, killed all his related iop sessions and rebooted the spectro crate. The crate appeared to hang during the reboot, and we could not ping sd1. We called Jon (sorry Jon), and he listened in as we rebooted again and watched from a terminal session (dsclat sd1). The boot process hung at "Configuring SCSI for Pool Disks". Per Jon's instructions, we first tried power-cycling the hard drive above the spectro crate without success. We then checked every SCSI connection we could reach, also without success. As a last resort we checked the fuse on the disk drive, and it was fine. We did note that one of the two fans on the disk drive was not working. We could have a bad drive. Note that the failure happened sometime between afternoon checkout and Viktor's precal. The first Bad ICC error message and watcher critical alert emails happened at 10:15:46Z, at the time of the pre-cal. At this point, twilight was only an hour away, so there was no point for Jon to drive to the site until morning. We closed down. 12:30Z - endNight rejoiced A total of three hours of science time were lost to the DA problem. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 7862 22:02Z 22:21Z 100 O 128.49 133.30 46 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): QA Procedures Done (y/n): UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 57391, plate -9999 ------- 21:49 57391 0.0 bias ----- sequence 57392, plate 3174 ------- 22:05 57392 10.0 flat 22:07 57393 2.0 arc 22:10 57394 2.0 arc 22:13 57395 3.0 arc 22:35 57396 3.0 arc 22:37 57397 3.0 arc ----- sequence 57398, plate 3105 ------- 23:05 57398 10.0 flat 23:07 57399 2.0 arc 23:16 57400 3.0 arc 23:18 57401 2.0 arc ----- sequence 57402, plate -9999 ------- 23:34 57402 0.0 bias ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 09:45Z 3 3174 189.15 -0.0111 75.33 -0.0069 11.43 0.0202 0.999950 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 09:49Z 3 3174 0.99995 494 1682 150 192 75.2 -0.9 13 263 -- 1.5" ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 19:42Z 37 -10 11 280 (W) 8 - cloudy 20:14Z 38 -8 20 266 (W) 104 - ' 20:48Z 37 -8 15 289 (WNW) 95 - ' 21:20Z 41 -4 19 268 (W) 134 - ' 21:52Z 39 -1 12 265 (W) 131 - ' 22:23Z 35 2 10 283 (WNW) 236 - ' 22:55Z 33 7 12 268 (W) 350 - ' 23:28Z 33 2 14 275 (W) 190 - ' 23:40Z 33 0 16 267 (W) 147 - ' 00:13Z 32 5 12 298 (WNW) 269 - ' 00:45Z 32 5 15 250 (WSW) 257 - ' 01:17Z 32 7 9 247 (WSW) 246 - ' 01:49Z 32 6 14 258 (WSW) 257 - ' 02:21Z 33 5 18 267 (W) 244 - ' 02:53Z 33 6 14 263 (W) 317 - ' 03:25Z 32 11 12 269 (W) 430 - ' 03:58Z 32 13 14 261 (W) 429 - ' 04:30Z 32 14 15 265 (W) 467 - ' 05:02Z 31 16 17 276 (W) 510 - ' 05:34Z 31 16 14 283 (WNW) 534 - ' 06:06Z 31 18 9 260 (W) 585 - ' 06:38Z 30 20 13 277 (W) 666 - ' 07:08Z 30 18 12 264 (W) 585 - ' 07:39Z 31 14 19 287 (WNW) 482 - ' 08:09Z 30 14 21 265 (W) 455 - ' 08:39Z 31 13 13 261 (W) 437 - ' 09:09Z 30 13 18 267 (W) 426 - ' 09:43Z 30 14 16 273 (W) 455 - partly cloudy 10:15Z 30 12 16 267 (W) 447 - ' 10:56Z 30 7 18 268 (W) 356 - ' 11:28Z 31 1 12 264 (W) 428 - ' 12:00Z 31 -1 14 266 (W) 408 - ' 12:32Z 31 -1 14 267 (W) 397 - ' ---=== TELESCOPE STATUS ===--- 23:35Z - Started building ventilation. 09:30Z - Opened enclosure. 12:18Z - Enclosure closed. Ventilation off. Telescope stowed at 30 deg alt. Cartridge 3 mounted. Counterweights at 250No interlocks bypassed. Spectro autofill connected. 12:50Z - Spectro dewar: 70 lb; 17 psi 12:50Z - Imager dewar: 136 lb; 19 psi ---=== SOFTWARE USED ===--- IOP/SOP: v4_39_0 Watcher: v2_36_0 MCP: v6_4_0 TPM: tpm_v3_5_0 AstroDa: v15_13_1 TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: v2_43 SoS: v5_1_8 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A -0.0340 -0.0330 Axial B 0.0410 0.0430 Axial C -0.0380 -0.0370 Trans D -0.7640 -0.7600 Lateral E 10.5791 10.5791 Lateral F 12.1793 12.1666 GALILS Commanded: 10450. -100. 5750. 8600. 10350. 10000. Actual: 10450. -100. 5750. 8600. 10350. 10000. SETMIR VALUES PriDesOrient: 0.00 -11.72 8.60 496.70 640.50 PriOrient: 1.06 -11.65 8.77 495.77 639.59 SECONDARY: ---------- Focus: 0.00 Air Temp.: 1.4 Alt.: 29.999997 MIGS TONIGHT NOMINAL Axial A 18.5790 18.5760 Axial B 15.6180 15.6170 Axial C 13.8190 13.8170 Trans D 15.1070 15.1110 GALILS Commanded: 1626635. 1528745. 1595586. -2950. -4550. Actual: 1626627. 1528808. 1595583. -2945. -4561. SETMIR VALUES SecDesOrient: 1257.00 -12.00 -28.00 -39.00 94.77 SecOrient: 1256.99 -12.01 -28.02 -39.20 94.71 ---=== PROBLEMS IN DETAIL ===--- DA: sd1 SCSI connection to pool disk problem: -------------------------------------------- From the log body: Viktor's pre-cal failed to read out. We aborted the exposure, killed all his related iop sessions and rebooted the spectro crate. The crate appeared to hang during the reboot, and we could not ping sd1. We called Jon (sorry Jon), and he listened in as we rebooted again and watched from a terminal session (dsclat sd1). The boot process hung at "Configuring SCSI for Pool Disks". Per Jon's instructions, we first tried power-cycling the hard drive above the spectro crate without success. We then checked every SCSI connection we could reach, also without success. As a last resort we checked the fuse on the disk drive, and it was fine. We did note that one of the two fans on the disk drive was not working. At this point, twilight was only an hour away, so there was no point for Jon to drive to the site until morning. We closed down. Spectro Focus Infor: ---------------------- sp1> mechSend s spMechVersion v2_9_0 Bootup 870616738 SpectroID 1 SlitID 35 Air On Shutter_open_sensor Off Shutter_closed_sensor On Left_open_sensor Off Left_closed_sensor On Right_open_sensor Off Right_closed_sensor On Coll_motor_A -10126 01P-0000007126 Coll_motor_B -10325 02P-0000007325 Coll_motor_C -10241 01P-0000007241 Coll_motor_A_status 132 01S0132 Coll_motor_B_status 132 02S0132 Coll_motor_C_status 133 01S0133 Requested_exp.time 0 Exp_time_left 0 Last_exp.time 3 Last_open_transit.time 715 Last_close_transit.time 535 Humid_Hartmann 11.8 0xFE1D Humid_Cen_Optics 12.4 0xFE15 Temp_Median 5.0 sp2> mechSend s spMechVersion v2_9_0 Bootup 870616738 SpectroID 2 SlitID 3 Air On Shutter_open_sensor Off Shutter_closed_sensor On Left_open_sensor Off Left_closed_sensor On Right_open_sensor Off Right_closed_sensor On Coll_motor_A -8237 01P-0000006237 Coll_motor_B -8714 02P-0000006714 Coll_motor_C -8942 01P-0000006942 Coll_motor_A_status 133 01S0133 Coll_motor_B_status 132 02S0132 Coll_motor_C_status 132 01S0132 Requested_exp.time 0 Exp_time_left 0 Last_exp.time 3 Last_open_transit.time 720 Last_close_transit.time 625 Humid_Hartmann -24.9 0x4 Humid_Cen_Optics 13.6 0xFE04 Temp_Median 3.0 IDL 5.5a> collimate, 57396 Reading /data/spectro/54820/sdR-b1-00057396.fit Reading /data/spectro/54820/sdR-b1-00057397.fit COLLIMATE: Min offset = -0.41 pix COLLIMATE: Max offset = 1.22 pix COLLIMATE: RMS across CCD = 0.40 pix COLLIMATE: Mean offset = 0.39 pix COLLIMATE: Camera b1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -13.9 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-54820-b1-00057396.log PostScript file = Collimate-54820-b1-00057396.ps Reading /data/spectro/54820/sdR-b2-00057396.fit Reading /data/spectro/54820/sdR-b2-00057397.fit COLLIMATE: Min offset = 0.01 pix COLLIMATE: Max offset = 0.42 pix COLLIMATE: RMS across CCD = 0.10 pix COLLIMATE: Mean offset = 0.27 pix COLLIMATE: Camera b2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -9.8 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-54820-b2-00057396.log PostScript file = Collimate-54820-b2-00057396.ps Reading /data/spectro/54820/sdR-r1-00057396.fit Reading /data/spectro/54820/sdR-r1-00057397.fit COLLIMATE: Min offset = -0.86 pix COLLIMATE: Max offset = -0.11 pix COLLIMATE: RMS across CCD = 0.24 pix COLLIMATE: Mean offset = -0.53 pix COLLIMATE: Camera r1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of 4870 steps for spectro-1 COLLIMATE: Issue SOP command: "sp1; mechPiston 4870" Log file = Collimate-54820-r1-00057396.log PostScript file = Collimate-54820-r1-00057396.ps Reading /data/spectro/54820/sdR-r2-00057396.fit Reading /data/spectro/54820/sdR-r2-00057397.fit COLLIMATE: Min offset = -1.10 pix COLLIMATE: Max offset = -0.15 pix COLLIMATE: RMS across CCD = 0.26 pix COLLIMATE: Mean offset = -0.47 pix COLLIMATE: Camera r2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of 4263 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston 4263" Bias check: Filename 02% 05% 10% 50% 90% 95% 98% ------------------- ------ ------ ------ ------ ------ ------ ------ sdR-b1-00057391.fit -5.6 -4.0 -2.3 2.3 7.6 8.7 10.7 sdR-b2-00057391.fit -7.9 -6.3 -4.1 1.0 7.2 9.6 11.0 sdR-r1-00057391.fit -6.7 -5.4 -3.4 2.0 7.5 9.6 11.6 sdR-r2-00057391.fit -8.1 -6.0 -3.9 1.5 7.7 9.8 11.9