APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Wednesday March 5, 2008 (MJD 54531) ---=== OBSERVING TEAM ===--- Steph Snedden Audrey Simmons Howard Brewington (dayShift) French Ledger (support) ---=== OBSERVING PLAN ===--- Science! ---=== OBSERVING SUMMARY ===--- Heavy clouds and humidity kept us in for most of the night. We were able to obtain two good exposures on cart 2, plate 2773 during a small break in the clouds. While we were closed, we gathered dithered flats, but it took us three tries. The first two attempts gave us back the same error as before (see log): 'motor b: Mechanicals did not respond correctly; response was mb100' At 11pm and again at 4am, the red camera to spectrograph 2 warmed up. French was able to fix the problem the first time by cleaning a dirty 6-pin connector leading to the solenoid, but the second time the problem came up, we were not able to figure out if the solenoid or the connector was the cause of the problem (see log for details). So, French will manually fill the CCD until morning when the problem can the fixed. ---=== OBSERVING LOG ===--- Afternoon: ---------- I discovered no problems during the afternoon checkout. The spectro focus was checked and slightly adjusted; it's set for about 0.0 degrees C. The pre-focus numbers via collimate are posted in the Problems Section. The disk space at /data and /files was good; see below: Filesystem Size Used Avail Use% Mounted on /dev/sda3 142G 127G 8.2G 94% / /dev/sda1 99M 30M 64M 33% /boot /dev/sdb1 917G 619G 252G 72% /data sdssfiles1:/data1/data 1.5T 553G 840G 40% /files iccSoundOff responded that all crates were available; see Problems Section for command's output. 23:40Z Opened doors/louvers, turned on fans. Night: ------ Heavy clouds prevented us from opening at sunset. 02:32Z - We re-adjusted the spectral collimators to be set at the current temperature (a move of +4000 steps in sp1 and sp2, according to goSpecFoc). sp1> -6018 -6018 -6019 sp2> -2394 -2394 -2394 --> 4 degrees C 03:05Z - Began taking spectro dithered flats with cart3, plate 2872. It failed after the 9th flat (mechanical error - see below): ******* Finished with specFlat 9 of 15. Setting up Collimator 2008-03-06 03:40:45Z: Original command was !mb100! 2008-03-06 03:40:45Z: expected reply was !mb100 OK! motor b: Mechanicals did not respond correctly; response was mb100 invalid keyed list format: list contains an empty field entry Error: problem with motors (see previous error message) Original motor positions: {a -5216} {b -5217} {c -5416} Current motor positions: {a -5116} {b -5117} {c -5416} ******* 03:55Z - We set the collimators back to their original setting (~0C), and then offset them by +2000 steps this time (just in case we moved the motors too much the first time and caused the error). sp1> -8018 -8018 -8019 sp2> -4394 -4394 -4394 --> 2 degrees C 04:05Z - Second attempt to obtain dithered flats. It failed again after the first one (same error message as before). 04:32Z - Set the collimators back to their original position, and tried again. (note the current temperature outside was 0.5C at the beginning, and -0.5 at the end). sp1> -10018 -10018 -10019 sp2> -6394 -6394 -6394 --> 0 degrees C 04:57Z - Nearby radar returns: we closed doors to telescope, but left the fans running. 05:38Z - Dithered flats completed successfully. I guess third time is a charm. The flat frame numbers are 50723-50737 and the arc frame numbers are 50738-50739. 06:02Z - Watcher error message: Voltage ln2temp for CCD02 (spectrograph 2, camera 2). We did an 'cc tcheck' on all of the cameras and found that ln2temp, as well as the CCD temp, were warming up on the red camera (cc #2 tcheck) for sp2. We did a primary fill with the peach dewer cap, allowing the secondary dewers to fill 32 lbs (dewer weight was around 117 lbs after the fill), but the pressure on the primary dewer was low and we were not able to build the pressure on it, so we exchanged out the dewers and put on a full blue cap dewer. We forced another primary fill and attempted several secondary fills, but the camera was still warming up (-51C). We heard the blue camera fill, but we could not hear the red camera fill. French came to the rescue and discovered that the 6-pin connector to the solenoid was dirty. He cleaned it and the camera began to cool down again. 06:15Z - Test bias to see if the red camera CCD on sp2 is okay. 07:25Z - A slight break in the clouds. Just in case the weather stay this way, we opened the doors to telescope again and continued ventilating. 08:50Z - Mounted cart 2, chunk165 plate 2773. 08:01Z - Opened enclosure to mostly clear skies. GSFOGTF. 08:19Z - Precals. 08:27Z - 20 min exposure. Seeing 1.4". Partly cloudy. Oragraphic clouds were forming on top of us. Efficiency varied from 80%-10%. 08:50Z - 20 min exposure. 09:13Z - 20 min exposure. Thick clouds came in and we lost guide stars, so we aborted this exposure. We obtained two good 20 min exposures on this plate, equalling a 7.1 (S/N)^2. 09:35Z - There are close radar returns to the north. We closed enclosure and closed the doors, but we left the fans running. 10:00Z - Watcher errors came back for the same problem that we were having before about the red camera on sp2 warming up (-35C). French woke up again to help us. However, our tactics to solve our problem the first time did not work this time. We tried swapping the blue connector with the red connector, but that failed to start a fill. We also tried moving around some wires and cleaning the connector again. No luck with those either. French disconnected the valve in order to push nitrogren into the CCD to cool it down (just like he did the last time). He will do this a few more times before the day crew comes in to fix the problem (either a connector problem or a solenoid problem - Wendell will determine it). 10:34Z - Stopped ventilating because of high humidity. 11:32Z - CCD temperature for camera #2 (sp2) is back to normal: -92C. 11:33Z - It started to snow. We called it a night. endNight rejoiced. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 7359 21:46Z 22:09Z 100 O -160.24 -154.57 52 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): yes QA Procedures Done (y/n): yes UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 50700, plate 2872 ------- 21:44 50700 0.0 bias 21:48 50701 10.0 flat 21:51 50702 2.0 arc 21:55 50703 2.0 arc 21:58 50704 3.0 arc 22:28 50705 10.0 flat 22:31 50706 2.0 arc ----- sequence 50707, plate -9999 ------- 22:43 50707 0.0 bias ----- sequence 50708, plate -9999 ------- 00:34 50708 0.0 bias ----- sequence 50709, plate 2872 ------- 02:33 50709 10.0 flat 02:35 50710 2.0 arc 02:43 50711 3.0 arc 02:45 50712 3.0 arc 03:06 50713 10.0 flat 03:10 50714 10.0 flat 03:14 50715 10.0 flat 03:19 50716 10.0 flat 03:23 50717 10.0 flat 03:27 50718 10.0 flat 03:31 50719 10.0 flat 03:35 50720 10.0 flat 03:39 50721 10.0 flat 04:03 50722 10.0 flat 04:31 50723 10.0 flat 04:35 50724 10.0 flat 04:39 50725 10.0 flat 04:43 50726 10.0 flat 04:47 50727 10.0 flat 04:51 50728 10.0 flat 04:56 50729 10.0 flat 05:00 50730 10.0 flat 05:04 50731 10.0 flat 05:08 50732 10.0 flat 05:12 50733 10.0 flat 05:16 50734 10.0 flat 05:21 50735 10.0 flat 05:25 50736 10.0 flat 05:29 50737 10.0 flat 05:33 50738 2.0 arc 05:36 50739 2.0 arc 07:43 50740 0.0 bias ----- sequence 50741, plate 2773 ------- 08:22 50741 10.0 flat 08:24 50742 2.0 arc 08:50 50743 1201.0 target 09:13 50744 1202.0 target ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 08:28Z 2 2773 71.11 0.0023 60.29 0.0040 237.56 0.0279 1.000090 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 00:27Z 3 0 1.00000 0 1256 0 121 30.0 2.7 25 262 - N/A 08:28Z 2 2773 1.00009 -889 617 200 71 60.3 -2.0 9 252 - 1.4 ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 21:00Z 43 2 16 216 (SW) 1097 - Cloudy 21:31Z 39 1 26 225 (SW) 1232 - " 22:02Z 38 0 20 225 (SW) 1383 - " 22:32Z 37 1 23 245 (WSW) 1465 - " 23:04Z 38 0 16 214 (SW) 1541 - " 23:37Z 38 0 19 225 (SW) 1815 - " 00:14Z 37 1 24 261 (W) 2272 - " 00:38Z 36 1 22 270 (W) 2123 - " 01:11Z 35 3 19 262 (W) 1818 - " 01:43Z 35 2 20 249 (WSW) 1806 - " 02:15Z 35 3 22 248 (WSW) 1933 - " 02:47Z 35 3 19 275 (W) 1844 - " 03:19Z 34 3 11 270 (W) 1494 - " 03:51Z 34 3 15 268 (W) 1428 - " 04:24Z 33 3 21 269 (W) 1519 - " 04:56Z 33 4 16 282 (WNW) 1534 - " 05:28Z 32 4 20 296 (WNW) 1526 - " 06:00Z 30 7 9 354 (NNW) 2334 - " 06:32Z 30 5 10 315 (NW) 1764 - " 07:04Z 30 5 7 274 (W) 1631 - " 07:36Z 26 14 3 176 (S) 1787 - Partly cloudy 08:07Z 28 5 9 223 (SW) 1843 - " 08:38Z 27 8 9 232 (SW) 1899 - Cloudy 09:09Z 25 12 15 225 (SW) 2069 - " 09:39Z 24 14 2 230 (SW) 2145 - " 10:11Z 23 14 4 264 (W) 1970 - " 10:44Z 21 15 1 294 (WNW) 2011 - " 11:16Z 21 16 8 307 (NW) 1768 - " ---=== TELESCOPE STATUS ===--- 23:40Z - Doors and louvers open, fans on. 08:01Z - Enclosure off. 09:35Z - Enclosure on, doors closed, but fans are still on. 10:35Z - Stopped ventilating completely because of high humidity. No interlocks bypassed. Status at: 11:36Z Telescope stowed at: 30,121,00 mount Instrument mounted: Cartridge 2 Counterweights at: 270 lbs LN2 autofill systems: Connected and turned on. 180L LN2 dewar scales: Spectro 320.50 lbs, 19.29 psi Imager 167.50 lbs, 23.17 psi ---=== SOFTWARE USED ===--- IOP/SOP: v4_38_0 Watcher: v2_36_0 MCP: v6_4_0 TPM: tpm_v3_5_0 AstroDa: v15_13_1 TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: v2_38 SoS: v5_1_8 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A -5.2160 -5.2160 Axial B -0.2142 -0.2142 Axial C -0.0016 -0.0016 Trans D 11.8610 11.8540 Lateral E 10.0838 10.0584 Lateral F 11.6586 11.6586 GALILS Commanded: 4600. -2000. 2650. -12450. -6500. -6550. Actual: 4600. -2000. 2650. -12450. -6500. -6550. SETMIR VALUES PriDesOrient: 0.00 0.00 0.00 100.00 -200.00 PriOrient: 0.00 0.00 0.00 99.59 -200.69 SECONDARY: ---------- Focus: 0.00 Air Temp.: 4.0 Alt.: 29.806007 MIGS TONIGHT NOMINAL Axial A 0.8024 0.8025 Axial B 0.6121 0.6120 Axial C 0.5474 0.5474 Trans D 0.6007 0.6008 GALILS Commanded: 1627510. 1653179. 1470912. -5900. -7800. Actual: 1627500. 1653150. 1470900. -5900. -7800. SETMIR VALUES SecDesOrient: 1257.00 60.00 -4.00 -20.00 118.90 SecOrient: 1257.01 59.99 -4.00 -19.92 119.29 ---=== PROBLEMS IN DETAIL ===--- ---=== Spectro Collimate Numbers ===--- IDL 5.5a> collimate, 50703 Reading /data/spectro/54531/sdR-b1-00050703.fit Reading /data/spectro/54531/sdR-b1-00050704.fit COLLIMATE: Min offset = -0.63 pix COLLIMATE: Max offset = 1.21 pix COLLIMATE: RMS across CCD = 0.43 pix COLLIMATE: Mean offset = 0.33 pix COLLIMATE: Camera b1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -11.7 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-54531-b1-00050703.log PostScript file = Collimate-54531-b1-00050703.ps Reading /data/spectro/54531/sdR-b2-00050703.fit Reading /data/spectro/54531/sdR-b2-00050704.fit COLLIMATE: Min offset = 0.11 pix COLLIMATE: Max offset = 0.56 pix COLLIMATE: RMS across CCD = 0.11 pix COLLIMATE: Mean offset = 0.40 pix COLLIMATE: Camera b2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -14.3 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-54531-b2-00050703.log PostScript file = Collimate-54531-b2-00050703.ps Reading /data/spectro/54531/sdR-r1-00050703.fit Reading /data/spectro/54531/sdR-r1-00050704.fit COLLIMATE: Min offset = -0.98 pix COLLIMATE: Max offset = -0.25 pix COLLIMATE: RMS across CCD = 0.23 pix COLLIMATE: Mean offset = -0.69 pix COLLIMATE: Camera r1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of 6316 steps for spectro-1 COLLIMATE: Issue SOP command: "sp1; mechPiston 6316" Log file = Collimate-54531-r1-00050703.log PostScript file = Collimate-54531-r1-00050703.ps Reading /data/spectro/54531/sdR-r2-00050703.fit Reading /data/spectro/54531/sdR-r2-00050704.fit COLLIMATE: Min offset = -1.16 pix COLLIMATE: Max offset = -0.23 pix COLLIMATE: RMS across CCD = 0.25 pix COLLIMATE: Mean offset = -0.56 pix COLLIMATE: Camera r2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of 5158 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston 5158" Log file = Collimate-54531-r2-00050703.log PostScript file = Collimate-54531-r2-00050703.ps % Program caused arithmetic error: Floating illegal operand IDL 5.5a> im> iccSoundOff ICC ad1 is available (node sdssad1, crate 3, board 0) ICC ad2 is available (node sdssad2, crate 3, board 1) ICC ad3 is available (node sdssad3, crate 3, board 2) ICC ad4 is available (node sdssad4, crate 3, board 3) ICC id1 is available (node sdssid1, crate 1, board 0) ICC id2 is available (node sdssid2, crate 1, board 1) ICC id3 is available (node sdssid3, crate 1, board 2) ICC id4 is available (node sdssid4, crate 2, board 0) ICC id5 is available (node sdssid5, crate 2, board 1) ICC id6 is available (node sdssid6, crate 2, board 2) ICC md1 is available (node sdssmd1, crate 11, board 0) ICC sd1 is available (node sdsssd1, crate 4, board 0) im> date Wed Mar 05 21:36:45 UTC 2008