APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday April 16, 2002 (MJD 52381) ---=== OBSERVING TEAM ===--- Swing: Steph Snedden Night: Mike Harvanek, Pete Newman Support: St. Constance of Washington (by aether) Visitors: Anders Jorgenson (LNAL), Brian McLean (STScI) Moral support: Scot, Atsuko, Steph, Eric ---=== OBSERVING PLAN ===--- Science to planned priorities. ---=== OBSERVING SUMMARY ===--- Five plates done (510, 845, 886, 904, 817) under variable conditions. Spectrographs' focus and collimation adjusted. New problem with imager secondary dewars overflowing lost us an hour (but no imaging data, as clouds arrived about the same time). Recurrences of several known software problems. ---=== OBSERVING LOG ===--- Swing shift notes ----------------- Scot installed a new IOP as test, v3_74_0a. Apparently we had been running an IOP that depended on an "unshaken" and incorrect astroline that astroda v14_45 depended on. The test IOP depends on an astroda (v14_47) that uses the reliable astroline. [NB: These were NOT declared current, as we did not get an opportunity to test imaging on the sky. SOP worked ok, however.] After the switch, I had to do a hard reboot of the photo crates (but not the spectro crates), since the photo nodes didn't come up after a dscSwSys v14_47. After that, when I started SOP and issued the initialization bias I got: sp1> goStare 0 -init -bias DA rebooted... attempting to fix exposure number. Error: Invalid state for this command Status entry is read-only A repeat worked. The spectrographs' focus and collimation were adjusted. See the last section of this log for details. Night shift notes ----------------- Only Moon prevents us from starting with imaging on opening, so we proceeded with spectroscopy with excellent seeing. PR3572 (smear failure) recurred on plates 510 and 917. PR updated. Around 05:15Z, the imager secondary dewars were found to be overflowing and dumping LN2 at 1lb/minute. See problem section #1 for details. PR3583 opened. PR3402 (exposure time incorrectly recorded) recurred on exposure 14637. We had more 'Bad sky residuals' warnings from SoS tonight. Looking back over the SoS logs to MJD 52370, we found several (52374, 52375, 52381), all reported by r1 in the 5800-5925A range. We do not know the cause of this yet. Observing sequence: 01:52Z Plate 904, cartridge 9. Done in 3 exposures. FK5 star found with previous offsets well before 12 deg twilight but too bright to see guide stars. 03:45Z Plate 510, cartridge 3. Done in 3 exposures. Three guide stars on gotoField. Smear failed on the second set of offsets (guide stars were points not streaks) although we are sure the autoguider had stopped. We returned to the field and repeated the smear. 05:13Z Switch to imaging, whereupon we discovered the imager problem (above). 06:15Z Switch to spectroscopy when clouds seen forming ahead of a weather system to the south, just as we were about to continue trying to image after working round the imager problem! Seeing also degraded to below imaging quality. 06:27Z Plate 845, cartridge 6. Done in 3 exposures. Guide stars on gotoField. Some time lost after this debugging the imager problem. 08:12Z Plate 886, cartridge 2. Done in 3 exposures. No guide stars with previous offsets, but FK5 visible. We suspect clearing the previous offsets would have found guide stars, as this field is a long way on the sky from the previous field. First smear again failed. 09:47Z Plate 917, cartridge 4. No useful data in 1 exposure. Guide stars on gotoField. We didn't expect to finish this plate tonight, and clouds dropped the efficiency too low to get anything useful before we ran off the designed hour-angle range. 10:21Z Plate 817, cartridge 1. Done in 2 exposures combined with (S/N)^2 >= 6.2 from last night. Guide stars on gotoField. endNight was running as this log was being completed. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 3132 22:46Z 23:02Z 100 O -104.21 -100.31 36 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot --------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields nGood rowMean rowSig colMean colSig rot --------------------------------------------------------------- ---=== SPECTROSCOPY DATA SUMMARY ===--- UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 14620, plate 904 ------- IGNORE: Focus adjustments 23:28 14621 3.0 arc 23:30 14622 3.0 arc 23:55 14623 2.0 arc 23:57 14624 3.0 arc ----- sequence 14625, plate -9999 ------- 00:12 14625 0.0 bias ----- sequence 14626, plate 904 ------- 19.1 19.9 16.3 18.4 DONE 00:21 14626 0.0 bias 02:36 14627 10.0 flat 02:39 14628 2.0 arc 02:59 14629 901.0 target 03:14 14630 721.0 target 03:33 14631 904.0 target 03:40 14632 240.0 smear ----- sequence 14633, plate 510 ------- 15.3 14.5 14.7 16.2 DONE 03:59 14633 10.0 flat 04:01 14634 2.0 arc 04:19 14635 801.0 target 04:35 14636 802.0 target 04:51 14637 23136.0 target Was really 800 seconds! 04:58 14638 240.0 smear Failed - declared bad 05:12 14639 240.0 smear ----- sequence 14640, plate 845 ------- 20.2 16.7 20.5 18.6 DONE 06:36 14640 10.0 flat 06:39 14641 2.0 arc 07:03 14642 1201.0 target 07:29 14643 1201.0 target 07:44 14644 722.0 target 07:51 14645 240.0 smear 07:55 14646 10.0 flat 07:57 14647 2.0 arc ----- sequence 14648, plate 886 ------- 17.4 15.6 18.6 19.2 DONE 08:30 14648 10.0 flat 08:32 14649 2.0 arc 08:52 14650 900.0 target 09:08 14651 900.0 target 09:25 14652 903.0 target 09:32 14653 240.0 smear Failed - declared bad. 09:43 14654 240.0 smear ----- sequence 14655, plate 917 ------- 09:57 14655 10.0 flat 09:59 14656 2.0 arc 10:17 14657 901.0 target Useless ----- sequence 14658, plate 817 ------- 21.9 15.1 26.7 19.0 DONE 10:31 14658 10.0 flat 10:33 14659 2.0 arc 10:58 14660 1200.0 target 11:21 14661 1200.0 target 11:28 14662 240.0 smear ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 02:43Z 9 904 157.58 -0.0008 66.83 0.0017 -32.53 -0.0183 1.000200 04:12Z 3 510 12.25 0.0020 58.96 0.0012 190.26 -0.0024 1.000150 06:51Z 6 845 -28.55 0.0020 59.14 0.0012 156.18 -0.0024 1.000090 08:38Z 2 886 222.16 -0.0015 57.71 0.0000 67.15 -0.0038 1.000160 10:02Z 4 917 -50.61 -0.0005 41.66 -0.0002 139.38 -0.0294 0.999960 10:37Z 1 817 224.74 -0.0005 79.03 -0.0002 50.74 -0.0294 1.000050 ---=== DATA TAPE SUMMARY ===--- Goes: JL5267 Stays: JL5268 ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 02:43Z 9 904 1.00020 -1974 -548 -50 158 66.8 7.6 17 240 BG38 1.5 04:11Z 3 510 1.00015 -1480 -221 -150 12 59.0 8.2 17 271 BG38 1.3 06:51Z 6 845 1.00009 -888 294 -125 -28 59.2 6.6 17 261 BG38 1.8 08:38Z 2 886 1.00016 -1579 -150 0 222 57.7 5.1 13 250 BG38 1.8 10:02Z 4 917 0.99996 394 1486 -50 -51 41.7 4.6 16 260 BG38 1.8 10:38Z 1 817 1.00005 -493 661 -50 225 79.0 4.2 13 238 BG38 1.8 ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 23:26Z 53 20 23 256 (WSW) 1064 - Clear 23:59Z 53 21 19 272 (W) 1075 - " 00:30Z 51 20 23 270 (W) 926 - " 01:00Z 50 21 17 265 (W) 984 - " 01:30Z 48 21 14 256 (WSW) 840 - " 02:01Z 46 21 19 250 (WSW) 908 - " 02:32Z 45 21 14 245 (WSW) 890 - " 03:04Z 46 20 15 263 (W) 949 - " 03:37Z 47 20 15 257 (WSW) 858 - " 04:09Z 46 19 18 265 (W) 823 - " 04:42Z 45 20 16 269 (W) 858 - " 05:12Z 45 21 19 272 (W) 833 - " 05:44Z 45 20 19 265 (W) 871 - " 06:17Z 44 19 18 266 (W) 843 - Variable cloud 06:48Z 44 21 17 259 (W) 861 - " 07:19Z 42 22 21 249 (WSW) 1004 - " 07:51Z 41 24 21 258 (WSW) 904 - " 08:21Z 41 24 16 238 (WSW) 923 - " 08:51Z 41 25 17 234 (SW) 931 - " 09:22Z 40 26 17 254 (WSW) 903 - " 09:52Z 40 26 18 255 (WSW) 1032 - " 10:23Z 39 27 12 243 (WSW) 935 - " 10:54Z 39 27 11 253 (WSW) 962 - " 11:28Z 39 27 9 259 (W) 988 - " ---=== TELESCOPE STATUS ===--- 23:50Z Fans on 01:00Z Doors open 01:35Z Enclosure off 11:52Z Enclosure on, fans off Status at 11:52Z: Telescope stowed at: 30 deg Instrument mounted: Cartridge 8 Counterweights at: Upper limit Autofill systems: On 180L LN2 dewar weights: Spectro 68 lb Imager 74 lb (just filled) Interlocks bypassed: Slip detection, west building door kick-back. ---=== SOFTWARE USED ===--- IOP/SOP: v3_74_0a (test: SOP tested, but IOP _not_ tested) Watcher: v2_15_0 MCP: v5_11_1 TPM: v2_5_3 AstroDa: v14_47 (test: _not_ tested on the sky) TCC: 2.6.2 sdssProcedures: v1_42 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.0840 0.0880 Axial B 0.7960 0.7980 Axial C 0.0710 0.0700 Trans D -1.5150 -1.5230 Lateral E 1.8490 1.8320 Lateral F 1.4120 1.4000 GALILS Commanded: 5400. -3700. 900. -200. 31550. 30650. Actual: 5400. -3700. 900. -200. 31550. 30650. SETMIR VALUES PriDesOrient: 0.00 -11.80 23.00 1256.90 642.10 PriOrient: 0.00 -12.16 22.81 1257.41 642.19 SECONDARY: ---------- Focus: 0.00 Air Temp.: 10.9 Alt.: 30.211724 MIGS TONIGHT NOMINAL Axial A 1.5590 1.5580 Axial B 1.2370 1.2350 Axial C 1.2670 1.2650 Trans D -0.5860 -0.5860 GALILS Commanded: 1599624. 1565142. 1586351. -10400. -9750. Actual: 1599600. 1565250. 1586350. -10400. -9750. SETMIR VALUES SecDesOrient: 1257.00 -3.40 -10.00 0.00 133.82 SecOrient: 1256.97 -3.43 -10.03 -0.26 133.71 ---=== PROBLEMS IN DETAIL ===--- Problem #1 - Image secondary LN2 dewar overflow Around 05:15Z we started to switch to imaging. On pulling the imager cart out of the doghouse, we heard LN2 fill noises, then noticed the SE corner of the doghouse floor was frosted. We subsequently found that the pressure relief overflow pipe on the leading (east) 10L dewar was dribbling LN2 and the 180L fill hoses were heavily frosted. We tried rapping the valves on the top of the dewar to no effect. We soon realised the 180L dewar weight was dropping about 1lb/minute, and subsequntly found the trailing dewar's pressure relief overflow was releasing most of the LN2 being lost, so that both secondary dewars were continuously filling. We tried an IOP command 'cc startfillseq' to force the primary dewars to fill and relieve pressure on the secondary dewars. This halted the overflow only while the primary dewars filled, but it resumed right after the primaries turned off. We phoned Connie for advice. We checked the state of the camera with IOP 'cc ln2stat' and 'cc 1 tcheck' commands and found all well. We tried pressing the 'stop' button on the secondary dewar control box on the trailing (west) side of the imager. This did NOT stop the fill. We then turned off the 180L dewar and the overflows stopped and no gas vented from the secondary dewars. By this time, we estimate 70-100lb of LN2 had vented. As conditions at the time (~06:00Z) were photometric, we concluded that we could safely image with the 180L dewar off provided we turned it on every few hours to fill the 10L secondary dewars. We finished mounting the imager...just as clouds arrived forming ahead of a weather system coming from the south! Around 08:00Z, under Connie's advice, we turned on the 180L dewar again, and all seemed normal. Connie suspects a pop-off valve (is that right?) may have frozen up, and letting it thaw solved the problem. We continued to closely monitor the 180L dewar weight in TPM. That this all happened while the enclosure was off means we didn't get to test the enclosure oxygen deficiency hazard alarms with a real situation...yet. ---=== SPECTROGRAPH FOCUS AND COLLIMATION ADJUSTMENT ===--- Cartridge 9 Temp=9.9 C IDL> collimate, 14621 % Compiled module: COLLIMATE. Reading /data/spectro/52381/sdR-b1-00014621.fit Reading /data/spectro/52381/sdR-b1-00014622.fit COLLIMATE: Min offset = -0.85 pix COLLIMATE: Max offset = 0.22 pix COLLIMATE: Mean offset = -0.23 +/- 0.27 pix COLLIMATE: Camera b1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of 8.3 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-52381-b1-00014621.log PostScript file = Collimate-52381-b1-00014621.ps Reading /data/spectro/52381/sdR-b2-00014621.fit Reading /data/spectro/52381/sdR-b2-00014622.fit COLLIMATE: Min offset = -1.02 pix COLLIMATE: Max offset = -0.07 pix COLLIMATE: Mean offset = -0.49 +/- 0.26 pix COLLIMATE: Camera b2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of 17.6 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-52381-b2-00014621.log PostScript file = Collimate-52381-b2-00014621.ps Reading /data/spectro/52381/sdR-r1-00014621.fit Reading /data/spectro/52381/sdR-r1-00014622.fit COLLIMATE: Min offset = -0.09 pix COLLIMATE: Max offset = 0.96 pix COLLIMATE: Mean offset = 0.36 +/- 0.29 pix COLLIMATE: Camera r1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of -3279 steps for spectro-1 COLLIMATE: Issue SOP command: "sp1; mechPiston -3279" Log file = Collimate-52381-r1-00014621.log PostScript file = Collimate-52381-r1-00014621.ps Reading /data/spectro/52381/sdR-r2-00014621.fit Reading /data/spectro/52381/sdR-r2-00014622.fit COLLIMATE: Min offset = -0.23 pix COLLIMATE: Max offset = 0.78 pix COLLIMATE: Mean offset = 0.36 +/- 0.24 pix COLLIMATE: Camera r2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of -3283 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston -3283" Log file = Collimate-52381-r2-00014621.log PostScript file = Collimate-52381-r2-00014621.ps A focus adjustment was made. Mirror motor positions before adjustment: sp1> Coll_motor_A -2400 Coll_motor_B -2400 Coll_motor_C -2400 sp2> Coll_motor_A -1664 Coll_motor_B -1665 Coll_motor_C -1266 After adjustment: sp1> Coll_motor_A -5679 Coll_motor_B -5679 Coll_motor_C -5679 sp2> Coll_motor_A -4947 Coll_motor_B -4948 Coll_motor_C -4548 IDL> collimate, 14623 Reading /data/spectro/52381/sdR-b1-00014623.fit Reading /data/spectro/52381/sdR-b1-00014624.fit COLLIMATE: Min offset = -0.59 pix COLLIMATE: Max offset = 0.61 pix COLLIMATE: Mean offset = 0.05 +/- 0.27 pix COLLIMATE: Camera b1 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict blue camera ring movement of -1.9 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-52381-b1-00014623.log PostScript file = Collimate-52381-b1-00014623.ps Reading /data/spectro/52381/sdR-b2-00014623.fit Reading /data/spectro/52381/sdR-b2-00014624.fit COLLIMATE: Min offset = -0.71 pix COLLIMATE: Max offset = 0.17 pix COLLIMATE: Mean offset = -0.17 +/- 0.22 pix COLLIMATE: Camera b2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of 6.2 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-52381-b2-00014623.log PostScript file = Collimate-52381-b2-00014623.ps Reading /data/spectro/52381/sdR-r1-00014623.fit Reading /data/spectro/52381/sdR-r1-00014624.fit COLLIMATE: Min offset = -0.61 pix COLLIMATE: Max offset = 0.61 pix COLLIMATE: Mean offset = 0.05 +/- 0.26 pix COLLIMATE: Camera r1 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict (red) piston movement of -460 steps for spectro-1 COLLIMATE: Issue SOP command: "sp1; mechPiston -460" Log file = Collimate-52381-r1-00014623.log PostScript file = Collimate-52381-r1-00014623.ps Reading /data/spectro/52381/sdR-r2-00014623.fit Reading /data/spectro/52381/sdR-r2-00014624.fit COLLIMATE: Min offset = -0.42 pix COLLIMATE: Max offset = 0.57 pix COLLIMATE: Mean offset = 0.08 +/- 0.20 pix COLLIMATE: Camera r2 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict (red) piston movement of -753 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston -753" Log file = Collimate-52381-r2-00014623.log PostScript file = Collimate-52381-r2-00014623.ps All mean offsets are within the uncertainties, so I will stop here.