APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday March 29, 2005 (MJD 53459) ---=== OBSERVING TEAM ===--- John Barentine Jurek Krzesinski Mike Harvanek (swing) ---=== OBSERVING PLAN ===--- Shakedown and science. ---=== OBSERVING SUMMARY ===--- Obtained data for a new pointing model and partial data for imager calibration. We did not test the new iop with spectrographs and imager on the sky, so for tomorrow it still will be the iop test version used. Problems: We did not recoverd from DA problems (it's not loading the tapes) - left for the day crew. ion pump presure - that started when we closed the dome please keep an eye on it. ---=== OBSERVING LOG ===--- Afternoon: ---------- There was a backplane communications error upon the start of the imager test bias that killed the iop session. All 3 crates were rebooted. The servers also died and had to be restarted. Error details are in the Problems section. There was no spectro collimation check because the engineering camera was mounted. One of the grade 5 N2 bottles is getting low (less than 500). Night: ------ High winds and dust delayed ventilation. Since we cannot open in these conditions we started with Mamoru calibration. Encoder has been fixed during the day (thanks Jon). For the r QE test we set the slit width to 0.50mm, the lamp voltage to 20V, starting lambda to 600 and the initial xStage position to 23100. The hand-cranked stage position was 14650. MSP bias dewar 2 filter z and g doesn't look good on the display, run 5215 frame 2,3. Next we took a dark frame and z, g filter in dewar 2 were fine, so we got another bias, and z,g look bad again. So, it's something connected with the integration time and/or difference in readout/charge transfer? Frames copied into: /data/photo/doi/calibdata Run 5215 -------- bias: frames 2,3 dark: frames 4,5 We had to stop qe_r1 because we started it in the wrong directory where we didn't have proper qe_r.list files copied over. ctrl_C worked fine. We took a bias (run 5216) to see if everything is working. Then changed the directory into: /usrdevel/jurek/msp and started getQeCCD r 1, so: Run 5216 -------- QE r 1: frames 2-48 VME reported in watcher: dead (Frame=29 Row=2069: 2005-03-30 05:05:07Z) - the frame looked fine on the disk. Quality of images checked - all seems to be ok. Next we did the test of the u leak, using the syntax getUleakCCDs 3 6 for chips u3-u6. Slit width is 0.50mm, lamp voltage is 20 V, lambda set to 600, the initial xStage to 23100, and the position of the hand-cranked stage on the encoder was 9410. The run number is the same as before (i.e., we did not start a new run). Run 5216 -------- uLeak QE 3-6: frames 49-72 (incomplete data set; the last line in qe_u_leak3.list done before bailing out was 770nm for 30 s.) Quality of images on disk looks okay. We bailed out of getUleakCCDs at an inopportune time, as a read started, leaving the readout incomplete. After completing the pointing model, we checked that we could still talk to the imager by rebooting the photo/astro crates and commanding a bias from IOP (running the msp "test.tcl" script) with the command: goStareMsp 0 -init -flavor engineering -stripe "100,O" -comment "MSP bias". This worked fine. A bias from a normal IOP session also worked. We had an imager ion pump pressure events right at the end of the night after the DA came back to life (see Problems section). We were unable to mount the tapes after the reboot, and will leave this for the day crew. ---------------------------------------------- 06:20Z We opened the telescope. Eng cam mounted. Pointing Model -------------- Despite last night's results of good rough collimation, we found the system visibly out of collimation tonight on first opening, looking at OOF images on engCam. We suspected this was due to being out of thermal equilibrium (we did not ventilate during the first half of the night while the dust event was ongoing.) The best focus we could get just after we started was +1100, or about double the number from last night under similar ambient temperature conditions. While waiting for the telescope to equilibrate, we went down to the scope to check the aliveness of DIMM. While there, the wind speed picked up rather quickly until gusts peaked above 40 MPH. We closed both the DIMM and the 2.5m and went back to Mamoru's imager calibrations. After 9:30Z the winds becagn to drop. We were open again at 09:45Z. Now, with the telescope reasonably equilibrated, rough collimation again looks good, but focus has changed significantly. Best focus was at 550, with FWHMs on the order of 6 pixels. We took data for a 72-point model and settled on a fit with an RMS error of 2.5 arcseconds. The pointing model ended with minutes to spare before the start of twilight. The need for a pointing model, given our limited on-sky time this shakedown, meant that we did not get to test the new version of IOP with either the spectrographs or imager on the sky. endNight was run on the cloudy night tapes and rejoiced. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 5214 23:59Z 00:17Z 100 O -103.41 -99.12 43 ignore 5218 12:07Z 12:17Z 100 O 78.92 81.58 31 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): n/a QA Procedures Done (y/n): n/a UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 31572, plate -9999 ------- 23:38 31572 0.0 bias 00:58 31573 0.0 bias ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL Stays: JL ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 23:24Z 37 13 26 254 (WSW) 3628 - MstlyClr 23:56Z 37 12 15 252 (WSW) 4095 - MstlyClr 00:26Z 37 14 31 263 (W) 3220 - Clear 00:57Z 35 12 30 267 (W) 5108 - Clear 01:21Z 33 12 23 250 (WSW) 7967 - Clear 01:53Z 32 12 23 267 (W) 4669 - Clear 02:25Z 31 12 21 262 (W) 3458 - Clear 02:59Z 31 11 14 258 (WSW) 2608 - Clear 03:30Z 30 11 21 242 (WSW) 3094 - Clear 04:06Z 30 11 32 278 (W) 4641 - Clear 04:39Z 30 12 26 241 (WSW) 2398 - Clear 05:11Z 29 13 20 260 (W) 2008 - PtlyCldy 05:43Z 29 12 23 267 (W) 1485 - PtlyCldy 06:20Z 29 9 14 270 (W) 1251 - PtlyCldy 06:52Z 29 11 20 281 (W) 1167 - PtlyCldy 07:24Z 29 7 27 290 (WNW) 1231 - MstlyClr 07:56Z 29 8 36 285 (WNW) 910 - MstlyClr 08:45Z 29 7 25 287 (WNW) 801 - Clear 09:17Z 28 9 17 298 (WNW) 865 - Clear 09:49Z 27 7 21 306 (NW) 868 - Clear 10:22Z 27 7 22 286 (WNW) 837 - Clear 10:54Z 27 7 19 275 (W) 934 - Clear 11:26Z 26 8 17 304 (NW) 896 - PtlyCldy 12:00Z 26 8 16 284 (WNW) 869 - PtlyCldy 12:32Z 26 9 15 297 (WNW) 917 - ---=== TELESCOPE STATUS ===--- 06:20Z Telescope opened, spectro dewars refilled, fans on, louvers open 07:30Z Enclosure on 09:45Z Enclosure off 11:45Z Enclosure on, fans off, louvers closed Telescope parked at 121,30 with the enginnering camera mounted Counterweights at 120 Spectro autofill reconnected No interlocks bypassed Dewar weights at 12:00Z Imager: 192lbs 22psi Spectro: 268lbs 17psi ---=== SOFTWARE USED ===--- IOP/SOP: v3_143_1 Watcher: v2_30_0 MCP: v5_26_0 TPM: tpm_v2_47_0 AstroDa: v14_47 TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: v1_98 SoS: v4_10_7 hoggPT: v1_6_9 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.5740 0.5770 Axial B 0.5870 0.5880 Axial C 0.9440 0.9460 Trans D -8.1970 -8.1960 Lateral E 10.0203 10.0330 Lateral F 11.5951 11.5951 GALILS Commanded: 4300. -1900. 2850. -13300. -7600. -7650. Actual: 4300. -1900. 2850. -13300. -7600. -7650. SETMIR VALUES PriDesOrient: 0.00 4.57 1.18 64.25 -249.76 PriOrient: 0.00 4.56 0.88 65.00 -249.58 SECONDARY: ---------- Focus: 0.00 Air Temp.: 2.9 Alt.: 29.713109 MIGS TONIGHT NOMINAL Axial A 1.5690 1.5680 Axial B 1.0460 1.0460 Axial C 1.1630 1.1590 Trans D -0.2000 -0.2020 GALILS Commanded: 1619057. 1604833. 1528443. -13800. -9950. Actual: 1619188. 1604973. 1528571. -13820. -9964. SETMIR VALUES SecDesOrient: 1257.00 27.97 -10.00 -90.00 257.89 SecOrient: 1256.90 27.96 -10.00 -89.94 257.50 ---=== PROBLEMS IN DETAIL ===--- Backplane communications error: ------------------------------- im> goDrift -bias 2005-03-29 23:42:56Z: No heartbeat found from ad1 in last 500 of murmur log 2005-03-29 23:42:56Z: 2005-03-29 23:42:56Z: Murmur not working for all ad1 node - Losing information!! 2005-03-29 23:42:56Z: No heartbeat found from ad2 in last 500 of murmur log 2005-03-29 23:42:56Z: 2005-03-29 23:42:56Z: Murmur not working for all ad2 node - Losing information!! 2005-03-29 23:42:56Z: No heartbeat found from ad3 in last 500 of murmur log 2005-03-29 23:42:56Z: 2005-03-29 23:42:56Z: Murmur not working for all ad3 node - Losing information!! 2005-03-29 23:42:57Z: No heartbeat found from ad4 in last 500 of murmur log 2005-03-29 23:42:57Z: 2005-03-29 23:42:57Z: Murmur not working for all ad4 node - Losing information!! Access to shared data area at 0x18000000 lost (errno=0x3e Timer expired) Read failed from PT icc30 CSB=0x00000000 rmt=0x18095D20 cnt=0x00000004 ******************************************************************************** * * * Backplane communications between the ICC/OAC are no longer possible. * * * * Perform the following steps until operations are possible. * * * * 1. Check connections between the machines. * * 2. Reboot (reset) the ICC. * * 3. Restart this (OAC) program. * * 4. Reset the local PT-VME940 (ptvmeMode -R). * * 5. Power-cycle the VMEbus crates. * * 6. Reboot the local machine (host). * * * ******************************************************************************** Ion Pump Pressure Event ----------------------- Shortly after rebotting the photo and astro crates, we had an ion pump critical error starting near 12:00Z. We monitored the pressure through a series of cc imstat's; it crested around a value of 2.7 microtorr.