APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Friday January 18, 2002 (MJD 52293) ---=== OBSERVING TEAM ===--- Atsuko Nitta Jurek Krzesinski (King of Soup) French Hercules (audience, nothing broke. He was keeping his eyes on everything.) Peregrine McGehee (LANL) ---=== OBSERVING PLAN ===--- Science! ---=== OBSERVING SUMMARY ===--- It was clear but we had poor (most of the time 2.5--3"or worse) seeing all night long. Accomplishment of the Night: some useful exposure on plate 807 (cart4) and plate 525 (cart5). finished plate 830 (cart7) Problems of the Night: 1. sop froze. 2.Actuator A became slow and we had to home the mirror several times. 3. ptvme(?) problem same as last night where we had to do "ptvmeMode -R" and wait for a long time before we could do anything. 4. The obvious ptvme problem, again same as last night, killing sop session and servers. Between the actuator A problem and the ptvme problem, we got nothing on plate 561 (cart8) because we ran out of observing time by the time we recovered. Soup of the Night: Polish soup called "Zurek soup" made by Jurek ---=== OBSERVING LOG ===--- Afternoon checkout ok. 00:55 telescope opened, cart 4 plt 807 mounted. Guide stars on gotoField Clouds moved in during the 1st exposure. We refocused and waited for the clouds to thin before we started the second. The second exposure on showed good S/N on the blue cameras, but 1/4 of that in red cameras. We also had lots of red monster and scattered light messages probably due to the moonlight. This plate is not done. We only have S/N^2 of 8.8 in r2. 04:45 Jurek's SOP froze right after instrument change while setting up the telescope. He had to get out of sop and restart it again. The guiders were all there on the first gotoField. The second plate of the night is cart 7 plt 830. 04:55 Atsuko filled the cloud camera. Please see image at "21:55" if you want to know what Atsuko looks like in IR. 05:57 During the second science exposure, we changed the focus and the some of the stars moved to the edge of the fibers. The actual and commanded position for Actuator A were off. So we issued the "set focus" commands to give the actuator a push. We also noticed that the actuator A were about 30000 counts off in GALIL units. This is probably ok, but were not too sure( The mirror position at stow says that A and B are about 30000 counts off in GALIL so it is probably ok). After the exposure ended, we homed the secondary to be on the safe side. When we restarted the collimation, we saw the actuator A still off around 30000 counts comapred to B and C, so we rehomed it again, but the 30000 counts offset were still there, so we decided that this must be a feature. We then started a new science exposure. The second science exposure has half of the S/N compared to the first exposure and did not make it to the minimum S/N^2 of 2 on r2. THe third and forth exposures went fine and we finished this plate. 08:12 Cart 6 plt 327. Jurek's saoDisplay did not update guider images. He dropped instrument, quit startMon. When he tried to restart startMon, then he got message about it is not possible to display all fibers. So he restarted with simple startMon. We found no guide stars and so we went to fk5. Jurek spotted some faint light on the edge of fiber 10. We also found that there was a too large to correct fiducial message during the slew to the field (see problem section). 08:30 After getting all the stars in fibers, Jurek did a scaleChange and actuator A lagged behind. The air temperature was -5.6C. Jurek did many "enable proc collimate" to hurry along the actuator A. When actuator A finally got there and all guide stars showed up, Jurek found that he needed to do more scaleChange. Since it took several minutes to get actuator A to its desired position, Jurek decided to home the secondary again so that actuator A will behave for a while. Jurek had to issue homing commands four times before the actuators actually homed. Since it was about 5 hrs since the last feeding of the cloud camera, Atsuko fed the cloud camera again -- this time before the cloud camera image told us it was out of LN2. 09:45 We expected the exporsure to end by now, but we never saw the exposure being read out. "exposrureRem" said there was no exposure going on. When Jurek tried to pause the exposure, no error message. We also noticed that Jurek's sop sesisn no longer "grab" the instrument. Jurek could not resume or pause the exposure (please see problem section for the error message he got). The spectrographs shutters were still open. The servers were still running fine. All this indicates the same problem we saw last night --which we *think* is ptvme problem because this is very similar to what Jurek and Scot encounter as ptvme problem when doing the imager calibration. But from the emails today, I don't know what the verdict is. A quick look at the murmur log didn't give me much insight because I am not sure what I am looking for. Jurek got out of the sop session and did "ptvmeMode -R" serveral times and then we waited for 10 min or so. By the time we were able to successfully take bias, the plate was close to its end of observing time. We put this plate thinking we will finish it with one exposure, since it already had some previous exposures, but we ended up not getting anything! 10:55 cart 5 plt 525. Despite of the to large to correct fiducial error, we found guide stars upon gotoField. But again when we tried to scaleChange, actuatorA was slow. So we rehomed again. Then back to normal operation. 12:08 The ptvme failure right when sop was ready to readout the science exposure. This time it was OBVIOUSLY ptvme error since Jurek's sop session died and he got the familiar ptvme error message. The servers were gone as well. The message Jurek got is in the problem section. The "ptvmeMode -R" got us back to business wihtout waiting for 10min (which is different from the ptvme-like problem). By the time we recovered, we only had time for one 15min exposure. 13:00 Closed enclosure. endNight ran successfully. ---=== IMAGING RUN SUMMARY ===--- Run Stripe Flavor Lambda Last Begin End Frame Comments ------------------------------------------------------------------ 2893 100 O ignore -182.74 -178.88 40 ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot --------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields nGood rowMean rowSig colMean colSig rot --------------------------------------------------------------- ---=== SPECTROSCOPY DATA SUMMARY ===--- UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 12706, plate -9999 ------- 23:21 12706 0.0 bias 23:26 12707 0.0 bias 23:29 12708 0.0 bias ----- sequence 12709, plate 807 ------- 01:47 12709 10.0 flat 01:50 12710 2.0 arc 02:23 12711 1800.0 target 03:09 12712 1800.0 target 03:44 12713 1801.0 target 04:17 12714 1800.0 target 04:23 12715 240.0 smear 04:26 12716 10.0 flat 04:28 12717 2.0 arc ----- sequence 12718, plate -9999 ------- 04:46 12718 0.0 bias ----- sequence 12719, plate 830 ------- 05:08 12719 10.0 flat 05:10 12720 2.0 arc 05:43 12721 1800.0 target 06:16 12722 1800.0 target 07:16 12723 1801.0 target 07:50 12724 1800.0 target 07:57 12725 240.0 smear 08:00 12726 10.0 flat 08:02 12727 2.0 arc ----- sequence 12728, plate 327 ------- 09:09 12728 10.0 flat 09:12 12729 2.0 arc ----- sequence 12730, plate -9999 ------- 10:24 12730 0.0 bias ----- sequence 12731, plate 327 ------- 10:38 12731 301.0 target ----- sequence 12732, plate 525 ------- 11:25 12732 10.0 flat 11:27 12733 2.0 arc ----- sequence 12734, plate -9999 ------- 12:18 12734 0.0 bias ----- sequence 12735, plate 525 ------- 12:44 12735 901.0 target 12:52 12736 240.0 smear 12:55 12737 10.0 flat 12:58 12738 2.0 arc ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument getclock Az Alt Rot Scale ------------------------------------------------------------------------------ 19:25 4 807 1011407117 0.004961 0.000798 -0.008465 1.000000 22:12 7 830 1011417128 0.002600 -0.001003 -0.028843 1.000160 05:34 5 525 1011443683 0.002020 -0.000151 -0.016068 0.999990 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL4954 Stays: JL4955 ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 19:38 4 807 1.00000 0 1363 200 -18 55.9 -2.0 17 246 2.5 22:12 7 830 1.00016 -1579 -67 75 117 55.1 -3.7 8 279 2.7 03:28 6 327 0.99987 1283 2329 100 6 54.6 -4.9 3 11 3.0 05:34 5 525 0.99999 99 1136 -100 -7 59.3 -2.3 17 324 2.6 ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 16:18 32 14 26 257 (WSW) 1718 - 16:48 32 11 14 254 (WSW) 2251 - 17:18 33 5 21 266 (W) 1018 - 17:48 32 4 20 263 (W) 1344 - 18:20 31 0 17 267 (W) 1026 - 18:50 30 1 15 252 (WSW) 1002 - 19:21 28 4 17 247 (WSW) 823 - 19:51 28 0 7 271 (W) 789 - 20:22 27 -1 13 260 (W) 570 - 20:53 27 -1 13 269 (W) 755 - 21:24 27 -1 10 273 (W) 686 - 21:54 26 0 14 271 (W) 889 - 22:25 24 0 17 292 (WNW) 636 - 22:56 24 -3 16 294 (WNW) 518 - 23:27 25 -5 17 325 (NW) 954 - 23:57 24 -3 14 354 (NNW) 914 - 00:30 23 -1 7 23 (NNE) 901 - 01:02 22 0 20 15 (NNE) 354 - 01:33 22 -1 21 18 (NNE) 251 - 02:05 21 -3 17 5 (N) 192 - 02:37 20 -4 13 12 (NNE) 209 - 03:10 21 -6 15 2 (N) 188 - 03:40 23 -10 8 357 (NNW) 145 - 04:10 24 -17 8 351 (NNW) 114 - 04:43 25 -20 11 329 (NNW) 94 - 05:16 27 -25 9 355 (NNW) 77 - 05:48 28 -29 13 347 (NNW) 57 - 06:20 27 -29 12 347 (NNW) 39 - ---=== TELESCOPE STATUS ===--- 00:55 telescope opened, (fans on for half an hour already). 16:00 telescope inside the enclosure. fans off. telescope with autofill connected. cart 8 mounted. spectro dewar@260 imager dewar@284 ---=== SOFTWARE USED ===--- IOP/SOP: v3_64_3c Watcher: v2_13_2a MCP: v5_8_7 TPM: v2_4_5 AstroDa: v14_40 TCC:2.5.5 sdssProcedures: 1_37 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.0740 0.0750 Axial B 0.8060 0.8020 Axial C 0.0720 0.0710 Trans D -1.4980 -1.4860 Lateral E 1.8240 1.8540 Lateral F 1.4110 1.4240 GALILS Commanded: 5400. -3700. 900. -200. 31550. 30650. Actual: 5400. -3700. 900. -200. 31550. 30650. SETMIR VALUES PriDesOrient: 0.00 -11.80 23.00 1256.90 642.10 PriOrient: 0.00 -12.16 22.81 1257.41 642.19 SECONDARY: ---------- Focus: 0.00 Air Temp.: 0.5 Alt.: 29.988508 MIGS TONIGHT NOMINAL Axial A 1.5460 1.5500 Axial B 1.2230 1.2260 Axial C 1.2460 1.2480 Trans D 0.2080 0.2320 GALILS Commanded: 1599662. 1565281. 1586370. -10395. -9766. Actual: 1599620. 1565254. 1586350. -10395. -9766. SETMIR VALUES SecDesOrient: 1257.00 -3.40 -10.00 0.00 133.82 SecOrient: 1257.02 -3.40 -10.01 0.00 133.82 ---=== PROBLEMS IN DETAIL ===--- azimuth (correction for azimuth 201120 is too large (Jan 19 01:07:44): Jan 19 01:07:56 MST ) azimuth (correction for azimuth 198809 is too large (Jan 19 03:47:13): Jan 19 03:47:21 MST ) Error message from sop when we had yet another ptvme (?) problem ==================================================================== sp1> SOPGUI: pauseStare appending PAUSE Exposure has been paused end stare is still scheduled, but time should stay fixed sp1> SOPGUI: resumeStare 1800 Changing exposure time to 1800 seconds appending ALTER stack Trace for Error ..................... can't read "scheduled(wait_for_endStare)": no such element in array while executing "proc_atexit schedule wait_for_endStare $scheduled(wait_for_endStare)..." (procedure "resumeStare" line 29) invoked from within "resumeStare $opt" (procedure "GUIresumeStare" line 16) invoked from within "GUIresumeStare $GUIresumeOpt" invoked from within ".expgui.resumestare.button invoke" ("uplevel" body line 1) invoked from within "uplevel #0 [list $w invoke]" invoked from within "if {($w == $tkPriv(window)) && ([$w cget -state] != "disabled")} { uplevel #0 [list $w invoke] }" invoked from within "if {$w == $tkPriv(buttonWindow)} { set tkPriv(buttonWindow) "" $w config -relief $tkPriv(relief) if {($w == $tkPriv(window)) && ([$w cget -state] ..." (procedure "tkButtonUp" line 3) invoked from within "tkButtonUp .expgui.resumestare.button" (command bound to event) .............................................................. sp1> also we see this message: Exposure is Paused, this is camHandler running Exposure is Paused, this is daHandler running sp1> SOPGUI: eval goStare 0 -bias -init -plateId -9999 Sat Jan 19 03:10:32 MST 2002: There is an ongoing exposure on sp1. sp1> exposureRem No exposure is in progress 0 the obvious ptvme problem and the error message acssociated with it ====================================================================== when endStare begun to read the immage we've got: ----------------------- GOOD GOOD GOOD GOOD GOOD GOOD GOOD GOOD GOOD GOOD GOOD 163 Offset telescope 0.141 (arcsec E) -0.093 (arcsec N) 0.6 (arcsec phi) =====endStare: beginning read out ============================= Access to shared data area at 0x18000000 lost (errno=0x10 Resource busy) Read failed from PT icc40 CSB=0x00000000 rmt=0x18000000 cnt=0x0009ABE8 ******************************************************************************* * * Backplane communications between the ICC/OAC are no longer possible. * * Perform the following steps until operations are possible. * * 1. Check connections between the machines. * 2. Reboot (reset) the ICC. * 3. Restart this (OAC) program. * 4. Reset the local PT-VME940 (ptvmeMode -R). * 5. Power-cycle the VMEbus crates. * 6. Reboot the local machine (host). * *******************************************************************************