APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Wednesday August 22, 2001 (MJD 52144) ---=== OBSERVING TEAM ===--- Daniel Long Scot Kleinman Mike Harvanek (swing) ---=== OBSERVING PLAN ===--- Science! ---=== OBSERVING SUMMARY ===--- We finished plate 627 of last night. Got an imaging run through a UCAC field and imaged strip 76 S with seeing as good as 0.72"! We had trouble getting skippy to give us meaningful results, though. We also had trouble with gang transfers - they stopped at frame 157 (run 2507) despite our best efforts to get them to resume. We eventually got them to come back by reboting the crates three (3) times. During closing, we noticed the murmur tLatch display showing the alt axis as some 12000 ticks (almost 3') off. The was coroborrated by the locking pin not going in when the telescope thought it was at 90deg. This may mean our beautiful, best seeing ever, first imaging run in months, is a beautiful, great seeing set of data of no particular stripe whatsoever. ---=== OBSERVING LOG ===--- The night actually started out clear, but with the moon up, we started with spectroscopy: Cart 1 plate 627. Right after opening the building, we went to move the telescope up and found the MCP unresponsive - we could not even connect to it via telnet. We rebooted it and all was well. Today, Dan is driving on his machine while Scot is operating Landru in multi-screen mode, but with a DIFFERENT Xserver than previously. Earlier in the evening, he got the old Xserver to die within 10 minutes of logging in. The new Xserver runs a different instance of the window manager in each screen and does not allow for dragging of windows across screens. But it does mean any window that pops up from another window will be on the same screen as the parent. We'll run with this and see if the X crashes go away. (Most of the time, btw, the "crashes" means the Xsession dies and we are returned to the Xdm login prompt - although more severe crashes have also been experienced.) Cart 1 - plate 627 required a 15" E offset to find guide stars. We were running with the 72 point pointing model. Dan recommends running with this model and applying a 15" E offset if you can't find stars. Last night, the same plate with the same pointing model found the stars right away. What'sup with that? We did reboot the MCP today, though. Combined with last night's data, plate 627 was finished in two exposures and we had about an hour to go before the moon went down. Since it was still clear (and seeing still excellent), we decided to use this time to switch instruments so the moon would be down by the time the imager were ready. If we beat the clouds, we could always do an astrometric calibration scan. We did beat the clouds and our top priority strips did not have UCAC coverage, so we decided to set up on a FASTT field (field N) for initial setup and our needed astrometric calibration scan. Dan checked collimation for out of focus donuts and they looked good. In focus, we got seeing as good as 0.78"! Focus value was about -485. Clouds came in shortly thereafter and the seeing got worse. Sigh. At least the imager appeared to be working.... Skippy run during this scan from the logTool apparently failed in astrom, but skippy run "by hand" worked fine (the nuErr was ~5"). You can look at the astrom murmur output to debug things.... At 22:41, the TCC axes "halted for a problem" (according to the watcher). Other errors from the watcher were: Modu="prt Read" (Aug 22 22:40:52 MDT) Modu="axe o Move" (Aug 22 22:40:52 MDT) Modu="axe i SchMove" (Aug 22 22:40:52 MDT) Modu="exe Track" (Aug 22 22:40:52 MDT) Modu="prt ReadMatch" (Aug 22 22:40:52 MDT) At this point, our FASTT field was 2 hours over, so we went to FAST field O. (The clouds were also thickening - they came in just as we mounted the imager - of course....) The clouds and seeing improved shortly thereafter (by around 23:00). We got enought FASTT field data by 23:45 and went off to our first science scan (!!) - stripe 76 S - starting at lambda=133 (science to start by 139). No large focus changes or telescope offsets were needed, so all this run contains good data. (This is run 2507.) At this point, though, seeing was marginal. It later became quite good! Skippy had a hard time (never did) finding enough stars in this scan to get accurate results. skyGang was of no help as it revealed no catalog stars (unless it was showing no real stars, but it claimed to find several hundred, so that seems unlikely - at any rate only red objects were shown). ltMatch revealed our rotator position was OK, but we have no info on nu. Skippy occasionally ran and gave us 4 stars with OK results. This was not terribly re-assuring, though. We tried to use the old method of finding where we were, but could not get anything to work - it complaining about not finding the right catalog file, etc. It looks like the teamster may have died around 01:50 as we got a lot of no gang transfer errors. A teamster -force was accepted OK and seemed to work. We then noticed that the gangs had stopped sowing up again. We continued to get "no gang transfer" watcher errors, so we re-started a teamster again! However, this did not seem to solve the problem. We saw no new gangs transferred. We stared the teamster again (hey - who knows what else to do?). This did not seem to help the situation, though. poolDir showed many gangs with flags g and c set- presumably (?) for gang and complete. ad1 gangs prior to frame 157 also had the a (archived) flag set, presumably because they have been transferred successfully to Unix, but frames after 157 did not have the a flag set (consistent with us not getting any gangs since then). id1 showed all the gangs with flags gca set - presumably because these gangs are archived to tape. We ran gangs2Unix 1 in an attempt to get the gangs over ourselves. Nothing happened, but the murmur log was giving us messages like: Aug 23 03:13:09 sdsshost TMS 163469 TEXTONLY Wainting for command response from id5 (crate 2, ICC 1), data server (client 1) We could find no other problems with id5. A few small clouds appeared to the North around 02:30. By 02:40, clouds started apearing more in the W. It looks like we cleared our end lambda just as clouds began encroaching a bit to close for our liking. The last couple frames may be contaminated by clouds - certainly by frame 336, we had clouds. We ended the run at lambda=-177, frame 339. We grepped the murmur log and found some intriguing error messages which seemed to indicate the DA lost the ability to write to sdsshost's shared memory. Knowing endNight would fail miserably if this wasn't fixed, we decided to let the normal archiving finish and reboot the crates to see if the connection was re-established. After 3 reboots, things worked. The error messages we found (by doing a grep TMS on the murmur log) are in the problems section below. Clouds remained so we closed, then noting at the MCP laptop's tLatch murmur window that the alt axis was some 12000 ticks off. This amounts to almost 3' and was confirmed when the locking pin did not go in when the telescope thought it was at 90deg. Looking at the murmur log, we see this error first occurred around 21:34 - just when we went to instChange from spectroscopy to imaging. The previous alt fiducial crossing as we slewed to our spectroscopic field was OK. We did set the fiducials and verified things worked) at the beginning of the night, but alas, were not watching the tLatch murmur messages while we observed. Shouldn't the watcher have shown us some "correction too large" error or something? We do not remember seeing such errors. While we were endNighting, we got a critical error on sp1 exec micro. We did an iack and it went away. What happened to sp1? endNight is running successfully as I finish this log. This was my first night with logTool and I was actually quite impressed. The main problems were: 1) cutting and pasting was haphazard at best- sometimes it worked, other time it didn't - I could not figure out why or how (running fvwm2). 2) the scroll bars shapes are misleading and sometimes not easy to control precisely 3) I exited the IOP that I called logTool from and it killed my logTool, losing some of my recent edits. Yes, I should not have done that, but it should not have done that either. 4) it would be nice to be able to insert text from an arbitrary external file. (I know all of these things are already known about.) But- in general, I found it fairly easy and straight-forward to use, but the cut/paste problems are huge. Editing is a bit of a nuisance in tk's editor, but it's workable. Is it possible, say, to run VI in a TK text widget? I also ran all night with a new Xserver on Landru- the XiGraphics commercial server instead of the XFree86 server we were running. I crashed XFree86 within 10 minutes of logging in earlier tonight- XiG lasted all night without problem. (It's a slightly different interface, but one we can use effectively, I think.) Hopefully, this will fix our Landru troubles. ---=== IMAGING RUN SUMMARY ===--- Run Stripe Flavor Lambda Last Begin End Frame Comments ------------------------------------------------------------------ 2504 100 O ignore 30.88 41.13 82 2505 10 O ignore 86.83 135.39 84 FASTT field N 2506 10 O calibration 134.47 147.71 101 FASTT field O 2507 76 S science 133.34 -176.66 347 Bad telescope pointing? ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot --------------------------------------------------------------- 2507 16 10 4 -0.800 1.486 -2.700 3.272 0.04634 2507 37 4 2 -3.700 0.000 -1.800 0.000 0.05177 2507 106 4 4 10.100 0.740 1.700 1.600 -0.07973 2507 153 4 2 -9.600 0.000 5.000 0.000 0.03446 2507 153 4 2 -9.600 0.000 5.000 0.000 0.03446 2507 153 4 2 -9.600 0.000 5.000 0.000 0.03446 ---=== LTMATCH RESULTS ===--- Run Field nFields nGood rowMean rowSig colMean colSig rot --------------------------------------------------------------- 2506 34 1 52 4.860 4.869 2.867 4.869 -0.00964 2506 34 1 61 3.476 3.487 2.764 3.487 -0.00929 2506 34 1 57 1.887 1.917 2.804 1.917 -0.00943 2506 34 1 46 0.405 0.479 2.801 0.479 -0.00942 2506 34 1 42 -1.215 1.260 3.153 1.260 -0.01060 2506 36 1 59 4.934 4.945 2.793 4.945 -0.00939 2506 36 1 42 3.373 3.390 2.991 3.390 -0.01006 2506 36 1 40 1.802 1.821 2.829 1.821 -0.00951 2506 36 1 33 0.277 0.439 2.602 0.439 -0.00875 2506 36 1 37 -1.079 1.107 2.433 1.107 -0.00818 2507 19 1 49 -2.301 2.317 -3.132 2.317 0.01053 2507 19 1 41 -2.324 2.335 -3.631 2.335 0.01221 2507 19 1 34 -1.835 1.876 -4.124 1.876 0.01387 2507 19 1 43 -1.920 1.952 -2.821 1.952 0.00949 2507 19 1 59 -2.079 2.097 -2.598 2.097 0.00873 2507 48 1 44 -2.311 2.317 -2.991 2.317 0.01006 2507 48 1 61 -2.221 2.251 -3.138 2.251 0.01055 2507 48 1 57 -2.078 2.094 -3.173 2.094 0.01067 2507 48 1 51 -1.921 1.934 -2.928 1.934 0.00984 2507 48 1 46 -2.059 2.072 -3.064 2.072 0.01030 2507 116 1 50 -3.178 3.182 -4.399 3.182 0.01479 2507 116 1 37 -3.080 3.082 -4.403 3.082 0.01480 2507 116 1 35 -3.024 3.027 -4.303 3.027 0.01447 2507 116 1 44 -3.065 3.067 -4.407 3.067 0.01482 2507 116 1 48 -3.056 3.059 -4.405 3.059 0.01481 2507 146 1 26 -3.225 3.230 -4.118 3.230 0.01385 2507 146 1 27 -3.161 3.164 -4.277 3.164 0.01438 2507 146 1 36 -3.320 3.321 -4.137 3.321 0.01391 2507 146 1 36 -3.390 3.392 -3.978 3.392 0.01337 2507 146 1 38 -3.306 3.308 -3.979 3.308 0.01338 2507 146 1 26 -3.225 3.230 -4.118 3.230 0.01385 2507 146 1 27 -3.161 3.164 -4.277 3.164 0.01438 2507 146 1 36 -3.320 3.321 -4.137 3.321 0.01391 2507 146 1 36 -3.390 3.392 -3.978 3.392 0.01337 2507 146 1 38 -3.306 3.308 -3.979 3.308 0.01338 2507 146 1 26 -3.225 3.230 -4.118 3.230 0.01385 2507 146 1 27 -3.161 3.164 -4.277 3.164 0.01438 2507 146 1 36 -3.320 3.321 -4.137 3.321 0.01391 2507 146 1 36 -3.390 3.392 -3.978 3.392 0.01337 2507 146 1 38 -3.306 3.308 -3.979 3.308 0.01338 2507 146 1 26 -3.225 3.230 -4.118 3.230 0.01385 2507 146 1 27 -3.161 3.164 -4.277 3.164 0.01438 2507 146 1 36 -3.320 3.321 -4.137 3.321 0.01391 2507 146 1 36 -3.390 3.392 -3.978 3.392 0.01337 2507 146 1 38 -3.306 3.308 -3.979 3.308 0.01338 ---=== SPECTROSCOPY DATA SUMMARY ===--- UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 Cartridge 1 - Plate 627 ----- sequence 10635, plate 627 ------- 23:42 10635 0.0 bias {{}} ----- sequence 10635, plate 627 ------- 23:42 10635 0.0 bias {{}} ----- sequence 10635, plate 627 ------- 23:42 10635 0.0 bias {{}} ----- sequence 10635, plate 627 ------- 23:42 10635 0.0 bias {{}} ----- sequence 10636, plate 627 ------- 02:40 10637 10.0 flat pre-flat ----- sequence 10636, plate 627 ------- 02:40 10637 10.0 flat pre-flat ----- sequence 10636, plate 627 ------- 02:40 10637 10.0 flat pre-flat ----- sequence 10636, plate 627 ------- 02:40 10637 10.0 flat pre-flat 02:42 10638 2.0 arc pre-arc 03:05 10639 900.0 target science 03:23 10640 900.0 target science 03:32 10641 240.0 smear {{Smear Pattern}} ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument getclock Az Alt Rot Scale ------------------------------------------------------------------------------ 20:35 c1:pl627 998534158 -0.005920 0.002627 0.000000 1.000000 23:26 imager 998544383 -0.005920 0.002627 -0.020000 1.000000 00:05 imager 998546740 -0.005920 0.002627 -0.020000 1.000000 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL4274 - JL4279 JL4301 Stays: JL4280 - JL4285 JL4300 ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 20:35 spectro 1.00000 0 919 -210 216 71.6 16.5 9 270 gdr 1" 22:17 imager 1.00000 0 -714 -482 -27 54.2 16.5 6 264 23 -i' 0.78" 23:11 imager 1.00000 0 -709 -483 34 52.1 16.3 9 272 23-i' 0.89 00:05 imager 1.00000 0 -749 -485 11 67.7 16.1 12 293 00:23 imager 1.00000 0 -743 -477 12 68.5 15.9 12 301 23-i' 0.82 01:31 imager 1.00000 0 -754 -484 14 70.6 15.8 7 308 23-i' 0.92 02:31 imager 1.00000 0 -755 -484 16 71.4 15.6 8 336 23-i' ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 17:27 70 37 10 265 (W) 383 - 17:59 64 38 5 252 (WSW) 410 - 18:31 67 37 12 295 (WNW) 370 - 20:32 62 36 6 269 (W) 382 - 21:03 59 37 7 242 (WSW) 398 - 21:36 58 37 6 265 (W) 426 - 22:09 58 36 7 267 (W) 398 - 22:41 58 36 8 266 (W) 382 - 23:13 61 35 7 273 (W) 352 - 23:43 61 35 6 277 (W) 430 - 00:14 60 35 10 291 (WNW) 396 - 00:45 60 35 10 318 (NW) 377 - 01:18 60 35 8 318 (NW) 409 - 01:50 60 36 10 301 (WNW) 368 - 02:22 59 36 6 344 (NNW) 426 - 02:54 59 36 6 326 (NW) 381 - 03:25 59 36 6 343 (NNW) 350 - ---=== TELESCOPE STATUS ===--- ---=== SOFTWARE USED ===--- IOP/SOP: v3_53_7 Watcher: v2_9_0 MCP: v5_3_1 TPM: v2_4_1 AstroDa: v14_36 TCC: 2.5.5 sdssProcedures 1_22 tccMon: v1_6 SoS: v4_7_6 (on sos) ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0730 0.0710 Axial B: -0.0870 -0.0980 Axial C: 0.0650 0.0610 Trans D: 4.1860 4.1800 Lateral E: 1.9330 1.9365 Lateral F: 0.4340 0.4370 GALILS Commanded: 5400. -3700. 900. -200. 31550. 30650. Actual: 5400. -3700. 900. -200. 31550. 30650. SETMIR VALUES primDesOrient: 0.00 -11.80 23.00 1256.90 642.10 primOrient: 0.00 -12.16 22.81 1257.41 642.19 SECONDARY: ---------- Focus: 0.0 Air temp: 19.4 C Altitude: 30.09 MIGS TONIGHT NOMINAL Axial A: -1.2940 -1.2900 Axial B: -1.3020 -1.3150 Axial C: -1.3130 -1.3060 Trans D: 0.1340 0.1890 GALILS Commanded: 1583850. 1583850. 1583850. 2600. 3800. Actual: 1583863. 1583863. 1583857. 2600. 3800. SETMIR VALUES secDesOrient: 1257.00 0.00 0.00 0.00 -175.00 secOrient: 1257.02 0.00 0.00 0.00 -175.12 ---=== PROBLEMS IN DETAIL ===--- Teamster and Gang Transfers --------------------------- 2507 157.0 /data/astro/52144/2507/idGang-002507-r6-0157.fit Aug 23 02:02:45 sdsshost TMS 168666 TEXTONLY Gangs transfer: ad2 2507 158.0 /data/astro/52144/2507/idGang-002507-r7-0158.fit Aug 23 02:02:45 sdsshost TMS 168666 TEXTONLY Gangs transfer: ad3 2507 157.0 /data/astro/52144/2507/idGang-002507-r8-0157.fit Aug 23 02:02:45 sdsshost TMS 168666 TEXTONLY Gangs transfer: ad4 2507 158.0 /data/astro/52144/2507/idGang-002507-r9-0158.fit Aug 23 02:02:45 sdsshost TMS 168666 TEXTONLY updating idAstroline files Aug 23 02:02:50 sdsshost TMS 168666 TEXTONLY Gangs transfer: id1:1/1 id2:1/1 id3:1/1 id4:1/1 id5:1/1 id6:1/1 ad1:1/1 ad2:1/1 ad3:1/1 ad4:1/1 -> unix Aug 23 02:02:51 sdsshost TMS 168666 dsc_E_shareLost Access to shared data area at 0x18000000 lost Aug 23 02:02:51 sdsshost TMS 168666 dsc_E_writeFail Write failed to PT icc21 CSB=0x80430010 Aug 23 02:02:51 sdsshost TMS 168666 dsc_E_writeFail Write failed to rmt=0x1828CE7C cnt=0x00002288 Aug 23 02:20:35 sdsshost TMS 170492 TEXTONLY transfering gangs to unix Aug 23 02:20:42 sdsshost TMS 170492 TEXTONLY Gangs transfer: id1:1/1 id2:1/1 id3:1/1 id4:1/1 id5:1/1 id6:1/1 ad1:1/1 ad2:1/1 ad3:1/1 ad4:1/1 -> unix Aug 23 02:23:16 sdsshost TMS 170492 TEXTONLY Waiting for command response from id5 (crate 2, ICC 1), data server (client 1) Aug 23 02:23:37 sdsshost TMS 170492 TEXTONLY Waiting for command response from id5 (crate 2, ICC 1), data server (client 1) Aug 23 02:23:45 sdsshost TMS 170492 TEXTONLY Waiting for command response from id5 (crate 2, ICC 1), data server (client 1)