APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday August 31, 2002 (MJD 52518) ---=== OBSERVING TEAM ===--- Swing: Jurek Krzesinski Night: Mike Harvanek, Pete Newman Support: Craig Loomis (by phone) ---=== OBSERVING PLAN ===--- Science per the plan. ---=== OBSERVING SUMMARY ===--- Two plates finished (687, 737) and good data one one more (670), after a late start due to clouds and humidity. Problems with tcc25m and hoggpt computers quickly worked around. ---=== OBSERVING LOG ===--- Thunderstorms mid-afternoon with heavy variable cloud continuing through sunset, then climbing humidity alternating with more clouds kept us closed until 0700Z. After 0800Z, the sky was photometric. The tcc25m.apo.nmsu.edu primary machine (the CPU with physical label TCC002) rebooted itself around 00:25Z, as yesterday (see PR4181, updated). See problem section #1 for details of the problem and how we recovered. hoggpt.apo.nmsu.edu also decided to take a rest by crashing around 04:15Z. See problem section #2 for details. The new sky camera continues to work nicely, but we still are looking forward to improving the image display with flat fielding and non-linear stretch of data numbers to grey scale. The "ringing" seen across all large contrast changes is also puzzling. This shows up as both a dark "halo" around bright features, and a bright halo around dark features. Observing sequence: 07:31Z Plate 737, cartridge 7. Done in 3 exposures. 09:14Z Plate 687, cartridge 3. Done in 3 exposures. Note that SoS marked the (S/N) for the blue smeared exposures in red. 10:49Z Plate 670, cartridge 9. Not done in 1 exposure. This is a photo-z plate requiring (S/N)^2 > 30 in red spectra. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 16071, plate 1054 ------- 23:20 16071 10.0 flat Focus checks 23:29 16072 2.0 arc 23:36 16073 3.0 arc 23:38 16074 3.0 arc ----- sequence 16075, plate -9999 ------- 00:21 16075 0.0 bias ----- sequence 16076, plate -9999 ------- 00:46 16076 0.0 bias ----- sequence 16077, plate 737 ------- 14.7 19.4 15.0 17.6 DONE 07:45 16077 10.0 flat 07:48 16078 2.0 arc 08:07 16079 900.0 target 08:27 16080 1022.0 target 08:50 16081 1202.0 target 08:58 16082 240.0 smear 09:02 16083 10.0 flat 09:04 16084 2.0 arc ----- sequence 16085, plate 687 ------- 16.4 18.8 15.0 19.6 DONE 09:20 16085 10.0 flat 09:23 16086 2.0 arc 09:44 16087 901.0 target 10:07 16088 1202.0 target 10:33 16089 1381.0 target 10:40 16090 240.0 smear ----- sequence 16091, plate 670 ------- 6.1 5.2 5.8 6.8 NOT DONE 11:02 16091 10.0 flat 11:05 16092 2.0 arc 11:33 16093 1500.0 target ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 07:50Z 7 737 -40.33 0.0027 65.60 -0.0001 145.97 -0.0201 1.000040 09:40Z 3 687 -27.58 0.0038 54.04 0.0001 157.06 0.0020 1.000220 11:14Z 9 670 -43.18 0.0035 48.61 0.0003 144.85 -0.0023 1.000220 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL5486 Stays: JL5493 ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 07:51Z 7 737 1.00004 -394 553 -260 -41 65.4 11.4 5 146 BG38 1.8 09:40Z 3 687 1.00022 -2171 -890 -260 -27 54.1 11.6 1 178 BG38 1.7 11:14Z 9 670 1.00022 -2171 -873 -260 -43 48.6 10.5 7 126 BG38 1.8 ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 22:48Z 57 44 12 79 (E) 200 - Cloudy 23:20Z 56 42 15 75 (ENE) 167 - " 23:52Z 56 42 15 73 (ENE) 268 - " 00:24Z 55 46 15 78 (ENE) 440 - " 00:45Z 55 47 11 89 (E) 526 - " 01:15Z 55 45 13 81 (E) 480 - " 01:48Z 54 44 12 84 (E) 442 - " 02:20Z 55 46 12 86 (E) 638 - " 02:52Z 54 47 11 81 (E) 648 - " 03:24Z 53 47 12 78 (ENE) 726 - " 03:56Z 54 47 12 76 (ENE) 716 - " 04:28Z 54 47 9 80 (E) 742 - " 05:01Z 56 45 0 195 (SSW) 710 - " 05:33Z 56 44 2 205 (SSW) 569 - " 06:05Z 54 46 2 155 (SSE) 710 - " 06:37Z 53 46 1 108 (ESE) 775 - " 07:07Z 52 46 6 141 (SE) 838 - Part cloudy 07:39Z 53 45 0 192 (SSW) 838 - " 08:12Z 52 46 1 105 (ESE) 882 - Clear 08:44Z 53 45 0 299 (WNW) 854 - " 09:16Z 51 46 5 12 (NNE) 1010 - " 09:49Z 52 46 0 242 (WSW) 980 - " 10:21Z 51 44 5 121 (ESE) 880 - " 10:52Z 50 43 11 126 (SE) 820 - " 11:26Z 51 42 4 110 (ESE) 858 - " ---=== TELESCOPE STATUS ===--- 06:45Z Fans on, doors open 07:00Z Enclosure off 11:40Z Enclosure on, fans off Status at 11:40Z: Telescope stowed at: 30 deg Instrument mounted: Cartridge 9 Counterweights at: 280 Autofill systems: On 180L LN2 dewar weights: Spectro 240 lb Imager 167 lb Interlocks bypassed: Alt slip, az slip. Slip detection tripped: Rot slip, reset at 01:00Z ---=== SOFTWARE USED ===--- IOP/SOP: v3_82_7 Watcher: v2_19_0 MCP: v5_13_4 TPM: tpm_v2_16_0 AstroDa: v14_47 TCC: 2.6.5 sdssProcedures: v1_51 SoS: v4_9_10 hoggPT: v1_5_8 plate-mapper: v4_1_0 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.0890 0.0890 Axial B 0.8060 0.8040 Axial C 0.0820 0.0790 Trans D -1.5170 -1.5180 Lateral E 1.8240 1.8220 Lateral F 0.0000 0.0000 GALILS Commanded: 5400. -3700. 900. -200. 31550. 30650. Actual: 5400. -3700. 900. -200. 31550. 30650. SETMIR VALUES PriDesOrient: 0.00 -11.80 23.00 1256.90 642.10 PriOrient: 0.00 -12.16 22.81 1257.41 642.19 SECONDARY: ---------- Focus: 0.00 Air Temp.: 13.7 Alt.: 30.094649 MIGS TONIGHT NOMINAL Axial A 1.4620 1.4640 Axial B 1.1490 1.1520 Axial C 1.0750 1.0770 Trans D -0.7180 -0.7160 GALILS Commanded: 1662294. 1540197. 1551372. -4550. -1550. Actual: 1661550. 1539250. 1550250. -4550. -1550. SETMIR VALUES SecDesOrient: 1257.00 10.00 -40.00 -100.00 64.19 SecOrient: 1257.74 9.93 -39.92 -100.13 64.14 ---=== PROBLEMS IN DETAIL ===--- Problem #1 - tcc25m.apo.nmsu.edu CPU TCC002 rebooted itself ----------------------------------------------------------- At about 2002/9/1 00:20Z, all tcc25m sessions appeared to hang and then the telnet windows died. A few minutes later we were able to log back in again, but the machine had clearly rebooted: $ show system OpenVMS V7.2-1 on node TCC002 1-SEP-2002 00:28:28.79 Uptime 0 00:04:01 This was an apparent repeat of the prblem reported yesterday in PR 4181. We consulted with Craig, and decided to switch to the backup machine (physically labeled TCC001, but running as node TCC002), following the procedure Craig outlined in the PR. This is trivial: pull the enternet cable from the bad machine, put it into the backup machine, and power-up the backup machine. A few minutes later, we were able to start telrun again on the new machine, re set the instrument, and reestablish communications from our IOP sessions. Note: to do that, use: im> tccClose im> startDa -tcc or else you need to log out of the IOPs entirely. At Craig's request, we left the sick machine powered up. Problem #2 - hoggpt.apo.nmsu.edu crashed in the operating system ----------------------------------------------------------------- Around 04:15Z, hoggpt decided it was its turn to crash. See PR 4199 for details of what was displayed on its monitor. We rebooted it by pressing the reset on the front of the CPU and it came back up ok. From the messages displayed, this looks like a bug in Redhat Linux 7.3, and indeed, Craig has already found the appropriate patch to install.