APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Friday August 17, 2007 (MJD 54330) ---=== OBSERVING TEAM ===--- Day shift: Howard Brewington Observers: Dan Oravetz, Dmitry Bizyaev Support: Steph Snedden, French Leger (by phone) ---=== OBSERVING PLAN ===--- Science! ---=== OBSERVING SUMMARY ===--- Took spectro dithered flats. Got good signal on Cart 6, plate 1963. Got signal on Cart 8, 2801. Lost time due to clouds and humidity early on and to a few other problems (see log and problems section). ---=== OBSERVING LOG ===--- Afternoon: ---------- No Problems to report from the afternoon checkout. The spectro focus/collimation was checked but not adjusted. They are set for about 14-degrees C, and the numbers are posted in the Problems Section. I checked the space on sdsshost2:/data/* and deleted all the MJDs that were flagged, "Safe to Remove." There should be enough space available (see below) until I return on Monday. im> df -h Filesystem Size Used Avail Use% Mounted on /dev/md0 4.9G 857M 3.8G 19% / /dev/md6 367G 330G 19G 95% /data /dev/md5 111G 87G 18G 84% /home none 1005M 0 1005M 0% /dev/shm /dev/md2 3.9G 90M 3.6G 3% /tmp /dev/md4 20G 3.6G 15G 20% /usr /dev/md3 3.9G 409M 3.3G 11% /var sdssfiles1:/data1/data 1.5T 534G 859G 39% /files im> Watcher reported both spectrographs as "Not connected." The other misc Watcher messages are posted in the Problems Section. 00:48Z Rain detected. Louvers closed, ventilation switched to internal. Night: ---------- 02:08Z - Call from NMSU with request of turning light off in 1m enclosure. Done. 02:20Z - Since sky is cloudy and will be like this for a while, we started taking dithered spectro flats. 03:30Z - Clouds gone and sky looks good, but humidity is as high as 87%. 03:41Z - Dithered flats are ready and seen on SoS. The following frames are taken: 45957-45971 - 15 Dithered flats 45972 and 45973 - 2 Corresponding Arcs 05:30Z - clear sky. Humidity is high but starts to move down. 06:00Z - enclosure off, started ventilation, switched on DIMM. Sky is clear. 06:25Z - Cart.6, Plate 1963, GSOGTF, focus loop started 06:36Z - pre-cal started 06:42Z - 20-min exposure 06:55Z - non-photometric conditions showed by IRCAM around 06:50 are due to a mosquito which took a sit at cloud camera. The bad mosquito killed (or at least seriously hurt). 07:05Z - 20 min exposure 07:28Z - 20 min exposure 07:51Z - 30 min exposure seeing was 1.1-1.3" 08:40Z - problem with lift and cartridge, see "Problems" section the problem was the altitude pin not being fully engaged (even though the led's came on on instrument latch controller panel). after the pin was fully engaged, everything worked fine. 10:00Z - problem with guider field taking - "too faint signal", see "Problems" section. Switched control from landru to "NCD" workstation. 10:10Z - Cart 8, Plate 2801. GSOGTF. Focus loop. 10:17Z - Pre-cal started 10:25Z - 20-min exposure started 10:47Z - 25-min exposure started 11:18Z - post-cal started 12:28Z - endNight rejoiced ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 6896 21:56Z 22:21Z 100 O 4.23 10.49 55 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): QA Procedures Done (y/n): UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 45950, plate -9999 ------- 18:16 45950 0.0 bias ----- sequence 45951, plate 1963 ------- 22:05 45951 10.0 flat 22:07 45952 2.0 arc 22:11 45953 2.0 arc 22:14 45954 3.0 arc ----- sequence 45955, plate -9999 ------- 00:35 45955 0.0 bias ----- sequence 45956, plate -9999 ------- 01:04 45956 0.0 bias ----- sequence 45957, plate 1963 ------- 02:26 45957 10.0 flat dithered flat 02:31 45958 10.0 flat dithered flat 02:35 45959 10.0 flat dithered flat 02:39 45960 10.0 flat dithered flat 02:44 45961 10.0 flat dithered flat 02:48 45962 10.0 flat dithered flat 02:52 45963 10.0 flat dithered flat 02:56 45964 10.0 flat dithered flat 03:01 45965 10.0 flat dithered flat 03:05 45966 10.0 flat dithered flat 03:09 45967 10.0 flat dithered flat 03:13 45968 10.0 flat dithered flat 03:17 45969 10.0 flat dithered flat 03:21 45970 10.0 flat dithered flat 03:25 45971 10.0 flat dithered flat 03:30 45972 2.0 arc for dithered flat 03:32 45973 2.0 arc for dithered flat ----- sequence 45974, plate -9999 ------- 04:16 45974 0.0 bias 04:29 45975 0.0 bias ----- sequence 45976, plate 1963 ------- 50.0 45.3 56.0 43.8 06:38 45976 10.0 flat 06:40 45977 2.0 arc 07:04 45978 1200.0 target 07:27 45979 1200.0 target 07:50 45980 1200.0 target 08:23 45981 1802.0 target 08:26 45982 10.0 flat 08:28 45983 2.0 arc ----- sequence 45984, plate 2801 ------- 7.4 13.4 15.6 13.9 10:19 45984 10.0 flat 10:22 45985 2.0 arc 10:46 45986 1201.0 target 11:14 45987 1503.0 target 11:20 45988 10.0 flat 11:22 45989 2.0 arc ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 11:00Z 8 0 -76.18 -0.0031 67.40 0.0040 115.71 0.0380 1.000320 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 04:31Z 6 0 1.00000 0 1247 0 121 30.0 13.3 9 49 -- 1.2 11:00Z 8 0 1.00032 -3160 -1729 -250 -76 67.4 13.9 9 325 -- 1.0 ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 16:50Z 61 45 8 100 (E) 1199 - 17:22Z 65 44 15 111 (ESE) 1116 - 17:55Z 63 44 2 71 (ENE) 1039 - 18:27Z 61 51 3 308 (NW) 1494 - 18:59Z 62 46 1 34 (NE) 1509 - 19:32Z 63 51 1 270 (W) 1413 - 20:03Z 62 52 2 210 (SSW) 1504 - 20:35Z 62 51 4 267 (W) 1447 - 21:08Z 63 51 2 257 (WSW) 1545 - 21:40Z 63 51 0 260 (W) 1383 - 22:10Z 63 49 5 267 (W) 1401 - 22:42Z 65 50 1 216 (SW) 1281 - 23:12Z 63 48 1 341 (NNW) 913 - 23:43Z 65 50 0 241 (WSW) 1116 - 00:16Z 62 49 2 65 (ENE) 646 - 01:13Z 58 53 8 83 (E) 516 - 01:45Z 58 52 11 69 (ENE) 485 - 02:17Z 58 52 16 83 (E) 507 - 02:49Z 57 52 14 76 (ENE) 481 - 03:21Z 56 52 11 77 (ENE) 556 - 03:53Z 55 53 11 69 (ENE) 687 - 04:26Z 55 53 12 64 (ENE) 706 - 04:58Z 57 50 5 25 (NNE) 729 - 05:30Z 58 50 2 6 (N) 669 - 06:02Z 60 49 8 343 (NNW) 698 - 06:32Z 59 49 8 350 (NNW) 717 - 07:02Z 58 50 7 318 (NW) 614 - 07:34Z 58 49 7 295 (WNW) 492 - 08:04Z 58 49 5 272 (W) 485 - 08:35Z 57 49 6 270 (W) 424 - 09:07Z 56 50 6 272 (W) 380 - 09:38Z 57 50 5 269 (W) 391 - 10:11Z 56 50 5 272 (W) 357 - 10:43Z 57 50 2 282 (WNW) 380 - 11:13Z 57 50 7 321 (NW) 491 - 11:44Z 58 50 4 294 (WNW) 616 - 12:14Z 57 50 7 321 (NW) 651 - ---=== TELESCOPE STATUS ===--- 23:00Z Louvers opened, fans on. 02:20Z Louvers closed, fans off, ventilation stopped: high humidity 06:00Z Began ventilation. Doors and louvers opened, fans on. Enclosure off. 11:50Z - Enclosure on, doors and louvers closed, fans off. No interlocks bypassed. Status at: 12:03Z Telescope stowed at: 30,121,00 mount Instrument mounted: Cartridge 8 Counterweights at: 266 lbs LN2 autofill systems: Connected and turned on. 180L LN2 dewar scales: Spectro 220 lbs, 21.9 psi Imager 229 lbs, 20.6 psi ---=== SOFTWARE USED ===--- IOP/SOP: v4_37_0 Watcher: v2_36_0 MCP: v6_4_0 TPM: tpm_v3_5_0 AstroDa: v15_13_1 TCC: TCC 2.9.1 2007-06-21 sdssProcedures: v2_35 SoS: v5_1_8 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A -5.2130 -5.2130 Axial B -0.2135 -0.2135 Axial C -0.0015 -0.0016 Trans D 11.6370 11.6400 Lateral E 9.9441 9.9568 Lateral F 11.5316 11.5316 GALILS Commanded: 4600. -2000. 2650. -9300. -9800. -9800. Actual: 4600. -2000. 2650. -9300. -9800. -9800. SETMIR VALUES PriDesOrient: 0.00 0.00 0.00 0.00 0.00 PriOrient: 0.00 0.00 0.00 0.00 0.00 SECONDARY: ---------- Focus: 0.00 Air Temp.: 17.3 Alt.: 30.100925 MIGS TONIGHT NOMINAL Axial A 0.7974 0.7973 Axial B 0.6041 0.6041 Axial C 0.5425 0.5425 Trans D 0.5995 0.5999 GALILS Commanded: 1800247. 1309810. 1642496. -9450. -4400. Actual: 1798650. 1309550. 1643400. -9450. -4400. SETMIR VALUES SecDesOrient: 1257.00 -60.00 -140.00 -190.00 200.12 SecOrient: 1257.26 -59.44 -140.53 -189.82 199.77 ---=== PROBLEMS IN DETAIL ===--- ---=== Spectro Focus/Collimation Numbers ==-- IDL 5.5a> collimate, 45953 % Compiled module: COLLIMATE. Reading /data/spectro/54330/sdR-b1-00045953.fit Reading /data/spectro/54330/sdR-b1-00045954.fit COLLIMATE: Min offset = -0.82 pix COLLIMATE: Max offset = 0.58 pix COLLIMATE: RMS across CCD = 0.35 pix COLLIMATE: Mean offset = -0.06 pix COLLIMATE: Camera b1 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict blue camera ring movement of 2.2 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-54330-b1-00045953.log PostScript file = Collimate-54330-b1-00045953.ps Reading /data/spectro/54330/sdR-b2-00045953.fit Reading /data/spectro/54330/sdR-b2-00045954.fit COLLIMATE: Min offset = -0.31 pix COLLIMATE: Max offset = 0.13 pix COLLIMATE: RMS across CCD = 0.12 pix COLLIMATE: Mean offset = -0.07 pix COLLIMATE: Camera b2 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict blue camera ring movement of 2.5 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-54330-b2-00045953.log PostScript file = Collimate-54330-b2-00045953.ps Reading /data/spectro/54330/sdR-r1-00045953.fit Reading /data/spectro/54330/sdR-r1-00045954.fit COLLIMATE: Min offset = -0.46 pix COLLIMATE: Max offset = 1.98 pix COLLIMATE: RMS across CCD = 0.39 pix COLLIMATE: Mean offset = 0.06 pix COLLIMATE: Camera r1 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict (red) piston movement of -504 steps for spectro-1 COLLIMATE: Issue SOP command: "sp1; mechPiston -504" Log file = Collimate-54330-r1-00045953.log PostScript file = Collimate-54330-r1-00045953.ps Reading /data/spectro/54330/sdR-r2-00045953.fit Reading /data/spectro/54330/sdR-r2-00045954.fit COLLIMATE: Min offset = -0.41 pix COLLIMATE: Max offset = 0.47 pix COLLIMATE: RMS across CCD = 0.24 pix COLLIMATE: Mean offset = 0.18 pix COLLIMATE: Camera r2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of -1605 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston -1605" Log file = Collimate-54330-r2-00045953.log PostScript file = Collimate-54330-r2-00045953.ps % Program caused arithmetic error: Floating illegal operand IDL 5.5a> --== Misc Watcher Messages ==-- m1 temp (Excessive M1 - PMSS Difference:Excessive Telescope - Ambient Difference:Excessive Radial Gradient:Excessive Front-Back Difference (Entire Mirror):Excessive Front-Back Difference (Left Half):Excessive Front-Back Difference (Right Half):Excessive Front-Back Difference (Lower Half):Excessive Front-Back Difference (Upper Half): 2007-08-17 18:11:25Z ) m1 mig (Communications Fault: 2007-08-17 18:11:25Z) tmicro (Disconnected Sensor in M2B7:Disconnected Sensor in M2B6:Disconnected Sensor in M2B5:Disconnected Sensor in M2B4:Disconnected Sensor in M2B3:Disconnected Sensor in M2B2:Disconnected Sensor in M2B1:Disconnected Sensor in M2B0:Disconnected Sensor in M1B7:Disconnected Sensor in M1B6:Disconnected Sensor in M1B5:Disconnected Sensor in M1B4:Disconnected Sensor in M1B3:Disconnected Sensor in M1B2:Disconnected Sensor in M1B1:Disconnected Sensor in M1B0:Disconnected Sensor in M0B7:Disconnected Sensor in M0B6:Disconnected Sensor in M0B5:Disconnected Sensor in M0B4:Disconnected Sensor in M0B3:Disconnected Sensor in M0B2:Disconnected Sensor in M0B1:Disconnected Sensor in M0B0:Communications Fault: 2007-08-17 18:11:25Z ) m2 galil (Communications Fault: 2007-08-17 18:11:25Z) m1 galil (Communications Fault: 2007-08-17 18:11:25Z) currents (High Az #1 Drive Current:: 2007-08-17 18:37:16Z) ca (Channel Access Failure: TPM Down?: 2007-08-17 18:11:45Z) m2 temp (Excessive Front-Back Difference (Lower Half):Excessive Front-Back Difference (Upper Half): 2007-08-17 18:11:45Z ) m2 mig (Communications Fault: 2007-08-17 18:11:25Z) Problem 1: Around 2:28Z X-session at Landru got frozen completely in the course of dithered flats taking. The flats sequence was not interrupted, according to SoS. Upon the sequence was over, DanO logged out/logged in from landru. Jon Brinkmann was notified. Details: DanO logged into sdsshost2 with several separate ssh sessions via xterms. Each of them got frozen including all child windows like TPM, MCP etc. At the same time, local Landru's webbrowser worked fine. Sdsshost2 ran with only 20Mb of free memory but it doesn't seem to create a problem. Nevertheless, sdsshost2 does have some zombie processes. After logout from landru it was able to grab spectrographs on the other machine without problems. This problem didn't hurt observations since it occured during high humidity conditions. --- Problem 2: 08:40Z - Few problems rise when we attempt to change cartridge (Cart 6--> Cart 5). 1) Handpaddle looks ok, lights are on, but the lift didn't want to go up. All lights/gauges are checked in the downstairs, look OK all. 2) Handpaddle re-connected to the manual side on the mount, i.e. from Auto to Manual position. Lift goes up... but next problem comes. 3) ... when the platform comes as close as ~1 inch to the cartridge, the upper part of the platform jumps up (like it would be attracted by a magnet) to the cartridge. We see pins go out of holes netween 2 parts of the platform. When attempted to go down, the cartridge hangs, distance between 2 parts of the platform increases to ~1 inch, then drops down to the platform (with some noise). Further moving down causes cartridge tilt and we affraid of moving further down. Cartridge attached back and latched OK. Second attempt showed the same "saction" of the platform, so we avoided to unlatch the cartridge 6 again. 4) Tried to move telescope off the stove position and return it back. No change: Handpaddle doesn't want to operate at the "Auto" side. 5) Called Steph at home. Checked additional gauges related to the lift. Everything looks normal. 6) Called French at home. 7) Checked if cart is ok. Found that lift platform's pins are equally out of holes. Checked telescopes pointing. Found that it's not in the zenith exactly, it was in 90:21:xx. Re-send it to zenith. It fixes everything. Cartridges start changing smoothly. Source of the problem, apparently, is that a stop button was hit before the axis pin was applied. Note: The altitude pin was difficult to retract (French was notified). --- Problem 3: 10:00Z - after going to field with -gflat it says "too faint signal". Tried several times. Tried to drop instrument and grab it again. Didn't help. Then dropped instrument and passed operation control to another computer. It worked fine there. Less than 10 min lost. --- Not a real problem, but we noticed that SlewEnd notice doesn't come anymore to TCC upon telescope's stops. Is it a feature or a bug? --- Waw! Dead rat is in the rat trap.