APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Friday October 19, 2001 (MJD 52202) ---=== OBSERVING TEAM ===--- Swing, night: Steph Snedden, Pete Newman (APO) ---=== OBSERVING PLAN ===--- Spectroscopy until moonset (20:54 MDT), then imaging if conditions allow. ---=== OBSERVING SUMMARY ===--- Patchy thick clouds from sunset until ~23:00 MDT, then clearer, so spectroscopy all night. 4 plates done (545, 695, 699, 711) plus good data on another (716). A problem with the sp1 LN2 fill delayed the start of observations slightly. No fidicual problems tonight (bar the usual few latch positions not read)! Thanks to the engineering crew and Sir Robert for diligence. We lost one neon lamp, which we expect to replace before the engineers arrive ( for practice). ---=== OBSERVING LOG ===--- We rebooted the MCP to v5_6_5 with new fiducial debugging code from RHL. The fiducial problem debugging exercise continues. See problem section #1 for some relevant messages from watcher and murmur. However, nothing fiducially bad happened all night! Craig rebooted the TCC after changing some operating system parameters at Russells's behest today, so we started with a cleared system. During the spectro fill after opening, spectro 2 did not stop filling. The two spectros took 40lb, venting normally, but sp2 did not stop (or vent liquid) after an hour. This delayed getting on the first field until the end of twilight. The valve closed when commanded by the control box buttons. We suspect the full sensor did not trigger. Spectro 1 behaved normally. PR2817 was filed. Watchers did not see any TCC errors all night, despite being started after the TCC was rebooted and telrun started. Not obvious why that happened, so PR 2819 filed. Nice and quiet without it, though! SoS complained about a big wavelength gap from 4358 to 4799 Angstroms on two arcs from plates 716 and 695, but all the arc exposure numbers were flagged black. What should be our response to this warning? It also failed to reduce frame R2 from exposure 11362 (plate 545) first time round (see PR 2814). Removing file sos:/data/spectro/52202/*r2*11361* let it try again and work. We lost the SE neon arc lamp on the last plate (545), but SoS was happy with a 3-lamp exposure. On a plus note, SoS managed to reduce the last science exposure BEFORE the following smear had finished for at least two plates tonight! Observing sequence: 19:50 Plate 716, cartridge 8. Not done, 2 useful exposures. Offset 4 arcsec W 9 arcsec N to center. UDP port 30410 conflict at 20:13 MDT lost 5 minutes. See problem section #2. Then clouds. Then, SoS complained that the FF screens and arc lamps were not set for the preCalib arc (they were: the arc looked fine on the displays). This is a known bug (see PRs 2650 and 2731). As the clouds were continuing, I aborted the 2-minute exposure and took a new arc which fixed it. Clouds thinned by 20:50, so we resumed science. First two exposures good, third ruined by more clouds. Off the design time range for this plate, so postCalibs taken, but not smeared yet. 22:20 -- 23:05 Heavy clouds, clearing to a clean edge from the west. 23:05 Plate 695, cartridge 5. Done in 3 exposures. The first preCal flat- field count was set to zero by mistake, so SoS complained it had no flat to reduce the arc. sos_stop, new preCals, sos_start fixed it. 00:56 Plate 699, cartridge 3. Done in 3 exposures. Clear, but degraded seeing, then thin clouds during second and third exposures. 02:25 Plate 711, cartridge 4. Done in 3 exposures. Thin cloud from west. Seeing improved. 03:53 Plate 545, cartridge 7. Done in 3 exposures. preCalibs reported one Ne lamp out and did not take the arc exposure. Parked at 121,30 and turned on lamps at the telescope, all came on. We tried another arc, and 4 lit, then one (SE corner) went out. SoS gave a warning, but flagged exposure as acceptable. Very large scale change from last plate to this (+0.032 per cent! - this plate drilled for lower temperatures) took extra 5 minutes to measure and adjust. Increasing cloud. The first three exposures and smear finished before twilight. A forth exposure running into twilight was aborted as unnecesssary. ---=== IMAGING RUN SUMMARY ===--- Run Stripe Flavor Lambda Last Begin End Frame Comments ------------------------------------------------------------------ 2669 100 O ignore 92.11 99.15 60 doghouse bias ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot --------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields nGood rowMean rowSig colMean colSig rot --------------------------------------------------------------- ---=== SPECTROSCOPY DATA SUMMARY ===--- UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 11330, plate 716 ------- 10.7 10.8 10.3 9.6 23:38 11330 0.0 bias 02:00 11331 10.0 flat 02:02 11332 2.0 arc bad headers! 02:36 11333 2.0 arc 03:12 11334 1201.0 target 03:33 11335 903.0 target 04:25 11336 1402.0 target useless (clouds) 04:35 11337 10.0 flat 04:37 11338 2.0 arc ----- sequence 11339, plate 695 ------- 14.8 16.8 21.3 19.0 DONE 05:23 11339 2.0 arc good, but no prior flat 05:34 11340 10.0 flat 05:37 11341 2.0 arc 06:04 11342 902.0 target 06:26 11343 1123.0 target 06:42 11344 804.0 target 06:49 11345 240.0 smear ----- sequence 11346, plate 699 ------- 22.3 15.0 19.4 20.0 DONE 07:02 11346 10.0 flat 07:04 11347 2.0 arc 07:33 11348 1000.0 target 07:54 11349 1101.0 target 08:12 11350 902.0 target 08:18 11351 240.0 smear ----- sequence 11352, plate 711 ------- 16.2 16.1 14.6 16.9 DONE 08:30 11352 10.0 flat 08:32 11353 2.0 arc 09:02 11354 1000.0 target 09:20 11355 902.0 target 09:39 11356 1002.0 target 09:46 11357 240.0 smear ----- sequence 11358, plate 545 ------- 16.6 17.6 16.8 15.8 DONE 09:57 11358 10.0 flat 10:17 11359 2.0 arc 11:00 11360 1000.0 target 11:18 11361 903.0 target 11:24 11362 240.0 smear 11:46 11363 1100.0 target ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument getclock Az Alt Rot Scale ------------------------------------------------------------------------------ 20:31 8 716 1003545117 0.002792 0.001918 0.000000 0.999840 23:51 5 695 1003557118 0.002371 -0.000063 -0.026968 0.999940 01:19 3 699 1003562385 0.002607 -0.001482 0.026009 0.999920 02:58 4 711 1003568302 0.000817 0.000389 0.014531 0.999990 06:12 7 545 1003579973 0.000777 0.001282 -0.037477 1.000310 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL4559 Stays: JL4560 (endNight is running as this is being mailed.) ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 20:31 8 716 0.99984 1579 2389 -105 13 48.2 11.1 1 253 -- 1.8'' 21:06 8 716 0.99984 1579 2327 -165 0 49.1 11.0 3 276 -- 1.4'' 23:51 5 695 0.99994 591 1462 -190 15 56.3 11.2 6 343 -- 1.5'' 00:32 5 695 0.99994 591 1460 -190 -4 57.2 10.0 9 340 -- 1.4'' 01:19 3 699 0.99992 789 1665 -150 -12 56.6 9.4 6 9 -- 2.2'' 01:45 3 699 0.99993 690 1587 -150 -23 55.0 10.5 6 356 -- 2.1'' 02:58 4 711 0.99999 99 1064 -180 -15 56.3 10.7 8 309 -- 1.6'' 05:54 7 545 1.00031 -3060 -1606 -200 122 72.5 11.0 7 266 -- 1.4'' ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 15:06 57 11 11 310 (NW) -9999 - Patchy 15:38 55 11 6 341 (NNW) 550 - '' 16:10 57 10 10 300 (WNW) 471 - '' 16:42 56 11 11 343 (NNW) 463 - '' 17:14 54 12 9 311 (NW) 506 - '' 17:47 53 11 6 296 (WNW) 472 - '' 18:27 52 11 0 246 (WSW) 518 - '' 18:59 52 11 6 345 (NNW) 560 - '' 19:31 53 11 3 318 (NW) 503 - '' 20:02 52 7 3 290 (WNW) 439 - '' 20:36 52 10 2 263 (W) 515 - '' 21:06 51 10 3 275 (W) 404 - '' 21:36 52 11 8 307 (NW) 394 - '' 22:08 50 10 7 334 (NNW) 401 - Thick 22:41 50 10 6 354 (NNW) 418 - '' 23:13 49 10 0 9 (N) 455 - Clear 23:45 52 9 5 340 (NNW) 490 - '' 00:18 50 10 8 340 (NNW) 473 - '' 00:50 49 10 9 350 (NNW) 522 - '' 01:21 48 11 8 350 (NNW) 606 - '' 01:54 49 10 7 353 (NNW) 570 - Thin patches 02:25 52 10 6 331 (NNW) 503 - '' 02:58 51 11 7 309 (NW) 582 - '' 03:31 51 13 8 297 (WNW) 854 - '' 04:03 51 12 7 272 (W) 876 - '' 04:34 51 11 6 265 (W) 862 - '' 05:04 52 11 5 264 (W) 848 - '' 05:36 51 12 6 264 (W) 926 - '' 06:08 51 13 8 270 (W) 946 - '' ---=== TELESCOPE STATUS ===--- 17:00 Fans on, doors cracked 18:35 Enclosure off 06:15 Enclosure on, fans off, shutdown Telescope stowed at 30 deg with cartridge 8 mounted ready for tomorrow. Counterweights at 290 (NB: this is 10 higher than yesterday) Instruments on autofill. 180L dewar weights at 06:15: Spectro: 111 lb Imager: 137 lb ---=== SOFTWARE USED ===--- IOP/SOP: v3_58_2 Watcher: v2_11_0 MCP: v5_6_5 TPM: v2_4_2 AstroDa: v14_39 TCC: 2.5.5 sdssProcedures: v1_31 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.0760 0.0710 Axial B 0.8030 0.8030 Axial C 0.0600 0.0640 Trans D -1.4930 -1.4590 Lateral E 1.8450 1.8600 Lateral F 1.4160 1.4280 GALILS Commanded: 5400. -3700. 900. -200. 31550. 30650. Actual: 5400. -3700. 900. -200. 31550. 30650. SETMIR VALUES PriDesOrient: 0.00 -11.80 23.00 1256.90 642.10 PriOrient: 0.00 -12.16 22.81 1257.41 642.19 SECONDARY: ---------- Focus: 0.00 Air Temp.: 11.4 Alt.: 30.021074 MIGS TONIGHT NOMINAL Axial A 1.5680 1.5670 Axial B 1.2880 1.2900 Axial C 1.3210 1.3200 Trans D 0.2330 0.2310 GALILS Commanded: 1599617. 1565243. 1586332. -10400. -9750. Actual: 1599600. 1565250. 1586350. -10400. -9750. SETMIR VALUES SecDesOrient: 1257.00 -3.40 -10.00 0.00 133.82 SecOrient: 1256.99 -3.40 -10.00 -0.24 133.69 ---=== PROBLEMS IN DETAIL ===--- Problem #1 - Fiducial debugging Sundry watcher messages during the night, in chronological order of seeing them. The following was seen during the large slews: rotator (correction for rotator 800484 is too large (Oct 19 19:50:01): Oct 19 19:50:12 MDT ) altitude (correction for altitude -38005 is too large (Oct 20 02:20:24): Oct 20 02:20:28 MDT ) altitude (correction for altitude -87355 is too large (Oct 20 03:49:00): Oct 20 03:49:18 MDT ) The following were ALL seen when stickyOffsets was applied, which converts ADR offsets to calibration offsets, resulting in a _very_ small slew). Seems the rotator is being commanded to move nowhere, fast: rotator (addoffset: Max accl. for rotator exceeded: -293/1000 (Oct 19 23:51:51) : Oct 19 23:52:16 MDT ) rotator (addoffset: Max accl. for rotator exceeded: -291/1000 (Oct 20 00:59:04) : Oct 20 00:59:19 MDT ) rotator (addoffset: Max accl. for rotator exceeded: 554/1000 (Oct 20 05:02:35): Oct 20 05:02:54 MDT ) ---------------------------------------------- Problem #2 - Relay server port 30410 failure while guiding: While guiding, about 5 minutes after starting the PGPLOT window, the SOP backup relay server failed. I recovered using the folklore prescripton in about five minutes. My fault for not following the _start-up_ prescription and opening the pgplot server before grabbing instruments. Here are the transactions from the SOP window, starting about 20:13 MDT: Offset telescope -0.063 (arcsec E) -0.108 (arcsec N) -1.0 (arcsec phi) ************************************************** ====>>>>>>RELAY SERVER FAILED TO START!!!!<<<===== ************************************************** Couldn't open udp socket 30410 : Address already in use ************************************************** /data/spectro/guider/gimg0927.fits SAOimage: histeq could not converge on best distribution, proceeding anyway I cannot find the sky from the fibres you suggested Sky values: 74 74 GUIDING USING FIBERS: 4 5 6 7 8 9 10 Computed errors: 0.786 (asec E) -0.894 (asec N) 0.0 (asec phi) 0.002 (percent scale) Running exposure number: 20 Last file: gimg0927.fits 1 2 3 4 5 6 7 8 9 10 11 row: 232.2 160.1 82.5 231.2 160.9 83.9 232.1 156.3 90.0 119.1 223.2 col: 81.2 80.8 83.5 131.6 141.2 141.3 195.7 192.2 195.1 267.0 341.6 counts: 2242 2465 1760 1455 1263 901 1375 1210 1483 1591 1447 scicts: 1438 1529 1232 827 294 468 726 863 690 1093 1187 Efficien: 0.53 0.52 0.55 0.35 0.14 0.30 0.39 0.50 0.37 0.48 0.64 fwhm(''): 1.94 2.00 1.87 1.92 0.00 1.84 1.51 1.50 1.82 1.81 1.63 rot: -571 -537 -370 -135 74 33 49 -50 119 -352 -448 GOOD GOOD GOOD GOOD GOOD GOOD GOOD GOOD GOOD GOOD GOOD 21 Offset telescope 0.629 (arcsec E) -0.716 (arcsec N) 0.0 (arcsec phi) SOPGUI: stopGuider /data/spectro/guider/gimg0928.fits SAOimage: histeq could not converge on best distribution, proceeding anyway sp1> sp1> grabInst -drop 0 sp1> fuser 30410/udp 30410/udp: 3680465o sp1> ps -ef | grep 3680465 prn 3680465 1 0 20:05:43 pts/12 0:00 /p/pgplot/v5_1_1a/dst/ pgxwin_server -display sdsshost:13.1 prn 3534296 3257193 0 20:14:25 pts/12 0:00 grep 3680465 sp1> XIO: fatal IO error 131 (Connection reset by peer) on X server ''sdsshost: 13.1'' after 88 requests (87 known processed) with 0 events remaining. sp1> ps -ef | grep 3680465 prn 3685517 3257193 0 20:15:04 pts/12 0:00 grep 3680465 sp1> sp1> handleList {h0 REGION 0x1111ff40} {h1 CHAIN 0x10fd3f60} {h2 REGION 0x10fbc940} {h3 VECTOR 0x10fc15f8} {h4 VECTOR 0x10fbe808} {h5 REGION 0x10fbeb78} {h6 REGION 0x10fc4688 } {h7 REGION 0x10fbe968} {h8 REGION 0x10fbea18} {h9 REGION 0x10fc1158} {h10 REGION 0x10fc7eb8} {h11 REGION 0x10fce680} {h12 REGION 0x10fbeac8} {h13 REGION 0x10fce5d0} {h14 REGION 0x10fce730} {h23 PGSTATE 0x11003dd8} sp1> pgstateClose h23 Close /xwindow sp1> pgstateOpen h23 Open /xwindow h23 sp1> fuser 30410/udp 30410/udp: fuser: No such file or directory sp1> grabInstr -handlers 120 IOP running as Backup Relay Server requestListen: listening Fri Oct 19 20:16:32 MDT 2001 76 sp1 ln2stat Fri Oct 19 20:16:33 MDT 2001 76 sp2 ln2stat sp1> Fri Oct 19 20:16:35 MDT 2001: registered (addr18) listener sdsshost: observer:2669711 -----------------------------------------------------