APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Wednesday January 28, 2004 (MJD 53033) ---=== OBSERVING TEAM ===--- Stephanie Snedden (day) Atsuko Nitta Scot Kleinman ---=== OBSERVING PLAN ===--- Maybe some science for a change? ---=== OBSERVING SUMMARY ===--- Four plates done. IOPs slow to start, long episode of worthless teamsters with miraculous recovery. Sporadic imager micro "server is not responding" watcher errors. We took an imager bias all night and stored several U3 frames on Phoenix and screen captured the watcher U3 bias plot. ---=== OBSERVING LOG ===--- Swing: ===== JEG called during the afternoon (returning your call, Mike). He wants us to monitor u3 tonight. The u3 bias looked normal during afternoon checkout. This was taken with the imager on the telescope. After unmounting the imager, another bias was started and left running to monitor u3. Afternoon checkout was without problems. Spectro focus checked and sp2 adjusted. bias saved to /data/photo/optics/53033/u3_040128.fit on phoenix. During the afternoon instrument change (removing the imager and mounting a cartridge), the auto-lift was used. We could not activate the latches to the imager until the force reached 1500 lb. That limit interlock appears to work properly. I assume the speeds were correct as well, as the lift started slowly, then sped up after engaging the cart. As with the previous day, I could not force myself to keep the thumbwheel on full as the cart got close to the imager, so I don't know if the speed slows down properly before engaging. It did take a very long time (approx. 15 s) for the force to exceed 1500 lb., so I would guess that the speed is properly low. Night: ======= IOP is taking a very long time to startup tonight, taking more than 5min! It seems to be slowing somewhere in the startupIOP.tcl routine before the firmPatch.tcl source statement. We ran a bias in the dog house for hours. We saw dewar 1 CCDs (ccd11, 21, 31, 41,51) getting a bias level of -1 often tonight. This did not always trigger nQuartile errors or biasL/R errors in watcher. (It was short-lived.) Sky started clearing around 08:00z, so we opened and started with cart 6 plate 1598 (survey). Guide stars were found after an fk5 star. Tonight's first focus sweep looked OK (as opposed to last night). Scot's session on monx* hung completely and killed EVERYTHING he was running. Sigh. 09:46Z: We finished this previously-observed plate with 2 additional exposures and went on to cart 3 plate 1356 (survey). Again, an fk5InFiber was needed (the usual 10" off in RA). 10:50Z: we finished this partially-done plate with two more exposures, and while the sky tempted us with photometricity for 30m, more clouds passed by, so we went on to cart 7 plate 1360 (survey). GSOTGTF. 11:23Z: We notice that Atsuko's imager teamster again died; she started a new one. No teamster started. We tried again. And again. ptvmeTest reported no errors, but we got lots of: 2004-01-29 12:04:48Z sdsshost TMS 394895 TEXTONLY Waiting for command response from id5 (crate 2, ICC 1), data server (client 1) messages in the murmurLog. We then issued a ptvmeReset and nothing changed. We also were getting the following imager micro watcher error: server is not responding (Last packet: 2004-01-29 12:19:29Z) We eventually ended the bias, were going to wait until archiving was complete, then reboot a crate or two, but before all that, a teamster came back to life and started gang transfer. The last exposure on this plate triggered an SoS warning: sdR-b1-00024843.fit: WARNING: Max sky-residual chi2 = 187.138 at 5984.79 Ang (ignoring 5577) I could detect nothing amiss in the raw frame, the sky extractions or at the telescope. 11:57Z We finished this plate in 3 exposures and went on to cart 9 plate 1310 (survey). GSOTGTF. Another max-sky residual warning message for this plate: sdR-r1-00024846.fit: WARNING: Max sky-residual chi2 = 76.1454 at 8921.49 Ang (ignoring 5577) We finished the second exposure as twilight approached, but started a third anyhow, just to see if it would be good... This last exposure received only the same sky-residual errors as the past two exposures and finished the plate, so we called it done (it's also the only end of night plate we currently have plugged.) 13:18Z: gangs magically started transfering again. We saved a screen capture of the bias level plots from the watcher for ccd33, 11, 21, 31, 41, 51. ccd33 behaved well (although showed a range of ~3 adu) but ccd 11, 21, 31, 41, 51 got occasional bias levesl of -1. The plots only goes up to frame 1124 which was the last set of gangs transferred successfully before the divine intervention late in the night. We only captured the R side of bias levels for ccd 11-51, but we got both R and L sides for ccd33. The files are at /home/ank/ on sdsshost as: ccd11biasR.ps ccd21biasR.ps ccd31biasR.ps ccd41biasR.ps ccd51biasR.ps ccd33biasR.ps ccd33biasL.ps A few U3 bias frames were copied to phoenix. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 4384 22:55Z 23:19Z 100 O -179.42 -173.39 54 bias GOOD bias 4385 00:02Z 12:49Z 100 O -162.53 29.69 1297 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): y QA Procedures Done (y/n): y UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 24822, plate -9999 ------- 22:48 24822 0.0 bias ----- sequence 24823, plate 1512 ------- 00:03 24823 10.0 flat 00:06 24824 2.0 arc 00:12 24825 2.1 arc 00:15 24826 2.1 arc 00:29 24827 2.1 arc 00:31 24828 2.1 arc ----- sequence 24829, plate -9999 ------- 01:42 24829 0.0 bias ----- sequence 24830, plate 1512 ------- 01:45 24830 0.0 bias SCIENCE ------- ----- sequence 24831, plate 1598 ------- 09:10 24833 1200.1 target 09:38 24834 1500.1 target DONE ----- sequence 24835, plate 1356 ------- 09:55 24835 10.0 flat 09:57 24836 2.0 arc 10:26 24837 900.1 target 10:39 24838 600.1 target DONE ----- sequence 24839, plate 1360 ------- 10:52 24839 10.0 flat 10:54 24840 2.0 arc 11:10 24841 700.1 target 11:30 24842 900.1 target 11:48 24843 900.1 target DONE sdR-b1-00024843.fit: WARNING: Max sky-residual chi2 = 187.138 at 5984.79 Ang (ignoring 5577) ----- sequence 24844, plate 1310 ------- 12:01 24844 10.0 flat 12:03 24845 2.0 arc 12:26 24846 900.1 target 12:45 24847 900.1 target 13:04 24848 900.1 target DONE sdR-r1-00024846.fit: WARNING: Max sky-residual chi2 = 76.1454 at 8921.49 Ang (ignoring 5577) sdR-r1-00024847.fit: WARNING: Max sky-residual chi2 = 83.5649 at 8829.34 Ang (ignoring 5577) sdR-r2-00024847.fit: WARNING: Max sky-residual chi2 = 73.8393 at 8883.82 Ang (ignoring 5577) sdR-r1-00024848.fit: WARNING: Max sky-residual chi2 = 83.0157 at 8921.32 Ang (ignoring 5577) ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 09:12Z 6 0 -10.45 0.0084 67.62 0.0005 171.00 -0.0009 1.000100 10:14Z 3 1356 243.80 -0.0001 69.00 0.0045 78.50 0.0107 1.000050 11:05Z 7 1360 241.29 0.0007 64.14 0.0032 80.11 -0.0130 1.000030 12:17Z 9 1310 212.95 -0.0017 56.93 0.0032 57.05 0.0072 0.999950 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL Stays: JL ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 09:11Z 6 0 1.00010 -988 518 200 -10 67.6 -2.8 11 303 gdr 1.1" 10:13Z 3 1356 1.00005 -494 924 200 244 69.0 -3.3 12 316 gdr 1.4" 11:05Z 7 1360 1.00003 -296 1097 200 241 64.2 -3.8 10 316 gdr 1.2" 12:17Z 9 1310 0.99995 494 1769 200 213 56.9 -3.9 8 329 gdr 1.2" ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 22:37Z 32 9 3 269 (W) -9999 - 23:09Z 30 8 1 303 (WNW) -9999 - 23:41Z 30 7 7 312 (NW) -9999 - 00:13Z 29 7 6 297 (WNW) -9999 - 00:46Z 29 7 7 312 (NW) -9999 - 01:18Z 29 7 5 331 (NNW) -9999 - 01:54Z 30 7 7 296 (WNW) -9999 - 02:26Z 30 8 6 279 (W) -9999 - 02:56Z 29 8 5 277 (W) -9999 - 03:26Z 29 10 5 288 (WNW) -9999 - 03:58Z 29 10 6 288 (WNW) -9999 - 04:30Z 29 11 6 272 (W) -9999 - 05:03Z 29 12 7 271 (W) -9999 - 05:33Z 29 11 8 298 (WNW) -9999 - 06:03Z 29 11 10 290 (WNW) -9999 - 06:33Z 29 11 12 277 (W) -9999 - 07:04Z 28 11 5 304 (NW) -9999 - 07:34Z 28 10 11 304 (NW) -9999 - 08:04Z 28 10 17 298 (WNW) -9999 - 09:29Z 26 9 10 305 (NW) -9999 - 09:59Z 26 8 10 328 (NNW) -9999 - 10:29Z 25 8 11 314 (NW) -9999 - 11:02Z 25 7 10 324 (NW) -9999 - 11:34Z 25 9 8 325 (NW) -9999 - 12:06Z 25 10 11 314 (NW) -9999 - 12:37Z 24 11 11 333 (NNW) -9999 - 12:39Z 24 11 9 297 (WNW) -9999 - 13:09Z 24 11 15 328 (NNW) -9999 - 13:39Z 24 10 6 354 (NNW) -9999 - ---=== TELESCOPE STATUS ===--- open/fans etc.: ~08:00Z Closed/fans off/thermoPresley on: ~13:30Z ---=== SOFTWARE USED ===--- IOP/SOP: v3_125_1 Watcher: v2_26_0 MCP: v5_24_0 TPM: tpm_v2_36_0 AstroDa: v14_47 TCC: TCC 2.7.1 July 22 2003 sdssProcedures: v1_82 SoS: v4_10_7 hoggPT: v1_6_9 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.5490 0.5420 Axial B 0.6420 0.6390 Axial C 1.0810 1.0900 Trans D -8.4590 -8.4610 Lateral E 10.8712 10.8966 Lateral F 10.8458 10.8712 GALILS Commanded: 4600. -2850. 850. -9250. 18400. 17850. Actual: 4600. -2866. 866. -9275. 18411. 17825. SETMIR VALUES PriDesOrient: 0.00 0.00 15.20 829.90 1.60 PriOrient: 0.00 0.00 14.91 830.49 3.19 SECONDARY: ---------- Focus: 0.00 Air Temp.: -0.7 Alt.: 29.997434 MIGS TONIGHT NOMINAL Axial A 1.5110 1.5160 Axial B 1.1050 1.1180 Axial C 1.1160 1.1210 Trans D -0.0010 -0.0050 GALILS Commanded: 1628594. 1548159. 1574421. -3900. -8750. Actual: 1628641. 1548187. 1574504. -3899. -8726. SETMIR VALUES SecDesOrient: 1257.00 0.00 -25.00 0.00 146.27 SecOrient: 1256.96 0.02 -25.00 0.27 146.55 ---=== PROBLEMS IN DETAIL ===--- Spectro Focus: ============== T=-3.4, cartridge 1 Moved sp2; mechPiston -3012 After adjust: sp1 sp2 A=-6884 -39578 B=-5885 +0810 C=-6984 -2229 Tonight's TPM Alarms: --------------------- dewar (Imager Dewar Scale Communications Fault:: 2004-01-29 09:40:04Z) m2 temp (Excessive Front-Back Temperature Differential:Excessive Front-Back Temperature Differential:Excessive Front-Back Temperature Differential:Excessive Front-Back Temperature Differential:Excessive Front-Back Temperature Differential: 2004-01-29 09:17:39Z ) m2 mig (Communications Fault: 2004-01-29 10:06:42Z)