APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Thursday September 8, 2005 (MJD 53622) ---=== OBSERVING TEAM ===--- swing: Jurek night: Mike Harvanek, Howard Brewington Eric Neilsen, Fritz Stauffer guests: TV crew. ---=== OBSERVING PLAN ===--- Supernova Science! ---=== OBSERVING SUMMARY ===--- - Mirrors button in the logToll did not work today, however m4l was. (is this the same problem as yesterday?) - Completed a large section of 82S, Lambda 121 to -126.3, Supernova - Lots of software problems, which cost us about 2 hours of imaging; see log. - Skippy button in nightLog not working; see log. - Dimm problems again; see log. ---=== OBSERVING LOG ===--- Afternoon checkout: ------------------- Fritz soleved the ssh key transfer problems from pt1 to sdsshost2, and for sos. Now we can ssh to sdsshost2 from pt1 and host as an "observer" user. Imager tested with bias, spectrographs as well. MIG values were not red in (again) when we pressedd the button in logTool. but we cut and pasted m4l result from the iop window. sdsshost was rebooted today so we had a couple of problems: - laptop at the 2.5m telescope was frozen this afternoon showing a gray screen. It needed to be powerdown, then the first (default) linux version did not conected to sdsshot, the second one did, so I telent to sdsshost2 from sdsshost and opened MCP and telrun windows. - spectro guider: pcnfs was not reastarted, so the guider frame were not read in: 0 0 F GCamReply="could not open file: guider:gimg0032.fits; error: No Error Fritz restarted the nfs and after rebooting the mac, setting up inst =spectro in telrun, everything was wroking again. The telescope is ready. Night: ------ 02:20Z We setup on 82S ~20-minutes before the end of twilight and did a short test scan to get the focus and pointing corrected; the run# = 5579. In the mean time, Eric was making needed software adjustments, which were Murmur related. We stopped the test drift and moved to the -startLambda of the supernova run of 5580, but we could not open the shutter via a goDrirt. The TB is below. im> goDrift Flavor of this run (science, bias, calibration, engineering, ignore, help) []: science Stripe, Strip (e.g, 22,N or SS,N) [82,S]: Please provide a one line comment [] start lambda 112 Error im> tb no murmur log. Heartbeat results unknown. invoked from within "murHeartBeat $iccList" invoked from within "if {[cameraType] == "imager"} { # make the icc's send out a message indicating they are alive murmur "Murmur Heartbeat to $iccList in in ..." (procedure "init4Data" line 20) invoked from within "init4Data " invoked from within "if { $initData } { init4Data }" (procedure "goDrift" line 72) invoked from within "goDrift" im> im> goDrift Flavor of this run (science, bias, calibration, engineering, ignore, help) []: science Stripe, Strip (e.g, 22,N or SS,N) [82,S]: 82,S Please provide a one line comment [] super nova CAMERA im: FAILURE on ftelnet: connection error in ftelnet: connection refused -- MURMUR CLIENT STATUS : "Can't SEND to MURMUR server - IO error" -- Errno message : -- MURMUR CLIENT STATUS : "Can't SEND to MURMUR server - IO error" -- Errno message : mur_send_text failure, error code : 0x800001fa Error: cannot take control of camera line -------------------------- Eric suggested that we reboot sdssHost2 and the crates. Fritz performed the former from home. We also had to kill all of our sdssHost2 sessions. And, we had to restart the servers, when we had blue screens. Afterwards, we got this watcher message below: --------------------------- (dsc E archWrFail Error archiving frame 5580 16.25: Failed to close file 13 (dsc_E_archWrFail Error archiving frame 5580 16.25: Failed to close file 13 : 2005-09-09 03:38:17Z ) TEXTONLY *** FATAL *** dscArch: While writing frames - 1 (TEXTONLY *** FATAL *** dscArch: While writing frames - 1 : 2005-09-09 03:38:17Z) ----------------------------- Although the rebooting and restarting everything improved our situation, the murmur log was still not reporting any information. 04:00Z With Eric's, Fritz's and Jurek's help, we were able to get operational again and start the supernova run (#5582); see Imaging details for more information. At about 35-frames, however, watcher informed us that no gangs were being transfered. We issused the teamster 60 imager -force command twice and the transfer was restored. Eric made other murmur adjustments, which repaired that problem too. Once data collection was underway, we performed the imaging QA procedure. The skippy numbers, for some reason, were not being transfer to the log when we click the Skippy button in logTool or after running skippy from an iop session. So, we had to run skippy in an Astrom session and copy/paste the numbers into the log. We got the following watcher messages several times during the night: TEXTONLY *** FATAL *** dscArch: While writing frames - 1 (TEXTONLY *** FATAL *** dscArch: While writing frames - 1 : 2005-09-09 09:46:34Z ) TEXTONLY *** FATAL *** dscArch: While writing frames - 1 (TEXTONLY *** FATAL *** dscArch: While writing frames - 1 : 2005-09-09 09:56:26Z ) -------------------------------- 07:01Z We checked air compressor #2 and found it to be offline. Se, we restated it. We noticed earlier in the night that DIMM was not working, i.e., its computer was unhappy. But because of the other problems during the night and the TV crew video taping us, we did not have time to deal with the Dimm until much after midnight. We tried pressing the reset button on DIMM computer in the lower enclosure, yet we did want to uncover the very bright LCD monitor while we were imaging. So, we waited until we ended the drift at twilight before checking the DIMM and discovering that it seemed okay. We also dismounted the laser-pointer finder (EZ Finder) to see about replacing its dead batteries. We mailed the runLogs. endNight finished and was happy. Misc. watcher messages are in the Problems Section. ----------------------------------------------- For the supernova guys and run 5582. We tried the supernova script, but it failed. So, we went to get Rick. Output from check_disk.cmd: Can process up to 827 frames. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 5578 23:23Z 23:53Z 100 O 48.10 55.74 63 ignore 5579 02:18Z 02:40Z 82 S 111.78 117.20 50 ignore 5579 02:18Z 02:41Z 82 S 111.78 112.11 50 ignore 5580 03:29Z 03:50Z 100 O 109.64 115.02 49 bias 5581 03:55Z 03:57Z 82 S 117.39 117.95 18 ignore ---=== IMAGING RUN DETAILS ===--- Run 5578: test scan; ignore Run 5579: test scan; ignore Run 5580: Bias, 30+ frames, T-bars unlatched, on telescope. Run 5581: test scan; ignore ++++++++++++++++++++++++ Run 5582: Supernova Science, 82S, -startLambda 121 -endlambda -126.3 Frame Lambda Notes ----- ------ -------------------------------------------------------- 020 121 Focus converged, skippy is happy; seeing ~1.8 to 2.2" 561 202.3 Seeing improved to ~1.6" or better. 778 -126.3 End supernova science. +++++++++++++++++++++++++ ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- 5582 20 5 164 -0.2 0.155 5.0 0.138 -.0001 -0.2 5 5582 70 5 155 -0.2 0.182 5.0 0.162 -.0004 -0.1 5 5582 120 5 98 -0.4 0.177 4.9 0.147 .0001 0.3 4.9 5582 170 5 97 -0.5 0.177 4.6 0.165 -.0004 0.5 4.6 5582 220 5 77 -0.4 0.179 4.5 0.123 -.0007 0.3 4.5 5582 270 5 53 -0.3 0.207 4.4 0.164 -.0016 0.1 4.5 5582 320 5 57 -0.3 0.205 4.3 0.183 -.0016 0.1 4.3 5582 370 5 62 0.2 0.183 4.1 0.142 -.0011 -0.7 4.1 5582 420 5 73 0.1 0.145 3.7 0.153 -.0003 -0.6 3.7 5582 470 5 66 0.1 0.169 3.5 0.160 -.0018 -0.5 3.5 5582 520 5 69 0.3 0.144 3.3 0.127 -.0006 -1.0 3.3 5582 570 5 52 0.6 0.205 3.2 0.141 -.0005 -1.5 3.1 5582 620 5 86 1.4 0.119 3.7 0.119 -.0014 -3.0 3.6 5582 670 5 90 1.2 0.143 3.4 0.112 -.0007 -2.5 3.3 5582 720 5 86 1.2 0.119 2.3 0.132 -0.001 -2.4 2.2 ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): y QA Procedures Done (y/n): y UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 33919, plate -9999 ------- 00:19 33919 0.0 bias ----- sequence 33925, plate -9999 ------- 03:36 33925 0.0 bias 03:39 33927 0.0 bias ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL Stays: JL ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 23:40Z 60 46 1 229 (SW) -9999 - 00:11Z 60 47 9 218 (SW) -9999 - ---=== TELESCOPE STATUS ===--- 01:00Z Opened doors and louvers, turned on fans. 01:15Z Pulled enclosure 12:11Z Enclosure on, fan off, doors and louvers closed. Telescope at 121,30,00 mount with cart 05 mounted. LN2 connected and turned on; CW at 145 lbs Spectro 244lbs 16psi Imager 183lbs 21psi ---=== SOFTWARE USED ===--- IOP/SOP: iop neilsen Watcher: watcher MCP: v5_26_0 TPM: tpm_v3_1_0 AstroDa: biery TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: SoS: v4_10_7 hoggPT: v1_6_9 plate-mapper: ---=== MIRROR NUMBERS ===--- PRIMARY: ----- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: -5.8430 -5.8440 Axial B: -5.6770 -5.6770 Axial C: 0.9430 0.9420 Trans D: -9.9920 -9.9940 Lateral E: 10.3759 10.3759 Lateral F: 11.9380 11.9380 GALILS Commanded: 4700. -2450. 3000. -7800. 3300. 3000. Actual: 4700. -2450. 3000. -7800. 3300. 3000. SETMIR VALUES primDesOrient: 0.00 -1.68 7.05 385.25 92.02 primOrient: 0.00 -1.52 7.02 384.99 93.81 SECONDARY: ------- Focus: 0.0 Air temp: 13.7 C Altitude: 30.00 MIGS TONIGHT NOMINAL Axial A: 1.5410 1.5420 Axial B: 1.0480 1.0470 Axial C: 1.1630 1.1650 Trans D: -0.1070 -0.1240 GALILS Commanded: 1593450. 1603650. 1554300. -6800. -5900. Actual: 1594206. 1603661. 1555057. -6800. -5900. SETMIR VALUES secDesOrient: 1257.00 15.87 0.00 -50.00 136.76 secOrient: 1257.40 15.70 -0.20 -49.69 136.85 ---=== PROBLEMS IN DETAIL ===--- ----= Misc Watcher Messages ==--- m1 temp (Excessive Telescope - Ambient Difference:Excessive Front-Back Difference (Right Half):Excessive Front-Back Difference (Upper Half): 2005-09-09 03:35:42Z ) env temp (Excessive Return - Ambient Difference:Excessive Floor - Ambient Difference: 2005-09-09 03:35:42Z) tmicro (Disconnected Sensor in M2B4:: 2005-09-09 03:35:42Z) TEXTONLY *** FATAL *** dscArch: While writing frames - 1 (TEXTONLY *** FATAL *** dscArch: While writing frames - 1 : 2005-09-09 06:15:48Z) TEXTONLY *** FATAL *** dscArch: While writing frames - 1 (TEXTONLY *** FATAL *** dscArch: While writing frames - 1 : 2005-09-09 09:30:20Z)