APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Sunday September 28, 2008 (MJD 54738) ---=== OBSERVING TEAM ===--- Dan Oravetz Elena Malanushenko Bill Borowski Viktor Malanushenko - PT Dan Long - call support ---=== OBSERVING PLAN ===--- BOSS/SEGUE Science ! ---=== OBSERVING SUMMARY ===--- It was clear and almost photometric but seeing 2-3". We did spectroscopy: observed plates 3110,3138,3130,3106. One plate 3106 is done. We had a problem with sop as it failed to readout the exposure. We lost 2.5 hours of observations but could not fix the problem. Dan Long can provide more detailes as he tried to monitor the problem with us. He suggested Jon or Fritz to check the fibers went to spectro crate. The Dimm's computer does not boot. ---=== OBSERVING LOG ===--- Afternoon: ---------- All systems are checked and work properly. Spectral collimation was set for 9C and did not change. Dimm computer did not boot. We reboot it but it did not help. Night: -------- Light cirrus, seeing ~2", wind ~20 mph, humidity ~60C. 00:10Z ventilation is on 01:00Z enclosure is off cart 8 plate 3138, segue FK5 was used as it was still bright outside. 01:52 preCalibs 02:13Z Twi 02:00 science 1500 02:28 science 1500 02:59 preCalib 03:06 science 1500 03:34 science 1500 04:02 postCalib Not Done. Cart 5 plate 3130, segue FSonGTF 04:22 preCalib 04:29 science 1500 04:57 science 1500 05:25 postCalib not Done yet. Cart 9 plate 3106 FSonGTF 05:44 preCalib 05:52 science 1500 the seeing jumped up to 3". 06:19 science 1500 06:47 postCalib This plate is DONE. It could be declared as DONE last night based on adjusted Connie's criteria. So we got some extra signal on this plate. Cart 6 plate 3110 FSonGTF 07:13 preCalib 07:20 science 1500 07:51 science 1500 8:37Z When this exposure is finished based on sop exposure counter, it did not start readout for 5 more minuts. We tried to abort this exposure using "pause" and "endStare - force" but it did not help. Tried to do postCal but we got errors: "goStare was not successful, trying again: Exposure was not created. Spectro displays stopped to show the observations. At the same time Watcher complained: "sp1>Status Busy Run 54738 Frame 55085 dead (Frame=55085 Row=1952: 2008-09-29 08:28:07Z)" The result was the same using co-pilot sop session. We rebooted the sop crate, restarted the server and all sop sessions, resert spectrograph. The problem was the same: sop could not complete the readout of exposure and kept sop status busy and not availble for next exposure. Used "iccExec [vmeList] statusGet daqBusy" to check the status. We tried to iccExec to abort the readout but it did not anythings. We consulted with Dan Long around 10:15 Z for a help. He confirmed the problem of readout of exposure. We did not fix the problem and Dan suggested to ask Jon or Fritz to check the fibers went to spectro crate. The humidity was rising. 11:00 the telescope is closed. EndNight is finished. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 7704 23:21Z 02:11Z 100 O 67.58 110.12 58 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): QA Procedures Done (y/n): UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 55055, plate -9999 ------- 23:17 55055 0.0 bias ----- sequence 55056, plate 3138 ------- 23:26 55056 10.0 flat 23:29 55057 2.0 arc 23:33 55058 3.0 arc 23:36 55059 3.0 arc ----- sequence 55060, plate -9999 ------- 00:32 55060 0.0 bias ----- sequence 55061, plate 3138 ------- 01:55 55061 10.0 flat 01:57 55062 2.0 arc 02:28 55063 1500.0 target 02:55 55064 1500.0 target 03:01 55065 10.0 flat 03:04 55066 2.0 arc 03:34 55067 1500.0 target 04:02 55068 1500.0 target 04:05 55069 10.0 flat 04:07 55070 2.0 arc ----- sequence 55071, plate 3130 ------- 04:24 55071 10.0 flat 04:27 55072 2.0 arc 04:56 55073 1500.0 target 05:24 55074 1500.0 target 05:27 55075 10.0 flat 05:30 55076 2.0 arc ----- sequence 55077, plate 3106 ------- 05:47 55077 10.0 flat 05:49 55078 2.0 arc 06:19 55079 1500.0 target 06:47 55080 1500.0 target 06:55 55081 10.0 flat 06:57 55082 2.0 arc ----- sequence 55083, plate 3110 ------- 07:16 55083 10.0 flat 07:19 55084 2.0 arc ----- sequence 55091, plate -9999 ------- 09:02 55091 0.0 bias 09:06 55093 0.0 bias 09:08 55094 0.0 bias ----- sequence 55100, plate -9999 ------- 10:41 55100 0.0 bias 10:41 55102 0.0 bias 10:51 55103 0.0 bias ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 02:11Z 8 3138 11.23 0.0001 44.53 0.0002 189.57 0.0154 1.000060 04:44Z 5 3130 53.77 0.0006 62.99 -0.0000 224.52 0.0028 1.000100 05:58Z 9 3106 31.66 0.0018 61.33 -0.0006 206.43 0.0283 1.000150 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 02:11Z 8 3138 1.00006 -591 784 75 11 44.6 8.6 18 74 -- 2.0" 04:43Z 5 3130 1.00010 -986 353 25 54 62.9 8.3 21 73 -- 1.8" 05:58Z 9 3106 1.00015 -1480 -52 25 32 61.2 8.3 20 77 -- 3.0" ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 22:43Z 53 34 1 105 (ESE) 941 - 23:17Z 53 34 6 71 (ENE) 865 - 23:49Z 52 32 10 78 (ENE) 812 - 00:20Z 51 33 6 88 (E) 863 - 00:50Z 49 34 13 80 (E) 914 - 01:22Z 48 34 17 63 (ENE) 968 - 01:54Z 48 34 20 73 (ENE) 963 - 02:25Z 47 35 20 75 (ENE) 1035 - 02:56Z 47 36 22 74 (ENE) 1066 - 03:27Z 46 36 20 68 (ENE) 1154 - 03:58Z 46 35 13 80 (E) 1172 - 04:29Z 46 34 19 75 (ENE) 1121 - 04:59Z 46 34 18 75 (ENE) 1094 - 05:31Z 46 34 17 77 (ENE) 1180 - 06:02Z 46 35 15 63 (ENE) 1202 - 06:35Z 45 35 14 82 (E) 1224 - 07:05Z 45 36 17 74 (ENE) 1274 - 07:35Z 44 36 20 74 (ENE) 1316 - 08:07Z 45 37 18 74 (ENE) 1280 - 08:39Z 44 36 9 84 (E) 1324 - 09:11Z 44 36 0 127 (SE) 1234 - 09:43Z 44 37 2 104 (ESE) 1310 - 10:14Z 44 36 5 95 (E) 1297 - 10:45Z 43 37 5 89 (E) 1304 - 11:17Z 43 36 11 56 (NE) 1261 - 11:50Z 44 36 3 264 (W) 1237 - ---=== TELESCOPE STATUS ===--- 00:10Z - Opened doors, started ventilation. 01:00Z - opened enclosure 11:00Z - Closed enclosure. Ventialion off Telescope stowed at 30 deg alt with cartridge 6 mounted Spectro auofill connected Counterweights at 250 No interlocks bypassed 11:50Z - Spectro dewar: 293 lb; 22 psi Imager dewar: 158 lb; 20 psi ---=== SOFTWARE USED ===--- IOP/SOP: v4_39_0 Watcher: v2_36_0 MCP: v6_4_0 TPM: tpm_v3_5_0 AstroDa: v15_13_1 TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: v2_43 SoS: v5_1_8 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000120 MIGS TONIGHT NOMINAL Axial A -0.0310 -0.0300 Axial B 0.0370 0.0390 Axial C -0.0390 -0.0400 Trans D -0.7560 -0.7570 Lateral E 10.5791 10.5537 Lateral F 12.1666 12.1539 GALILS Commanded: 29050. 18500. 24350. 8600. 10400. 10050. Actual: 29065. 18518. 24348. 8616. 10403. 10060. SETMIR VALUES PriDesOrient: 0.00 -11.72 8.60 496.70 640.50 PriOrient: -1183.95 -11.65 8.77 496.29 639.59 SECONDARY: ---------- Focus: 125.00 Air Temp.: 10.9 Alt.: 30.000576 MIGS TONIGHT NOMINAL Axial A 18.5630 18.5620 Axial B 15.6110 15.6080 Axial C 13.8180 13.8170 Trans D 15.1100 15.1170 GALILS Commanded: 548364. 450556. 517315. -3050. -4600. Actual: 548367. 450548. 517323. -3037. -4618. SETMIR VALUES SecDesOrient: 401.13 -12.00 -28.00 -39.00 94.77 SecOrient: 401.13 -12.00 -28.00 -39.35 94.71 ---=== PROBLEMS IN DETAIL ===--- Filename 02% 05% 10% 50% 90% 95% 98% ------------------- ------ ------ ------ ------ ------ ------ ------ sdR-b1-00055055.fit -6.1 -4.0 -2.8 2.7 7.6 9.3 10.7 sdR-b2-00055055.fit -7.9 -5.9 -4.2 1.6 6.9 9.2 10.6 sdR-r1-00055055.fit -7.1 -4.9 -3.5 1.6 7.5 9.5 11.4 sdR-r2-00055055.fit -8.0 -5.9 -3.8 1.5 7.7 9.8 12.0 ------------- Watcher complain: sp1> Status Busy Run 54738 Frame 55085 dead (Frame=55085 Row=1952: 2008-09-29 08:28:07Z) --------- Starting Flat field 0 (press cntrl-C to abort) goStare was not successful, trying again goStare was not successful, trying again goStare was not successful, trying again goStare was not successful, trying again goStare was not successful, trying again goStare was not successful, trying again Could not do goStare in 5 attempts Finished with Flat field 0 Finished with Flat Field Closing Flat Field Screen 4 Ne and 4 HgCd lamps are on Starting Arc lamp exposure 0 (press cntrl-C to abort) goStare was not successful, trying again goStare was not successful, trying again goStare was not successful, trying again goStare was not successful, trying again goStare was not successful, trying again goStare was not successful, trying again Could not do goStare in 5 attempts Finished with Arc Lamp exposure 0 Finished With Arc Lamps Opened Flat Field Screen Exiting successfully This calibration took 81.711 seconds ------------------------------ Start abother bias andsop session is quit with next error: Starting Flat field 0 (press cntrl-C to abort) Access to shared data area at 0x18000000 lost (errno=0x71 No route to host) Read failed from TCP icc40 (sdsssd1) rmt=0x18000000 cnt=0x000B9688 ******************************************************************************** * * * Communication between the ICC/OAC is no longer possible. * * * * Perform the following steps until operations are possible. * * * * 1. Check network connectivity between the machines. * * 2. Reboot (reset) the ICC. * * 3. Restart this (OAC) program. * * 4. Power-cycle the VMEbus crates. * * 5. Reboot the local machine (host). * * ------------------------------------------