APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday October 22, 2005 (MJD 53666) ---=== OBSERVING TEAM ===--- Night: Steph Snedden Mike Harvanek Support: Eric Neilsen (by phone) Kurt Biery (by phone) Visitors: Dozens from the SDSS II Advisory Council Meeting ---=== OBSERVING PLAN ===--- Supernova science then shakedown. ---=== OBSERVING SUMMARY ===--- Supernova imaging: 82 S from lambda +116 to 180 (including ramps). 82 N from lambda +176 to -129 (including ramps). Some problems with logTool accepting input. Focus, offsets, mirror numbers, spectro summary, skippy, ltmatch, software and weather info were all affected at one time or another. All shake items completed successfully except that iop was not declared current. There may be a new iop verion soon to correct a warning about a astroDA version mismatch. ---=== OBSERVING LOG ===--- Afternoon: ---------- There were problems starting up the test iop. Howard setup iop v4_6_0a in the morning for the servers, but we had not switched to the corresponding astroda. He switched back to the current iop to start the servers. Later in the day, Jon tried to setup an iop to do a bias drift for the VIPs but the iop session hung when sourcing tcl procs. Steph then tried setting up IOP v4_6_0a and astroda v15_6, did a dscSwSys and rebooted the crates. Her new iop also failed on sourcing tcl. We rolled back to iop v4_5_0 and astroda v15_4, rebooted crates again, and everything was okay again, after waiting for a udp socket to clear for the main server. We took a bias drift and set up for imaging. We will retry the new astroda and iop after supernova imaging. The bellows pressure was at 47 this afternoon. French was on site and was notified. The pressure went down to about 40 when we unlatched the tbars but went back up to 47 when we latched them again. sdssfiles1 crashed and needed to be rebooted. Night: ------ Supernova imaging to start. We wanted to take advantage of the moonless time and clear weather. We will save shake tasks for the second half of the night. Run 5762: On-telescope bias. Everything, including i5, looked okay. 01:44Z Run 5763: 82 S, start lambda +116. Everything good from the beginning. Skippy is reporting a nu error of around -9". Since we are sitting on an equatorial stripe, this error won't get much worse so we left it as is and continued. Photometric, excellent (< 1") seeing and no moon. Moonrise officially occurred at 04:11Z, frame 254, lambda +152.8. Moon was definitely above the trees by frame 330, lambda +164.1, probably sooner. The watcher started giving sky warnings about this time: skyL (04:54:31Z 2005-10-23 ccd51:) skyR (04:58:27Z 2005-10-23 ccd51:) We ended this drift at 06:00Z, frame 437, lambda +/-180, RA 5 degrees. All the data were good (photometric, good seeing) but the last 100 or so frames were probably a bit moony. Rick Kessler called and asked us to reboot sn09. We had to do it multiple times (3 or 4?) because it did not seem to be coming back up. Rick called Fritz and it turned out that he just wasn't waiting long enough for the machine to come back up. He was waiting only a few minutes when it actually took about 15-20 minutes to come back up. After ending run 5763, we switched over to the new iop (v4_6_0a) and new DA (v15_6) for shake. There were problems and both Eric Neilsen and Kurt Biery were called. It turned out that we just needed to add a -f to the dscSwSys command (dscSwSys -f v15_6) to get things to work. Note that until further notice we are using "setup iop -t" to setup iop. Also note that you will get a warning (which you can ignore) when you start up iop: Executable was built against version v15_5 of the DA; setup version is v15_6 Warning: oacVersion v15_5 != version reported by crates is v15_6 The reason we are not declaring iop current yet is that there may be another version soon (tomorrow?) to fix this warning. The new iop and DA were shaken successfully. Details are in the shakedown section below. Run 5764: On-telescope bias for iop/DA testing. 07:58Z Run 5765: 82 N, start lambda +176. Everything good from the beginning. The nu error is around -7". Conditions are not photometric, there is a fair bit of moon and the seeing is not as good as run 5763 (1.2 - 1.5") but the data should still be good. Clouds and lots of scattered light from frames 241 to 255 (lambda -148.6 to -146.5). Drift was ended at 11:36Z, frame 372, lambda -129, RA 56 degrees. All the data, except maybe that from frames 241 to 255, should be good. We quit the log when switching to the shake version of iop and then started it back up again. Upon startup, we got the following warning: im> logTool 2005-10-23 07:42:57Z: Failed to execute command on observer@plate-mapper.apo.nmsu.edu; ssh error was 1703: WARNING: RSA1 key found for host plate-mapper.apo.nmsu.edu in /home/observer/.ssh/known_hosts:34 RSA1 key fingerprint 50:79:a0:1e:a2:71:9e:63:a8:30:c6:d3:79:97:99:46. 1703: Host key verification failed. .logtool.logviewer2 im> Furthermore, offset, focus and weather info were no longer being accepted into the log. The offset and focus info were recovered using o4l and f4l, respectively, but the weather info was not recovered. Skippy, spectro summary, ltmatch, software and mirror numbers were also affected. The DIMM was not functional due to a computer problem. We believed the system needed to be rebooted but since we already had a live telescope and were taking good (photometric, excellent seeing) supernova data, we delayed the reboot. However, it turned out that the software was just hung and Steph was able to solve the problem by logging off the administrator and then logging back on (as administrator). endNight finished. It did not find the mcptpm logs (probably because cleanupMurmur was run early in the day) but other than that it rejoiced. Shakedown tasks: ---------------- Changes to sdssProcedures were verified. The new version is v2_06. The TCC and new Multinet were tested during supernova imaging. Everything appeared to work normally. The plug plate database has a new feature. When a "bright" segue plate is declared done, the priority of its counterpart "faint" plate is now increased to 4 automatically and this plate is moved to the top of the plugging list. Thanks Steve. PR 6452 closed. 06:00Z to 07:58Z: We shook the new iop/DA successfully. The FITS header words DATASUM and CHECKSUM are present in the photo frame files. They are not present in the photo and astro gang files. frameCatcher didn't complain about any of the checksum values. Although we did have an ftp hang up error tonight (dsc E archTaskErr Archive task error: FTP connection is hung. 2005-10-23 08:18:20Z), the instructions for shaking this situation were unclear and we did not want to wake Kurt up again. Since we will continue to run this iop/DA combination, we'll call Kurt when we get an FTP hang up at a more reasonable hour. The new iop was not declared current in anticipation of a new version soon to correct the warning we get on start up. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 5761 23:16Z 23:30Z 100 O 89.60 93.16 37 ignore 5762 01:17Z 01:36Z 100 O 120.06 124.80 46 bias on-telescope 5763 01:43Z 06:01Z 82 S 115.78 -179.71 445 science good 5764 07:38Z 07:50Z 100 O -144.33 -141.41 34 bias on-telescope 5765 07:58Z 11:36Z 82 N -183.59 -128.81 380 science good ---=== IMAGING RUN DETAILS ===--- See the main log. ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- 5763 17 4 12 -8.900 2.263 -3.400 2.011 0.08592 200 56 5763 39 4 68 -0.500 0.118 -8.700 0.106 0.00024 200 56 5763 67 4 108 -0.100 0.164 -8.600 0.127 0.00067 200 56 5763 120 4 116 -0.300 0.152 -7.000 0.111 0.00019 200 56 5763 172 4 76 0.000 0.127 -6.900 0.098 0.00017 200 56 5763 226 4 55 0.200 0.171 -7.100 0.113 0.00004 200 56 5763 277 4 47 0.500 0.104 -7.200 0.114 0.00060 200 56 5763 329 4 42 0.900 0.608 -6.900 0.758 0.00247 200 56 5763 381 4 40 1.000 0.161 -6.900 0.129 -0.00026 200 56 5765 32 4 41 -2.000 0.154 -7.200 0.143 -0.01526 241 37 5765 208 4 41 -1.100 0.117 -8.300 0.138 -0.01617 241 37 ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ 5763 23 1 56 340 75 -1.338 0.113 -0.295 0.117 0.00099 5763 23 1 56 340 66 -0.923 0.106 -0.229 0.138 0.00077 5763 23 1 56 340 72 -0.554 0.095 -0.097 0.202 0.00033 5763 23 1 56 340 79 -0.273 0.118 0.017 0.184 -0.00006 5763 23 1 56 340 76 0.032 0.167 -0.037 0.122 0.00012 5763 25 1 56 340 66 -1.461 0.138 -0.209 0.135 0.00070 5763 25 1 56 340 61 -1.031 0.127 -0.074 0.109 0.00025 5763 25 1 56 340 70 -0.641 0.163 0.022 0.163 -0.00007 5763 25 1 56 340 75 -0.356 0.123 0.064 0.170 -0.00022 5763 25 1 56 340 82 0.009 0.130 -0.054 0.214 0.00018 5763 43 1 56 340 77 -1.252 0.116 -0.671 0.144 0.00226 5763 43 1 56 340 72 -0.873 0.106 -0.527 0.119 0.00177 5763 43 1 56 340 73 -0.446 0.120 -0.389 0.208 0.00131 5763 43 1 56 340 75 -0.246 0.145 -0.261 0.152 0.00088 5763 43 1 56 340 70 0.143 0.095 -0.129 0.123 0.00043 5763 79 1 56 340 62 -1.321 0.155 1.079 0.149 -0.00363 5763 79 1 56 340 76 -0.961 0.121 1.205 0.160 -0.00405 5763 79 1 56 340 75 -0.534 0.142 1.455 0.147 -0.00489 5763 79 1 56 340 77 -0.204 0.193 1.654 0.163 -0.00556 5763 79 1 56 340 72 0.106 0.166 1.820 0.140 -0.00612 5763 131 1 56 340 63 -0.834 0.097 -1.110 0.086 0.00373 5763 131 1 56 340 57 -0.554 0.085 -0.948 0.149 0.00319 5763 131 1 56 340 68 -0.111 0.116 -0.725 0.131 0.00244 5763 131 1 56 340 51 0.169 0.157 -0.665 0.101 0.00224 5763 131 1 56 340 53 0.369 0.111 -0.422 0.149 0.00142 5763 148 1 56 340 44 -0.935 0.123 -0.744 0.147 0.00250 5763 148 1 56 340 66 -0.518 0.079 -0.500 0.143 0.00168 5763 148 1 56 340 51 -0.236 0.104 -0.245 0.194 0.00082 5763 148 1 56 340 40 0.133 0.119 -0.107 0.183 0.00036 5763 148 1 56 340 51 0.359 0.104 -0.095 0.141 0.00032 5763 183 1 56 340 30 -0.965 0.186 -1.034 0.137 0.00348 5763 183 1 56 340 44 -0.613 0.156 -0.900 0.247 0.00302 5763 183 1 56 340 36 -0.321 0.187 -0.929 0.175 0.00312 5763 183 1 56 340 29 -0.037 0.171 -0.821 0.129 0.00276 5763 183 1 56 340 25 0.313 0.157 -0.625 0.126 0.00210 5763 200 1 56 340 35 -0.657 0.109 -0.726 0.110 0.00244 5763 200 1 56 340 34 -0.367 0.053 -0.748 0.094 0.00251 5763 200 1 56 340 40 0.020 0.135 -0.460 0.187 0.00155 5763 200 1 56 340 30 0.348 0.151 -0.212 0.222 0.00071 5763 200 1 56 340 41 0.693 0.110 -0.106 0.107 0.00036 5763 236 1 56 340 24 -0.456 0.188 -0.348 0.170 0.00117 5763 236 1 56 340 39 -0.193 0.175 -0.478 0.166 0.00161 5763 236 1 56 340 27 0.157 0.158 -0.157 0.121 0.00053 5763 236 1 56 340 23 0.479 0.141 0.038 0.141 -0.00013 5763 236 1 56 340 32 0.784 0.174 0.037 0.196 -0.00013 5763 253 1 56 340 24 -0.532 0.158 -0.703 0.176 0.00236 5763 253 1 56 340 31 -0.376 0.210 -0.744 0.184 0.00250 5763 253 1 56 340 27 0.082 0.121 -0.452 0.248 0.00152 5763 253 1 56 340 19 0.390 0.110 -0.499 0.131 0.00168 5763 253 1 56 340 36 0.587 0.090 -0.222 0.108 0.00075 5763 289 1 56 340 23 -0.908 0.120 -0.647 0.114 0.00217 5763 289 1 56 340 23 -0.462 0.096 -0.699 0.136 0.00235 5763 289 1 56 340 27 -0.091 0.161 -0.258 0.146 0.00087 5763 289 1 56 340 18 0.184 0.164 -0.157 0.145 0.00053 5763 289 1 56 340 28 0.492 0.153 0.125 0.204 -0.00042 5763 306 1 56 340 26 -0.550 0.149 -0.658 0.202 0.00221 5763 306 1 56 340 24 -0.259 0.221 -0.484 0.309 0.00163 5763 306 1 56 340 19 0.261 0.194 -0.227 0.339 0.00076 5763 306 1 56 340 18 0.636 0.181 -0.088 0.224 0.00030 5763 306 1 56 340 14 0.804 0.182 0.017 0.172 -0.00006 5763 341 1 56 340 19 -0.705 0.231 -0.625 0.187 0.00210 5763 341 1 56 340 11 -0.270 0.206 -0.247 0.142 0.00083 5763 341 1 56 340 27 0.110 0.146 -0.007 0.212 0.00002 5763 341 1 56 340 21 0.388 0.160 -0.077 0.194 0.00026 5763 341 1 56 340 22 0.621 0.160 -0.052 0.226 0.00018 5763 358 1 56 340 15 -0.549 0.101 -0.399 0.058 0.00134 5763 358 1 56 340 13 -0.113 0.093 -0.182 0.199 0.00061 5763 358 1 56 340 14 0.349 0.078 0.135 0.162 -0.00045 5763 358 1 56 340 26 0.553 0.121 0.031 0.170 -0.00010 5763 358 1 56 340 16 0.843 0.134 0.081 0.152 -0.00027 5763 393 1 56 340 16 -0.834 0.146 -0.657 0.131 0.00221 5763 393 1 56 340 14 -0.506 0.089 -0.500 0.124 0.00168 5763 393 1 56 340 12 -0.064 0.117 -0.249 0.159 0.00084 5763 393 1 56 340 24 0.119 0.111 -0.087 0.180 0.00029 5763 393 1 56 340 14 0.407 0.131 -0.021 0.252 0.00007 5763 410 1 56 340 11 -0.845 0.144 -0.638 0.184 0.00214 5763 410 1 56 340 17 -0.482 0.086 -0.526 0.186 0.00177 5763 410 1 56 340 14 -0.141 0.133 -0.387 0.261 0.00130 5763 410 1 56 340 18 -0.005 0.135 -0.205 0.218 0.00069 5763 410 1 56 340 19 0.229 0.105 -0.089 0.105 0.00030 ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): YES QA Procedures Done (y/n): NO UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 34278, plate -9999 ------- 00:56 34278 0.0 bias 34279 is missing due to a reboot of the DA. 01:20 34280 0.0 bias 07:48 34281 0.0 bias 34282 is missing due to a reboot of the DA. 07:50 34283 0.0 bias ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 02:19Z imager -19.56 0.0000 55.56 0.0000 73.41 0.0000 1.000000 09:15Z imager 298.99 0.0000 37.20 0.0000 42.46 0.0000 1.000000 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL Stays: JL ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 02:19Z imager 1.00000 0 -354 -253 -20 55.6 10.1 5 265 23 0.8" 03:19Z imager 1.00000 0 -368 -267 -20 55.6 9.5 5 195 23 0.8" 04:19Z imager 1.00000 0 -374 -273 -20 55.6 8.9 6 182 23 1.0" 05:19Z imager 1.00000 0 -362 -261 -20 55.6 8.8 6 186 23 1.0" 09:15Z imager 1.00000 0 -312 -274 299 37.2 10.3 5 360 23 1.1" 10:16Z imager 1.00000 0 -331 -293 299 37.2 10.4 3 328 23 1.4" ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 01:50Z 50 28 3 270 (W) -9999 - clear 02:54Z 48 30 4 256 (WSW) -9999 - clear 03:24Z 48 30 5 199 (SSW) -9999 - clear 03:54Z 49 29 5 180 (S) -9999 - clear 04:26Z 48 35 5 182 (S) -9999 - clear 04:58Z 47 36 6 184 (S) -9999 - clear 05:31Z 47 36 5 184 (S) -9999 - clear Weather input ceased after we quit the log to switch to the shake version of iop. ---=== TELESCOPE STATUS ===--- 23:30Z Enclosure doors opened, fans and blowers on, louvers opened. 00:20Z Enclosure off. 11:50Z Enclosure on, doors closed, fans and blowers off, louvers closed. Telescope stowed at 30 degrees with cartridge 5 mounted. Counterweights at 275. Spectro auto-fill connected. Spectro dewar 12:14 147 lb, 23 psi Imager dewar 12:14 191 lb, 21 psi No interlocks bypassed. ---=== SOFTWARE USED ===--- IOP/SOP: v4_5_0 Watcher: v2_30_2 MCP: v5_26_0 TPM: tpm_v3_1_0 AstroDa: v15_4 TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: v2_06 SoS: v4_10_7 hoggPT: v1_6_9 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- The mirror numbers were checked using m4l and they looked fine but they did not get recorded in the log for some reason. ---=== PROBLEMS IN DETAIL ===---