APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday September 7, 2002 (MJD 52525) ---=== OBSERVING TEAM ===--- Swing: Jurek Krzesinski Night: Pete Newman, Scot Kleinman ---=== OBSERVING PLAN ===--- Science per this month's plan: http://hello.apo.nmsu.edu/~sjnk/sdss/obsplans/science/sci.sep02.html ---=== OBSERVING SUMMARY ===--- Variable levels of cloud lost us a lot of photons, and hardware failures on the observers' console (landru) lost us about an hour of time. However, we finished off 2 plates (682, 1086) and got good data on two more (1034, 1081). The landru problem is serious - we need the machine fixed or a replacement X terminal as soon as possible. ---=== OBSERVING LOG ===--- Rain in late afternoon a continuing variable heavy cloud past sunset kept us closed until ~04:10Z when most of the sky cleared except for the extreme south enough to tempt us to open, although we logged many more hours to "clouds". Observing sequence: 04:36Z Plate 1034, cartridge 1. Not done in 2 good exposures (and several bad) even when added to prior night's data (Low-z plate requires [S/N]^2 >30 in r). FK5 star needed to get offsets. After one good exposure, we got too many clouds to get acceptable S/N. At the end of the plate's design time, we got another good tracked exposure. 07:19Z Plate 682, cartridge 2. Done in 3 exposures. GSOGF. On the first exposure, landru died taking the SOP session with it. See problem section #1 for details and how we recovered. We lost ~30 minutes to recovering. 09:18Z Plate 1086, cartridge 9. Done in 2 exposures when added to prior night5's data. GSOGF. Immediately after the preCalibs finished reading out, landru died again. We decided to not use it, although we do not have a spare machine or X terminal, so Scot (driving) used the monx3 terminal that is normally reserved for the instrument server session. We lost ~20 minutes recovering this time. 10:37Z Plate 1081, cartridge 7. GSOGF. Not done in 2 exposures. SoS failed to reduce exposure 16320 for camera r1. See problem section #2 for details. endNight finished ok. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 3329 22:58Z 23:24Z 100 O 40.64 47.13 57 ignore doghouse bias ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 16277, plate -9999 ------- 22:55 16277 0.0 bias ----- sequence 16278, plate 1086 ------- Collimation checks - ignore 23:27 16278 10.0 flat 23:33 16279 2.0 arc 23:41 16280 3.0 arc 23:44 16281 3.0 arc 00:06 16282 3.0 arc 00:08 16283 3.0 arc 00:31 16284 3.0 arc 00:34 16285 3.0 arc 00:51 16286 2.0 arc 00:54 16287 2.0 arc 01:03 16288 10.0 flat ----- sequence 16289, plate 1086 ------- 02:33 16289 0.0 bias ----- sequence 16290, plate 1034 ------- 04:49 16290 10.0 flat 04:52 16291 2.0 arc 05:15 16292 1000.0 target 05:41 16293 1003.0 target 06:33 16294 1501.0 target 07:01 16295 1501.0 target 07:09 16296 240.0 smear 07:13 16297 10.0 flat 07:15 16298 2.0 arc ----- sequence 16299, plate 682 ------- 07:25 16299 10.0 flat 07:28 16300 2.0 arc ??:?? 16301 ????.? target Info in file is correct execpt exposure # ----- sequence 16304, plate 682 ------- 08:04 16304 1200.0 08:10 16305 0.0 bias 08:42 16306 900.0 target 09:00 16307 901.0 target 09:08 16308 240.0 smear 09:12 16309 10.0 flat 09:14 16310 2.0 arc ----- sequence 16311, plate 1086 ------- 09:24 16311 10.0 flat 09:27 16312 2.0 arc 09:42 16313 0.0 bias 10:07 16314 901.0 target 10:25 16315 901.0 target 10:33 16316 240.0 smear ----- sequence 16317, plate 1081 ------- 10:42 16317 10.0 flat 10:45 16318 2.0 arc 11:05 16319 901.0 target 11:23 16320 901.0 target ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 04:58Z 1 1034 30.72 0.0020 53.11 -0.0023 205.41 0.0147 0.999900 07:34Z 2 682 -1.10 0.0020 57.21 0.0006 179.05 -0.0006 1.000140 11:22Z 7 1081 -51.28 0.0014 44.28 0.0015 138.96 -0.0215 1.000170 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL5518 Stays: JL5519 ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 04:58Z 1 1034 0.99990 986 1779 -210 31 53.1 12.3 14 89 BG38 2.5 08:11Z 2 682 1.00014 -1381 -191 -210 -17 56.0 14.6 6 339 BG38 2.0 09:39Z 9 1086 1.00014 -1381 -274 -300 -30 53.3 13.4 2 341 BG38 2.0 11:22Z 7 1081 1.00017 -1678 -490 -300 -51 44.3 12.8 2 349 BG38 2.0 ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 22:40Z 51 48 15 87 (E) 219 - Var. heavy cloud 23:12Z 51 47 14 98 (E) 218 - " 23:44Z 52 47 17 125 (SE) 268 - " 00:16Z 53 48 11 137 (SE) 330 - " 00:48Z 56 46 14 109 (ESE) 292 - " 01:20Z 55 46 12 90 (E) 258 - " 01:45Z 55 45 14 90 (E) 247 - " 02:17Z 55 45 15 82 (E) 267 - " 02:50Z 55 43 11 89 (E) 256 - " 03:22Z 55 42 9 89 (E) 243 - " 03:55Z 54 43 15 80 (E) 244 - " 04:27Z 54 44 14 97 (E) 303 - Mostly clear 04:58Z 54 44 13 89 (E) 301 - " 05:30Z 53 44 9 91 (E) 278 - " 06:00Z 53 44 10 81 (E) 326 - Variable cloud 06:31Z 53 44 9 82 (E) 324 - " 07:01Z 54 42 9 81 (E) 365 - " 07:33Z 55 41 5 82 (E) 313 - " 08:05Z 58 40 7 327 (NNW) 317 - " 08:38Z 57 40 3 273 (W) 288 - " 09:09Z 56 41 6 312 (NW) 328 - " 09:39Z 56 41 2 341 (NNW) 359 - " 10:11Z 55 41 5 352 (NNW) 350 - Clear 10:43Z 53 41 6 353 (NNW) 347 - " 11:14Z 55 41 6 331 (NNW) 347 - " 11:47Z 55 41 3 338 (NNW) 337 - ---=== TELESCOPE STATUS ===--- 04:10Z Fans on, doors open 04:15Z Enclosure off Telescope stowed at: 30 deg Instrument mounted: Cartridge 9 Counterweights at: 280 Autofill systems: On 180L LN2 dewar weights: Spectro 240 lb Imager 167 lb Interlocks bypassed: Alt slip, az slip. Slip detection tripped: Rot slip, reset at 01:00Z ---=== SOFTWARE USED ===--- IOP/SOP: v3_82_7 Watcher: v2_19_0 MCP: v5_13_4 TPM: tpm_v2_16_0 AstroDa: v14_47 TCC: 2.6.5 sdssProcedures: v1_51 SoS: v4_9_10 hoggPT: v1_5_8 plate-mapper: v4_1_0 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.0870 0.0890 Axial B 0.8030 0.8040 Axial C 0.0780 0.0790 Trans D -1.5280 -1.5180 Lateral E 1.8280 1.8220 Lateral F 0.0000 0.0000 GALILS Commanded: 5400. -3700. 900. -200. 31550. 30650. Actual: 5400. -3700. 900. -200. 31550. 30650. SETMIR VALUES PriDesOrient: 0.00 -11.80 23.00 1256.90 642.10 PriOrient: 0.00 -12.16 22.81 1257.41 642.19 SECONDARY: ---------- Focus: 0.00 Air Temp.: 11.0 Alt.: 30.010042 MIGS TONIGHT NOMINAL Axial A 1.4630 1.4640 Axial B 1.1510 1.1520 Axial C 1.0760 1.0770 Trans D -0.7180 -0.7160 GALILS Commanded: 1661538. 1539259. 1550238. -4550. -1550. Actual: 1661550. 1539250. 1550250. -4550. -1550. SETMIR VALUES SecDesOrient: 1257.00 10.00 -40.00 -100.00 64.19 SecOrient: 1256.99 10.01 -40.00 -100.17 64.08 ---=== PROBLEMS IN DETAIL ===--- Problem #1 - landru died in mid exposure ---------------------------------------- landru just hung up entirely and did not repond to the front-panel reset button. We power cycled it once and it died again half-way through the boot seuqnce (after fixing and entry in the root "/" partition). We power cycled again and this time it came up all the way. The exposure that was running finished and sat on the ccd. We opened another SOP session and successfully grabInst'ed the spectrographs. We then found we needed to issue the following commands to get the exposure to read out (the Observing spectroscopy folklore hint for using endStare to force a read only works in the _same_ SOP session): set scanType(flavor) 'science' loadCart 2 682 set scanType(plateId) 682 endStare -read -force The set commands get round complaints from endStare that those values were missing (because this was not the originating SOP session), but in the end it's not clear which of these were strictly necessary. By this time we'd used engough endStares to get the frame, sequence and exposure numbers messed up. A goStare -init -bias fixed that on sdshost. We found we needed to used the SoS apoheader command to determine that the flavor had NOT been set in the data files, so we used the apofix command to correct flavor and the remove2redo command suggested by apofix (thanks, David!) to get SoS to reduce the data: IDL> apofix, 16301, 'flavor', 'science' IDL> remove2redo, mjd=52525, expnum=16301 All this was worth the effort as it was a good exposure! Landru died again with the same symptoms about 02:22Z, and we left it powered down. APO site PR 2002148 updated, assigned to Craig Loomis, and raised to immediate/cannot operate severity. We need landru fixed or an extra X terminal within a week. Problem #2 - SoS failed to reduce an exposure --------------------------------------------- We saw on the SoS web page that exposure 16320 camera r1 did not reduce. We used sos_redo expnum=16320 on sos.apo and...it hung, after saying: REMOVE2REDO: Trying to lock the logfile /data/spectro/spectrologs/52525/logfile-52525.fits sos_status then reported: The following lock files exist: -rw-rw-r-- 1 observer dss 1 Sep 8 05:46 ./logfile-52525.fits.lock which we removed, after which sos_redo completed and the exposures were reduced ok. Not sure what this was - no PR filed yet.