APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday August 17, 2004 (MJD 53235) ---=== OBSERVING TEAM ===--- Pete Newman Steph Snedden Larry Carey (swing support) ---=== OBSERVING PLAN ===--- Science! ---=== OBSERVING SUMMARY ===--- More high humidity & clouds. No science but more arcs studied. Three conclusions: 1) The bit-swapping problem dominated the NLAMPS problem on MJD 53228 2) Tonight, NLAMPS was suppressed when an arc followed immediately after a flat. 3) In the case of item 2, there was a strong anti-correlation between the strength of one measured Cd emission line and the value of NLAMPS. Why do excitation levels in an arc depend on whether or not a flat was done just prior to the arc? ---=== OBSERVING LOG ===--- Swing: ----- Larry replaced the Hg-Cd lamps with the new-old ones...or was that the old-new ones? (The ones that were first installed this dark run, anyway.) Instruments and telescope checked out okay. Spectrograph r1 focus was marginal, but rotator was at 0 degrees, so focus was not changed. Night: ------ Clouds and humidity were present from sunset on. We performed more arc lamp tests. Pete looked at the saddlebag control and data connectors for spectrograph 2 after powering it down. There was nothing obviously wrong, Perhaps just reseating them will solve the bit-swapping problem (she said optimistically). This was done AFTER we had already taken some arcs. Frame numbers >= 28020 were taken after the connectors were reseated. There was no evidence of bit-swapping before the connectors were touched, though, and none after. We did see evidence that there was another problem besides bit-swapping, however. We saw several yellow NLAMP warnings in BOTH r1 and r2 for arcs taken just after a flat, as in a regular pre-or-post-cal. However, when several arcs were run im a row, the NLAMPS were fine. At first we thought this was because the latter exposures were done with the arc lamps already warm. Pete then ran a sequence of arcs with short rest-times and another sequence with long (10 minute) rest-times between exposures. It made no difference! What seemed to matter was whether the arc followed shortly after a flat, with no rest time. To summarize: ***Arcs taken right after a flat, with no rest time had lower NLAMPS values!*** Pete's detailed notes of the arc and flat sequences with their rest times are below the data analysis tables that follow. Steph also looked at the r2 arcs taken on MJD 53228, the date that showed the bit-swapping problem, as well as the arcs taken tonight. On MJD 53228 there was no correlation between the strength of one of the Cd lines and the value reported by Son-of-Spectro for NLAMPS. There was a correlation between the bit-swapping and NLAMPS. On MJD 53228 it appears bit-swapping is what dominated the SoS warnings. The data from tonight, however, showed no evidence of bit-swapping (compare the sigma and minimum pixel values for the two nights below). Now, back to the suppressed NLAMPS following a flat: Tonight there was a strong anti-correlation between the strength of the measured Cd line (lambda 6325 A, I believe) and the value for NLAMPS. This is readily seen in the tables below. It seems quite possible that the suppressed NLAMPS values in both r1 and r2 come from energy being taken from measured lines and going into other non-SoS-measured lines. Now, why would this tend to happen only right after a flat? How would this affect arc excitation levels? It also seems pretty clear that more lines need to be measured and their strengths correlated to NLAMPS. Data from MJD 53228 (The night with bit-swapping): Background levels Frame Cd-line peak NLAMPS median sigma min max (DN) (DN) (DN) (DN) (DN) ----- ------------ ------ ------ ----- --- --- 27757 2614 30 1392 34.43 1122 1465 27763 2433 36 1380 24.66 1348 1461 27768 2602 27 1368 66.59 1116 1444 27770 1503 32 1370 70.82 1119 1854 27773 2398 30 1372 32.64 1094 1441 27778 2527 31 1376 27.73 700 1474 Data from MJD 53235: Background levels Frame Cd-line peak NLAMPS median sigma min max (DN) (DN) (DN) (DN) (DN) ----- ------------ ------ ------ ----- --- --- Before connectors reseated, arcs directly follow flats: 28006 2253 32 1369 17.51 1344 1421 28008 2981 32 1370 19.43 1344 1430 28010 3061 32 1370 22.11 1344 1438 28012 3069 31 1376 23.71 1347 1442 28014 3100 31 1371 20.72 1344 1428 After the connectors were reseated, arc sequence with short pauses: 28022 1615 38 1366 18.95 1342 1428 28023 1623 37 1370 20.83 1341 1431 28024 1624 37 1367 21.27 1341 1438 28025 1462 38 1368 22.99 1338 1441 Arc lamps cooled 10 min. between exposures 28027 1429 38 1364 20.57 1337 1431 28028 1432 38 1370 22.76 1340 1432 28029 1423 38 1369 20.96 1339 1431 Two arcs after a flat, pause between flat & arc, no pause between the arcs 28031 1424 38 1367 24.3 1341 1448 28032 3905 31 1368 21.23 1340 1428 Two arcs after a flat, with pauses between each exposure 28034 1513 38 1368 24.83 1333 1443 28035 1529 37 1369 21.31 1339 1441 The median, sigma, min and max were calculated over 1600 pixels located away from any strong arc lines, and were measured in the same place on each of the frames. The Cd line strength is not bias subtracted, but since the bias did not vary much, that is not an issue. The Cd line strength was measured on the same three fibers in each image, and the values averaged. Pete's notes about the arc and flat sequences: --------------------------------------------- 2004-08-18 MJD 53235 Took a flat earlier sp1> loadCart 9 1144 sp1> loop i 0 5 1 {sleep 120; postCalibs 0 1} -> Exposures 28000 - 28004. NLamps good for all cameras (37-39 lines detected). sp1> loop i 0 5 1 {sleep 120; postCalibs} -> Exposures 28005 - 28014. Odd numbers are flats, even numbers are arcs. ALL the arcs have NLamps flagged in yellow for r2 (31 or 32 lines detected). 28010/12/14 also have NLamps flagged yellow for r1 (32 lines detected). sp1> loop i 0 5 1 {sleep 120; postCalibs 0 1} -> Exposures 28015 - 28019. Again, NLamps good for all cameras. Check HgCd lamp colours from cold. The southeast lamp comes on a little slower and redder than the others, but with 10 seconds they were visually indistinguishable. However, these checks show that a two-minute cool-down is NOT really sufficient to put them all back to 'cold'. Checked both halves of the connectors on both ends of the main (SCSI) cable from the r2 saddle bag to the PSU junction box. All pins looked good. Since this sp2 cameras were power-cycled and cables removed, we ran another series of 5 arcs as a check. sp1> loop i 0 5 1 {sleep 120; postCalibs 0 1} -> Exposures 28020 - 28024. The first exposure on sp2 produced SoS errors: sdR-b2-00028020.fit: WARNING: Reject arc: 99% bad pixels sdR-b2-00028020.fit: WARNING: Reject arc: 2048 saturated rows sdR-b2-00028020.fit: ABORT: Unable to reduce arc sdR-r2-00028020.fit: WARNING: Reject arc: 99% bad pixels sdR-r2-00028020.fit: WARNING: Reject arc: 2048 saturated rows sdR-r2-00028020.fit: ABORT: Unable to reduce arc but the subsequent exposures were all good. We assume these errors were from power-cycling sp2. We then tried just arcs with 10 minute cool-downs: sp1> loop i 0 5 1 {sleep 600; postCalibs 0 1} -> Exposures 28025 - 28029. All good! So it looks like we get NLamps flagged in yellow ONLY after a flat. Now, see if the timing matters, by taking a flat, then waiting 10 mins before taking arcs: sp1> postCalibs 1 0; sleep 600; postCalibs 0 1; postCalibs 0 1 -> Exposures 28030 - 28032. Not no rest between the arcs. The first arcis flagged black, the second yellow for r1 and r2. Let's try that again with the "standard" 2-minute rest between the arcs. sp1> postCalibs 1 0; sleep 600; postCalibs 0 1; sleep 120; postCalibs 0 1 -> Exposures 28033 - 28035. Both arcs good. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 4778 22:44Z 22:58Z 100 O 16.77 20.48 39 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n):n QA Procedures Done (y/n): arc analysis UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 27992, plate -9999 ------- 22:51 27992 0.0 bias 23:48 27993 0.0 bias ----- sequence 27994, plate 1144 ------- 00:10 27994 10.0 flat 00:13 27995 2.0 arc 00:16 27996 2.1 arc 00:18 27997 2.1 arc 00:36 27998 2.1 arc 00:38 27999 2.1 arc 02:13 28000 2.0 arc 02:18 28001 2.0 arc 02:22 28002 2.0 arc 02:26 28003 2.0 arc 02:31 28004 2.0 arc 02:43 28005 10.0 flat 02:45 28006 2.0 arc 02:50 28007 10.0 flat 02:52 28008 2.0 arc 02:57 28009 10.0 flat 02:59 28010 2.0 arc 03:04 28011 10.0 flat 03:06 28012 2.0 arc 03:11 28013 10.0 flat 03:13 28014 2.0 arc 03:31 28015 2.0 arc 03:36 28016 2.0 arc 03:40 28017 2.0 arc 03:45 28018 2.0 arc 03:49 28019 2.0 arc 05:45 28020 2.0 arc 05:49 28021 2.0 arc 05:54 28022 2.0 arc 05:58 28023 2.0 arc 06:03 28024 2.0 arc 06:30 28025 2.0 arc 06:42 28026 2.0 arc 06:54 28027 2.0 arc 07:07 28028 2.0 arc 07:19 28029 2.0 arc 07:27 28030 10.0 flat 07:39 28031 2.0 arc 07:42 28032 2.0 arc 08:48 28033 10.0 flat 09:01 28034 2.0 arc 09:05 28035 2.0 arc ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL N/A Stays: JL N/A ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 22:48Z 52 52 4 266 (W) 127228 - cloudy 23:20Z 54 49 3 269 (W) 117223 - " 23:53Z 52 49 7 231 (SW) 124033 - " 00:25Z 51 49 4 213 (SSW) 123724 - " 00:57Z 51 49 1 269 (W) 129974 - " 01:29Z 50 48 5 101 (E) 122170 - " 02:02Z 50 48 1 270 (W) 128363 - " 02:34Z 50 47 0 273 (W) 125818 - " 03:06Z 49 48 1 109 (ESE) 128996 - " 03:39Z 48 47 12 122 (ESE) 140773 - " 04:10Z 49 45 12 136 (SE) 133799 - " 04:42Z 49 44 7 180 (S) 130422 - " 05:15Z 49 45 6 179 (S) 128112 - " 05:48Z 48 45 6 183 (S) 127925 - " 06:20Z 48 46 8 184 (S) 136159 - " 06:52Z 48 46 7 174 (S) 134209 - " 07:24Z 49 46 8 145 (SE) 140633 - " 07:54Z 47 46 1 99 (E) 139551 - " 08:24Z 48 45 8 182 (S) 132982 - " 08:57Z 48 47 6 187 (S) 142210 - " 09:29Z 48 48 3 206 (SSW) 410613 - " 10:01Z 47 47 0 207 (SSW) 151286 - " 10:33Z 48 46 0 260 (W) 135808 - " ---=== TELESCOPE STATUS ===--- Never ventilated or opened. AC heaters left on. Space heater left on near front door. Cartridge 9 mounted. Telescope stowed at 30 deg alt with spectro auto-fill connected. Counterweights at 245. 10:36Z - Spectro dewar weight: 154 lb 10:36Z - Imager dewar weight: 200 lb ---=== SOFTWARE USED ===--- IOP/SOP: v3_140_0 Watcher: v2_29_0 MCP: v5_25_0 TPM: tpm_v2_42_0 AstroDa: v14_47 TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: v1_92 SoS: v4_10_7 hoggPT: v1_6_9 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.5260 0.5260 Axial B 0.6990 0.7130 Axial C 0.9980 0.9990 Trans D -8.6840 -8.6780 Lateral E 11.5443 11.5062 Lateral F 11.5189 11.4808 GALILS Commanded: 4850. -3650. 4050. -6150. 40200. 39150. Actual: 4850. -3650. 4050. -6150. 40200. 39150. SETMIR VALUES PriDesOrient: 0.00 -3.60 26.90 1470.40 198.00 PriOrient: 0.00 -3.80 26.76 1470.93 196.30 SECONDARY: ---------- Focus: 0.00 Air Temp.: 11.4 Alt.: 30.393775 MIGS TONIGHT NOMINAL Axial A 1.5010 1.7810 Axial B 1.1090 1.3910 Axial C 1.0870 1.3710 Trans D 0.0690 0.0630 GALILS Commanded: 1628650. 1548191. 1574490. -3900. -8750. Actual: 1628650. 1548200. 1574500. -3900. -8750. SETMIR VALUES SecDesOrient: 1257.00 0.00 -25.00 0.00 146.27 SecOrient: 1257.00 0.01 -25.00 0.26 146.55 ---=== PROBLEMS IN DETAIL ===--- Watcher errors: --------------- altitude (Windscreen touched in altitude: UP (2004-08-17 23:39:55Z sdssmcp): 2004-08-17 23:40:05Z ) dewar (Imager Dewar Scale Communications Fault:: 2004-08-17 23:22:04Z) ca (Channel Access Failure: TPM Down?: 2004-08-17 22:47:11Z) m2 mig (Communications Fault: 2004-08-17 23:00:45Z) A TCC session died uncleanly: Text="Write to user failed:output terminates to user9": (2004-08-18 10:05:33Z) Text="Could not queue a write to user:message output dies": (2004-08-18 10:05:33Z) Facil="SYSTEM":VMSMsg:"DEVOFFLINE" (2004-08-18 10:05:33Z) Facil="SYSTEM":VMSMsg:"HANGUP" (2004-08-18 10:05:33Z) Spectrograph Focus: ------------------- T=12.0C, Cartridge 9 sp1 Coll_motor_A -733 Coll_motor_B 232 Coll_motor_C -1634 sp2 Coll_motor_A -466 Coll_motor_B -2667 Coll_motor_C -6365