APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday September 3, 2005 (MJD 53617) ---=== OBSERVING TEAM ===--- Mike Harvanek John Barentine Eric Neilsen (by phone) ---=== OBSERVING PLAN ===--- Supernova Science! ---=== OBSERVING SUMMARY ===--- Clouds and/or high humidity all night. We never opened. We did the spectro rotator test. We monitored memory usage on sdsshost2 as per Eric Neilsen's instructions. We monitored compressor #2 as per Mark Klaene's request. There appears to be a flaky neon lamp. We have been requested to run a spooling script for the SN folks at the end of those nights on which we obtain SN data. ---=== OBSERVING LOG ===--- Afternoon --------- No issues. Imager bias looks fine. Spectro collimation adjusted. Night ----- Clouds and humidity delayed opening but we ventilated until around 02:30Z. While waiting for the weather to improve, we performed the spectro rotator test (running goSpecFocus at various rotator positions) to check if the "flop" in one of the spectro ccds had been fixed by work done this summer. The data were emailed to Dan Long for analysis. While performing this test, we encountered a flaky Neon lamp. On 2 consecutive tries, goSpecFocus failed because 1 of the Ne lamps failed to light. We went to the telescope to investigate but all the lamps lit up when we turned them on. We tried 3 or 4 times to get them to fail but they all lit every time. We came back to the control room and continued the test without further trouble from the lamps. Later we noticed that SoS had also reported that 4 of the test exposures that we had taken had only 3 Ne lamps lit. We did not see this earlier because SoS was so far behind in the reductions. (This test generated a large number of frames quickly and SoS had trouble keeping up.) Since goSpecFocus fails to execute when 1 or more of the lamps do not light initially, we assume that the flaky neon lamp either dimmed or went out after each of these 4 exposures had already begun. Is it possible that the sensor that determines if the lamps are lit is faulty? As a result of last night's trouble with mop crashing because of an apparent memory leak, we are monitoring memory use on sdsshost2 at the request of Eric Neilsen. Results of this monitoring can be found in the Problems section. The humidity finally dropped around 07:30Z and we started ventilating again. At the request of Mark Klaene, we are also monitoring compressor #2 in the boiler room which provides primary air for the mirror support systems. We found this system to be offline around 08:30Z and we brought it back online as per Mark's instructions. Humidity became a problem again around 09:25Z and we stopped all ventilation and closed everything up again. Clouds and high humidity remained with us the rest of the night. We never opened. endNight finished successfully. We have been requested to run a spooling script for the SN folks at the end of those nights on which we obtain SN data so that they can get their data transferred over sooner. John Barentine has sent out an email to the observers detailing the procedure. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 5567 23:40Z 00:04Z 100 O 47.35 53.39 55 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): YES QA Procedures Done (y/n): NO UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 33766, plate -9999 ------- 23:26 33766 0.0 bias ----- sequence 33767, plate 2260 ------- 23:57 33767 10.0 flat 00:00 33768 2.0 arc 00:03 33769 2.1 arc collimation 00:05 33770 2.1 arc collimation 00:21 33771 2.1 arc collimation 00:24 33772 2.1 arc collimation ----- sequence 33773, plate -9999 ------- 00:40 33773 0.0 bias ----- sequence 33774, plate 2260 ------- 02:47 33774 10.0 flat 02:49 33775 2.0 arc 02:55 33776 2.1 arc rotator test starts here 02:57 33777 2.1 arc 03:03 33778 2.1 arc 03:06 33779 2.1 arc 03:11 33780 2.1 arc 03:13 33781 2.1 arc 03:16 33782 2.1 arc 03:19 33783 2.1 arc 03:23 33784 2.1 arc 03:25 33785 2.1 arc 03:29 33786 2.1 arc 03:31 33787 2.1 arc 03:34 33788 2.1 arc 03:37 33789 2.1 arc 03:41 33790 2.1 arc 03:43 33791 2.1 arc 03:46 33792 2.1 arc 03:49 33793 2.1 arc 03:53 33794 2.1 arc 03:55 33795 2.1 arc 03:59 33796 2.1 arc 04:02 33797 2.1 arc 04:07 33798 2.1 arc 04:09 33799 2.1 arc 04:15 33800 2.1 arc 04:17 33801 2.1 arc 04:21 33802 2.1 arc 04:23 33803 2.1 arc 04:27 33804 2.1 arc 04:29 33805 2.1 arc 04:33 33806 2.1 arc 04:35 33807 2.1 arc 04:39 33808 2.1 arc 04:41 33809 2.1 arc 04:46 33810 2.1 arc only 3 Ne lamps lit 04:48 33811 2.1 arc only 3 Ne lamps lit 04:52 33812 2.1 arc only 3 Ne lamps lit 04:54 33813 2.1 arc only 3 Ne lamps lit 05:27 33814 2.2 arc 05:30 33815 2.1 arc 05:37 33816 2.1 arc 05:39 33817 2.1 arc 05:43 33818 2.1 arc 05:46 33819 2.1 arc 05:50 33820 2.1 arc 05:52 33821 2.1 arc 05:56 33822 2.1 arc 05:59 33823 2.1 arc 06:03 33824 2.1 arc 06:05 33825 2.1 arc 06:15 33826 2.1 arc 06:17 33827 2.1 arc 06:22 33828 2.1 arc 06:24 33829 2.1 arc ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL Stays: JL ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 23:18Z 58 49 1 85 (E) -9999 - 23:48Z 55 48 9 78 (ENE) -9999 - 00:19Z 55 48 11 86 (E) -9999 - 00:50Z 55 48 9 89 (E) -9999 - clouds 01:21Z 54 48 10 83 (E) -9999 - clouds 02:05Z 53 46 9 88 (E) -9999 - clouds 02:37Z 54 45 8 104 (ESE) -9999 - clouds 03:09Z 54 44 9 109 (ESE) -9999 - clouds 03:41Z 54 43 9 82 (E) -9999 - clouds 04:13Z 53 45 7 86 (E) -9999 - clouds 04:46Z 54 44 7 86 (E) -9999 - clouds 05:16Z 52 46 10 80 (E) -9999 - clouds 05:46Z 52 47 8 76 (ENE) -9999 - clouds 06:18Z 53 46 6 81 (E) -9999 - clouds 06:50Z 52 47 8 83 (E) -9999 - clouds 07:22Z 52 48 5 91 (E) -9999 - clouds 07:55Z 55 43 0 138 (SE) -9999 - clouds 08:27Z 54 43 1 319 (NW) -9999 - clouds 08:59Z 53 45 0 251 (WSW) -9999 - clouds 09:31Z 51 50 5 130 (SE) -9999 - clouds 10:03Z 50 51 8 117 (ESE) -9999 - clouds 10:36Z 51 51 7 112 (ESE) -9999 - clouds ---=== TELESCOPE STATUS ===--- 01:25Z Enclosure doors opened, fans and blowers on, louvers opened. 02:30Z Doors closed, fans and blowers off, louvers closed. (Clouds, humidity, spectro rotator test.) 07:30Z Enclosure doors opened, fans and blowers on, louvers opened. 09:25Z Doors closed, fans and blowers off, louvers closed. (Humidity.) Never opened. Telescope stowed at 30 degrees with cartridge 8 (plate 2260) mounted. Counterweights at 245. Spectro auto-fill connected. Imager dewar 11:00 156 lb, 20 psi Spectro dewar 11:00 215 lb, 25 psi No interlocks bypassed. ---=== SOFTWARE USED ===--- IOP/SOP: iop neilsen Watcher: watcher neilsen MCP: v5_26_0 TPM: tpm_v3_0_0 AstroDa: biery v15_3_1 TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: v2_03 SoS: v4_10_7 hoggPT: v1_6_9 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A -5.8430 -5.8440 Axial B -5.6760 -5.6770 Axial C 0.9420 0.9420 Trans D -9.9920 -9.9940 Lateral E 10.3759 10.3759 Lateral F 11.9380 11.9380 GALILS Commanded: 4700. -2450. 3000. -7800. 3300. 3000. Actual: 4711. -2457. 2997. -7825. 3296. 3024. SETMIR VALUES PriDesOrient: 0.00 -1.68 7.05 385.25 92.02 PriOrient: 0.00 -1.52 7.02 384.99 93.81 SECONDARY: ---------- Focus: 0.00 Air Temp.: 12.2 Alt.: 30.001541 MIGS TONIGHT NOMINAL Axial A 1.5420 1.5420 Axial B 1.0480 1.0470 Axial C 1.1650 1.1650 Trans D -0.1080 -0.1240 GALILS Commanded: 1593419. 1603554. 1554295. -6800. -5900. Actual: 1593447. 1603642. 1554316. -6820. -5882. SETMIR VALUES SecDesOrient: 1257.00 15.87 0.00 -50.00 136.76 SecOrient: 1256.96 15.85 -0.02 -49.57 136.75 ---=== PROBLEMS IN DETAIL ===--- Spectro Focus ------------- before goSpecFocus sp1 Coll_motor_A -601 Coll_motor_B -602 Coll_motor_C 597 sp2 Coll_motor_A 4810 Coll_motor_B 1780 Coll_motor_C 3310 sp1 red l-r = 0.320 pixels , tolerance = 0.15 pixels, not focused yet Predict a movement of -2928 steps for sp1 red Issue: sp1; mechPiston -2928 Calculating pixel shift maps now... Done calculating pixel shift maps... sp2 red l-r = 0.117 pixels, tolerance = 0.15 pixels, focused Calculating pixel shift maps now... Done calculating pixel shift maps... sp1 blue l-r = -0.205 pixels , tolerance = 0.15 pixels, not focused yet Predict a movement of 7 steps for sp1 blue If red is in focus then you need to rotate blue camera ring by 7 degrees Calculating pixel shift maps now... Done calculating pixel shift maps... sp2 blue l-r = -0.171 pixels , tolerance = 0.15 pixels, not focused yet Predict a movement of 6 steps for sp2 blue If red is in focus then you need to rotate blue camera ring by 6 degrees Temperatures at time of goSpecFocus tpm_TM_PMSSAvg 13.7557 tpm_TM_TelairAvg.VALA 5.7825 IDL 5.5a> collimate, 33769 Reading /data/spectro/53617/sdR-b1-00033769.fit Reading /data/spectro/53617/sdR-b1-00033770.fit COLLIMATE: Min offset = -0.92 pix COLLIMATE: Max offset = 0.26 pix COLLIMATE: RMS across CCD = 0.31 pix COLLIMATE: Mean offset = -0.19 pix COLLIMATE: Camera b1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of 6.6 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-53617-b1-00033769.log PostScript file = Collimate-53617-b1-00033769.ps Reading /data/spectro/53617/sdR-b2-00033769.fit Reading /data/spectro/53617/sdR-b2-00033770.fit COLLIMATE: Min offset = -0.61 pix COLLIMATE: Max offset = 0.31 pix COLLIMATE: RMS across CCD = 0.24 pix COLLIMATE: Mean offset = -0.11 pix COLLIMATE: Camera b2 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict blue camera ring movement of 4.0 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-53617-b2-00033769.log PostScript file = Collimate-53617-b2-00033769.ps Reading /data/spectro/53617/sdR-r1-00033769.fit Reading /data/spectro/53617/sdR-r1-00033770.fit COLLIMATE: Min offset = -0.22 pix COLLIMATE: Max offset = 0.89 pix COLLIMATE: RMS across CCD = 0.32 pix COLLIMATE: Mean offset = 0.29 pix COLLIMATE: Camera r1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict (red) piston movement of -2630 steps for spectro-1 COLLIMATE: Issue SOP command: "sp1; mechPiston -2630" Log file = Collimate-53617-r1-00033769.log PostScript file = Collimate-53617-r1-00033769.ps Reading /data/spectro/53617/sdR-r2-00033769.fit Reading /data/spectro/53617/sdR-r2-00033770.fit COLLIMATE: Min offset = -0.49 pix COLLIMATE: Max offset = 0.29 pix COLLIMATE: RMS across CCD = 0.20 pix COLLIMATE: Mean offset = 0.05 pix COLLIMATE: Camera r2 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict (red) piston movement of -492 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston -492" Log file = Collimate-53617-r2-00033769.log PostScript file = Collimate-53617-r2-00033769.ps Issued the recommended mechPiston for sp1 and re-ran goSpecFocus. sp1 red l-r = 0.029 pixels, tolerance = 0.15 pixels, focused Calculating pixel shift maps now... Done calculating pixel shift maps... sp2 red l-r = 0.113 pixels, tolerance = 0.15 pixels, focused Calculating pixel shift maps now... Done calculating pixel shift maps... sp1 blue l-r = 0.007 pixels, tolerance = 0.15 pixels, focused Calculating pixel shift maps now... Done calculating pixel shift maps... sp2 blue l-r = -0.157 pixels , tolerance = 0.15 pixels, not focused yet Predict a movement of 6 steps for sp2 blue If red is in focus then you need to rotate blue camera ring by 6 degrees IDL 5.5a> collimate, 33771 Reading /data/spectro/53617/sdR-b1-00033771.fit SPHDRFIX1: Changing QUALITY=excellent -> test Reading /data/spectro/53617/sdR-b1-00033772.fit COLLIMATE: Min offset = -0.71 pix COLLIMATE: Max offset = 0.55 pix COLLIMATE: RMS across CCD = 0.32 pix COLLIMATE: Mean offset = 0.04 pix COLLIMATE: Camera b1 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict blue camera ring movement of -1.6 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-53617-b1-00033771.log PostScript file = Collimate-53617-b1-00033771.ps Reading /data/spectro/53617/sdR-b2-00033771.fit SPHDRFIX1: Changing QUALITY=excellent -> test Reading /data/spectro/53617/sdR-b2-00033772.fit COLLIMATE: Min offset = -0.61 pix COLLIMATE: Max offset = 0.32 pix COLLIMATE: RMS across CCD = 0.24 pix COLLIMATE: Mean offset = -0.10 pix COLLIMATE: Camera b2 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict blue camera ring movement of 3.5 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-53617-b2-00033771.log PostScript file = Collimate-53617-b2-00033771.ps Reading /data/spectro/53617/sdR-r1-00033771.fit SPHDRFIX1: Changing QUALITY=excellent -> test Reading /data/spectro/53617/sdR-r1-00033772.fit COLLIMATE: Min offset = -0.47 pix COLLIMATE: Max offset = 0.53 pix COLLIMATE: RMS across CCD = 0.29 pix COLLIMATE: Mean offset = -0.02 pix COLLIMATE: Camera r1 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict (red) piston movement of 174 steps for spectro-1 COLLIMATE: Issue SOP command: "sp1; mechPiston 174" Log file = Collimate-53617-r1-00033771.log PostScript file = Collimate-53617-r1-00033771.ps Reading /data/spectro/53617/sdR-r2-00033771.fit SPHDRFIX1: Changing QUALITY=excellent -> test Reading /data/spectro/53617/sdR-r2-00033772.fit COLLIMATE: Min offset = -0.53 pix COLLIMATE: Max offset = 0.28 pix COLLIMATE: RMS across CCD = 0.20 pix COLLIMATE: Mean offset = 0.04 pix COLLIMATE: Camera r2 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict (red) piston movement of -345 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston -345" Log file = Collimate-53617-r2-00033771.log PostScript file = Collimate-53617-r2-00033771.ps Memory monitoring on sdsshost2: ------------------------------- Note that we did not open tonight so there was not much activity to test memory usage. The "biggest" thing we did was the spectro rotator test which ran from about 02:30Z to 06:30Z. The corresponding increase in memNumBlocksInUse and memAMPSize by sop is seen in the 06:30Z query. The increase seen in the sop 11:02Z query may be due to running endNight. 02:30:02 up 2 days, 4:01, 36 users, load average: 0.21, 0.23, 0.17 266 processes: 249 sleeping, 4 running, 13 zombie, 0 stopped CPU states: cpu user nice system irq softirq iowait idle total 8.5% 0.0% 4.1% 0.0% 2.6% 0.0% 84.4% cpu00 9.5% 0.0% 3.9% 0.0% 1.7% 0.0% 84.6% cpu01 7.5% 0.0% 4.3% 0.1% 3.5% 0.0% 84.2% Mem: 2057708k av, 2045364k used, 12344k free, 0k shrd, 164576k buff 1564396k actv, 316588k in_d, 45148k in_c Swap: 5116600k av, 2356k used, 5114244k free 1445776k cached im> memNumBlocksInUse 1 im> memAMPSize 1 sp1> memNumBlocksInUse 12 sp1> memAMPSize 12 mt> memNumBlocksInUse 1 mt> memAMPSize 1 06:30:01 up 2 days, 8:01, 38 users, load average: 0.24, 0.27, 0.26 273 processes: 257 sleeping, 2 running, 14 zombie, 0 stopped CPU states: cpu user nice system irq softirq iowait idle total 9.2% 0.0% 2.9% 0.0% 0.1% 0.0% 87.4% cpu00 11.3% 0.0% 2.9% 0.1% 0.1% 0.0% 85.2% cpu01 7.1% 0.0% 2.9% 0.0% 0.1% 0.0% 89.6% Mem: 2057708k av, 2045500k used, 12208k free, 0k shrd, 105300k buff 1596208k actv, 301960k in_d, 45224k in_c Swap: 5116600k av, 5344k used, 5111256k free 1434884k cached im> memNumBlocksInUse 1 im> memAMPSize 1 sp1> memNumBlocksInUse 14469 sp1> memAMPSize 14469 mt> memNumBlocksInUse 1 mt> memAMPSize 1 08:30:00 up 2 days, 10:01, 38 users, load average: 0.16, 0.14, 0.12 272 processes: 257 sleeping, 1 running, 14 zombie, 0 stopped CPU states: cpu user nice system irq softirq iowait idle total 3.8% 0.0% 0.5% 0.0% 0.2% 0.1% 94.9% cpu00 5.5% 0.0% 0.3% 0.0% 0.3% 0.1% 93.4% cpu01 2.1% 0.0% 0.7% 0.1% 0.1% 0.1% 96.4% Mem: 2057708k av, 2045872k used, 11836k free, 0k shrd, 124172k buff 1595172k actv, 302000k in_d, 45836k in_c Swap: 5116600k av, 5712k used, 5110888k free 1412444k cached im> memNumBlocksInUse 1 im> memAMPSize 1 sp1> memNumBlocksInUse 14469 sp1> memAMPSize 14469 mt> memNumBlocksInUse 1 mt> memAMPSize 1 09:45:34 up 2 days, 11:17, 39 users, load average: 0.15, 0.18, 0.17 275 processes: 257 sleeping, 3 running, 15 zombie, 0 stopped CPU states: cpu user nice system irq softirq iowait idle total 2.1% 0.0% 0.4% 0.0% 1.1% 0.0% 96.0% cpu00 3.5% 0.0% 0.7% 0.0% 1.1% 0.1% 94.2% cpu01 0.7% 0.0% 0.1% 0.0% 1.1% 0.0% 97.8% Mem: 2057708k av, 2045632k used, 12076k free, 0k shrd, 133032k buff 1593552k actv, 302488k in_d, 45796k in_c Swap: 5116600k av, 5712k used, 5110888k free 1400004k cached im> memNumBlocksInUse 1 im> memAMPSize 1 sp1> memNumBlocksInUse 14469 sp1> memAMPSize 14469 mt> memNumBlocksInUse 1 mt> memAMPSize 1 11:02:28 up 2 days, 12:34, 35 users, load average: 0.14, 0.13, 0.16 262 processes: 247 sleeping, 1 running, 14 zombie, 0 stopped CPU states: cpu user nice system irq softirq iowait idle total 2.9% 0.0% 0.2% 0.0% 0.2% 0.0% 96.4% cpu00 3.1% 0.0% 0.1% 0.0% 0.0% 0.0% 96.6% cpu01 2.7% 0.0% 0.3% 0.0% 0.5% 0.0% 96.2% Mem: 2057708k av, 2045728k used, 11980k free, 0k shrd, 117096k buff 1592968k actv, 302896k in_d, 45988k in_c Swap: 5116600k av, 4720k used, 5111880k free 1456068k cached im> memNumBlocksInUse 1 im> memAMPSize 1 sp1> memNumBlocksInUse 15655 sp1> memAMPSize 15655 mt> memNumBlocksInUse 1 mt> memAMPSize 1