APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Sunday November 20, 2005 (MJD 53695) ---=== OBSERVING TEAM ===--- Jurek Krzesinski Howard Brewington Olena Malanushenko Viktor Malanushenko Steph Snedden Mike Harvanek (swing) Fritz Stauffer (by phone) Robert Lupton (by phone) Kurt Biery (by phone) Craig Loomis (by phone) Eric Neilsen (by phone) Jon Brinkmann (by phone) Russell Owen (by phone) ---=== OBSERVING PLAN ===--- Shakedown. ---=== OBSERVING SUMMARY ===--- We could not move the 2.5-meter with the tcc, so we went to bed early. We did, however, complete several shake tasks; see log. Steph set back fiducials v1_44 and rebooted the MCP. ---=== OBSERVING LOG ===--- Afternoon --------- Steph setup the new DA software (v15_9), the new iop (v4_9_0, yes 9) and the new watcher (v2_31_0) - all test versions. The engcam was mounted but wouldn't take an image. More below. We verified that the PT ff lamp was changed. Thanks Bob. No spectro collimation was done today due to the engcam being mounted. Night ----- Wow! Where to begin? Well, for starters, engcam wouldn't take an image. After several hours of Steph and Jurek swapping stuff and jiggling cables and numerous calls to Fritz et al. it finally came to life. A bad connector on the Mac side is currently suspected. After switching to iop v4_9_0, the PT wouldn't take an image. See the PT log for more details. We couldn't get the mcp to read the new fiducial tables. Robert Lupton was called and he found the problem (an alias between tcc25m and tai-time was either missing or corrupted) but a call to Fritz was needed to fix the problem. So, there is a new set of fiducial tables installed (v1_44 on host; host2 mistakenly thinks that it's version v1_41). A PR was filed to allow us to view the fiducial table version from the mcp itself. We were then unable to move the telescope. Fritz and Russell Owen were called. Apparently the serial ports on the tcc were hosed. Shake Items: ------------- We checked to see if sdssProcedures was available as the home page of sdsshost2; it was. With respect to PR6645, we checked and made sure that checksum was contained in the headers of the files and also made sure the values were correct. The spectro, and idgang files for astro and photo were okay. However, the mt files were not. This could be related to the mop getting started on the current version of iop instead of -t. Although we tried to restart mop on the test version, we had no success. We will try to check the mt files again tomorrow. Consequently, we could not close this PR tonight. PR 6752 dscIpcrm should now correctly clean up IPC services ============================================================ After opening a couple of new iop sessions we saw: ------- Shared Memory Segments -------- key shmid owner perms bytes nattch status 0x00054050 1736704 cloomis 666 512 0 0x000540fa 12976129 neilsen 666 512 0 0x00000000 16121858 observer 666 512 1 dest 0x00000000 16875523 observer 600 21344 1 <--- 0x00000000 16744452 observer 600 21344 1 dest 0x00000000 16220165 observer 666 512 1 dest 0x00000000 14778374 observer 600 21344 1 dest 0x00000000 16777223 observer 600 21344 1 dest 0x00000000 16809992 observer 600 21344 1 dest 0x00000000 14745609 observer 600 21344 1 dest 0x00000000 14876683 observer 600 21344 1 dest 0x00000000 16842764 observer 600 21344 1 <--- 0x00000000 15794190 observer 600 21344 1 dest 0x00000000 14974991 observer 600 21344 1 dest 0x00000000 15892496 observer 600 21344 1 dest 0x000540ee 13664273 neilsen 666 512 0 0x00000000 15106066 observer 600 21344 1 dest 0x00000000 15040533 observer 600 21344 1 dest 0x00000000 15925270 observer 600 21344 1 dest 0x00000000 15138840 observer 600 21344 1 dest 0x00000000 15958041 observer 600 21344 1 dest 0x00000000 15171610 observer 600 21344 1 dest ------ Semaphore Arrays -------- key semid owner perms nsems 0x000540fa 12681218 neilsen 666 17 0x00000000 16384003 observer 600 1 <--- 0x00054050 1802244 cloomis 666 17 0x00000000 16416774 observer 600 1 <--- 0x000540ee 13369361 neilsen 666 17 ------ Message Queues -------- key msqid owner perms used-bytes messages Lets clean up services: 23:17 sdsshost2.apo.nmsu.edu % $ASTRODA_DIR/bin/dscIpcrm Removing all of observer's IPC message queues, shared memories, and semaphores and see what left: 23:17 sdsshost2.apo.nmsu.edu % ipcs ------ Shared Memory Segments -------- key shmid owner perms bytes nattch status 0x00054050 1736704 cloomis 666 512 0 0x000540fa 12976129 neilsen 666 512 0 0x00000000 16121858 observer 666 512 1 dest 0x00000000 16875523 observer 600 21344 1 dest 0x00000000 16744452 observer 600 21344 1 dest 0x00000000 16220165 observer 666 512 1 dest 0x00000000 14778374 observer 600 21344 1 dest 0x00000000 16777223 observer 600 21344 1 dest 0x00000000 16809992 observer 600 21344 1 dest 0x00000000 14745609 observer 600 21344 1 dest 0x00000000 14876683 observer 600 21344 1 dest 0x00000000 16842764 observer 600 21344 1 dest 0x00000000 15794190 observer 600 21344 1 dest 0x00000000 14974991 observer 600 21344 1 dest 0x00000000 15892496 observer 600 21344 1 dest 0x000540ee 13664273 neilsen 666 512 0 0x00000000 15106066 observer 600 21344 1 dest 0x00000000 15040533 observer 600 21344 1 dest 0x00000000 15925270 observer 600 21344 1 dest 0x00000000 15138840 observer 600 21344 1 dest 0x00000000 15958041 observer 600 21344 1 dest 0x00000000 15171610 observer 600 21344 1 dest ------ Semaphore Arrays -------- key semid owner perms nsems 0x000540fa 12681218 neilsen 666 17 0x00054050 1802244 cloomis 666 17 0x000540ee 13369361 neilsen 666 17 ------ Message Queues -------- key msqid owner perms used-bytes messages 23:18 sdsshost2.apo.nmsu.edu =========================================================== im> Well, zeros are shown at nattach before and after cleaning services but those nattch which got 1 and no 'dest' did cleaned up. Can we tell that the test is a success? If we assume that 0 are the ones which have to dissapear as well the dscIpcrm is not working. So, we're not sure if the shake task for PR 6753 is working since it does not clean the zeros either. ===================================================== Craig and Fritz spent a lot of time (more than two hours) diagnosing the errors we saw with truncated commands in the TCC telrun session. They decided the problem was a UART overrun. They looked at decreasing the amount of traffic to the kernel. Fritz edited out tracing commands in /p/mcpbase/etc/mcp.login, but the traffic load didn't change . They tried other things, no doubt, that I don't have any info on for the log. Jurek and Steph went down to the MCP and checked all the connections and rebooted the MCP (again). Nothing changed...still too many interrupts. As a last ditch diagnostic, we reverted to the old fiducial tables (v1_41), but we saw no change in the TCC behavior. We still had truncated commands because of the interrupts. Fritz and Craig will give this problem high priority tmorrow. After that Steph setup new fiducials (v1_44) on the host computer and we reboot the MCP. Hopefuly it will be good to go tomorrow. ================================================== With respect to PR2575 and PR6633, the shake tasks worked as advertised. endNight finished and was happy. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 5883 23:34Z 00:05Z 100 O 122.74 130.56 66 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): QA Procedures Done (y/n): UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 34955, plate -9999 ------- 23:04 34955 0.0 bias 34956 missing due to DA reboot 23:07 34957 0.0 bias 23:10 34958 0.0 bias ----- sequence 34959, plate -9999 ------- 23:33 34959 0.0 bias 23:38 34960 0.0 bias ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL Stays: JL ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 23:01Z 33 19 4 37 (NE) 667 - 23:34Z 37 15 10 54 (NE) 589 - 00:06Z 38 9 15 31 (NNE) 438 - clear 00:39Z 38 2 11 51 (NE) 231 - 01:11Z 37 1 7 10 (N) 810 - 01:42Z 37 1 13 31 (NNE) 206 - 02:15Z 38 1 16 33 (NNE) 253 - 02:47Z 40 0 21 25 (NNE) 164 - 03:19Z 40 3 23 30 (NNE) 107 - ---=== TELESCOPE STATUS ===--- 22:30Z Enclosure doors opened, fans and blowers on, louvers opened. 08:03Z Enclosure doors closed, fan and blowers off, louvers closed. ---=== SOFTWARE USED ===--- IOP/SOP: v4_9_0 Watcher: v2_31_0 MCP: v5_26_0 TPM: tpm_v3_1_0 AstroDa: v15_9 TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: v2_06 SoS: v4_10_7 hoggPT: v1_6_9 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A -5.8350 -5.8440 Axial B -5.6750 -5.6770 Axial C 0.9350 0.9420 Trans D -9.9920 -9.9940 Lateral E 10.3759 10.3759 Lateral F 11.9507 11.9380 GALILS Commanded: 4700. -2450. 3000. -7800. 3300. 3000. Actual: 4711. -2457. 2997. -7825. 3296. 3024. SETMIR VALUES PriDesOrient: 0.00 -1.68 7.05 385.25 92.02 PriOrient: 0.00 -1.52 7.02 384.99 93.81 SECONDARY: ---------- Focus: 0.00 Air Temp.: 3.5 Alt.: 30.437556 MIGS TONIGHT NOMINAL Axial A 1.5390 1.5420 Axial B 1.0520 1.0470 Axial C 1.1700 1.1650 Trans D -0.1150 -0.1240 GALILS Commanded: 1593356. 1603636. 1554225. -6800. -5900. Actual: 1593447. 1603642. 1554316. -6820. -5882. SETMIR VALUES SecDesOrient: 1257.00 15.87 0.00 -50.00 136.76 SecOrient: 1256.95 15.89 0.02 -49.54 136.72 ---=== PROBLEMS IN DETAIL ===--- See the main log.