APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday August 27, 2005 (MJD 53610) ---=== OBSERVING TEAM ===--- Swing: Jurek Krzesinski Night: Howard Brewington Steph Snedden Kaike Pan Support: Kurt Biery ---=== OBSERVING PLAN ===--- DA testing and spectro monthly checkout ---=== OBSERVING SUMMARY ===--- o Spectro monthly checkout done. o The rotator physical zero is offset from the MCP zero by 0.14 degrees. (setting the rotator to -0.14 degrees mount in the TCC will allow you to mount instruments safely). o an nfs problem affected loadCart o Not much work done on the DA tonight o A problem at the end of the night with id5 not coming up after reboot (see the end of the log body) ---=== OBSERVING LOG ===--- Afternoon checkout: ------------------- Not much to check today. All seems to be ok. Night: ----- Humidity and threatening weather nearby kept us closed early on. We decided that the most valuable thing we could do tonight is check the health of the spectrographs. We called Kurt to see about rolling forward to his code that successfully reads out the spectrographs. He did this and also sent us the procedure to switch between versions that can handle either the spectro crate or the imager crates (but not both). Spectro monthly checkout: Note that we saw the known problem where the DA gave a different frame number (33531) to the spectrograph 1 images and that number + 1 to the spectrograph 2 images (33532). When taking the first exposure of the monthly checkout, SOP correctly caught the mismatch, and we fixed it then. After that the exposure numbers were in sync. Spectrograph checkout proceeded normally until the script to run multiple biases was done. Three biases completed normally, the fourth only read out sp1 exposures. The sd1 crate was rebooted. We then could continue with the biases. Here are the relevant error messages: ----- readoutBegin sp1 cameraStart {} t-g-sdss-2.apo.nmsu.edu 2100 sp2 cameraStart {} t-g-sdss-2.apo.nmsu.edu 2200 Waiting for read to finish Error: daqBusy=1: sd1 is/are busy after 80 seconds sp1> IOP running as Backup Relay Server no response to listen request 130310... 30 sp1> sp1> loop i 0 21 {goStare 0 -bias} 2005-08-28 05:54:23Z: statusEntry daqBusy on node sd1 is not 0 but 1 Error: Aborting: system is already busy ----- We had a problem with the nfs server. This affected loadCart in SOP. The first sign of trouble was this: ----- sp1> initNight 2005-08-28 06:05:45Z: SOP Ready for flight I can't find rpc.pcnfsd running. You should do something! (Start with a ps -ef | grep nfsd) nfsd appears to be registered - good. sp1> goStare 0 -init -bias ----- Then when you would try to do loadCart, you would see: ----- /data/spectro/guider is not a directory while executing "error "$imageDir is not a directory"" invoked from within "if ![file isdirectory $imageDir] { error "$imageDir is not a directory" }" (procedure "loadCartridge" line 177) invoked from within "loadCartridge -latest $cart $plate" (procedure "GUIloadCart" line 26) invoked from within "GUIloadCart $GUIcart $GUIplate" invoked from within ".sgui.loadcart.button invoke" ("uplevel" body line 1) invoked from within "uplevel #0 [list $w invoke]" invoked from within "if {($w == $tkPriv(window)) && ([$w cget -state] != "disabled")} { uplevel #0 [list $w invoke] }" invoked from within "if {$w == $tkPriv(buttonWindow)} { set tkPriv(buttonWindow) "" $w config -relief $tkPriv(relief) if {($w == $tkPriv(window)) && ([$w cget -state] ..." (procedure "tkButtonUp" line 3) invoked from within "tkButtonUp .sgui.loadcart.button" (command bound to event) ----- Ahhhh, we had just removed the engcam and mounted the imager. Reboot the guider Mac which automatically starts the nfs server. Yep, that worked, but then we had the same problem with the plug map files. Is that an nfs server problem between sdsshost and devel1 or plate-mapper and devel1 or ... ? For Fritz's info, here is the information about what nfs processes were running: devel1.apo.nmsu.edu % ./rpcinfo -p program vers proto port 100000 2 tcp 111 portmapper 100000 2 udp 111 portmapper 100024 1 udp 32778 status 100024 1 tcp 32768 status 100021 1 udp 32863 nlockmgr 100021 3 udp 32863 nlockmgr 100021 4 udp 32863 nlockmgr 100021 1 tcp 55925 nlockmgr 100021 3 tcp 55925 nlockmgr 100021 4 tcp 55925 nlockmgr 150001 1 udp 883 pcnfsd 150001 2 udp 883 pcnfsd 150001 1 tcp 886 pcnfsd 150001 2 tcp 886 pcnfsd 391002 2 tcp 42003 sgi_fam 100011 1 udp 933 rquotad 100011 2 udp 933 rquotad 100011 1 tcp 936 rquotad 100011 2 tcp 936 rquotad 100003 2 udp 2049 nfs 100003 3 udp 2049 nfs 100003 2 tcp 2049 nfs 100003 3 tcp 2049 nfs 100005 1 udp 947 mountd 100005 1 tcp 950 mountd 100005 2 udp 947 mountd 100005 2 tcp 950 mountd 100005 3 udp 947 mountd 100005 3 tcp 950 mountd ------ Here are the spectro bias and dark percentiles: 2005 August 28 (53610) Spectro Bias Percentiles; Brewington and Pan Filename 02% 05% 10% 50% 90% 95% 98% ------------------- ------ ------ ------ ------ ------ ------ ------ sdR-b1-00033533.fit -6.4 -4.2 -3.0 2.6 7.1 9.4 10.5 sdR-b1-00033533.fit -6.4 -4.2 -3.0 2.6 7.1 9.4 10.5 sdR-b2-00033533.fit -8.5 -6.6 -4.5 1.3 7.4 9.2 11.9 sdR-b2-00033533.fit -8.5 -6.6 -4.5 1.3 7.4 9.2 11.9 sdR-r1-00033533.fit -7.1 -5.3 -3.7 1.7 6.7 9.0 11.3 sdR-r1-00033533.fit -7.1 -5.3 -3.7 1.7 6.7 9.0 11.3 sdR-r2-00033533.fit -7.8 -6.5 -4.5 0.6 6.5 8.5 10.5 sdR-r2-00033533.fit -7.8 -6.5 -4.5 0.6 6.5 8.5 10.5 2005 August 28 (53610) Spectro Dark Percentiles; Brewington and Pan Filename 02% 05% 10% 50% 90% 95% 98% ------------------- ------ ------ ------ ------ ------ ------ ------ sdR-b1-00033575.fit -3.1 -1.7 0.5 6.2 13.0 15.0 17.5 sdR-b1-00033575.fit -3.1 -1.7 0.5 6.2 13.0 15.0 17.5 sdR-b2-00033575.fit -5.6 -3.1 -1.6 6.2 12.9 15.4 18.1 sdR-b2-00033575.fit -5.6 -3.1 -1.6 6.2 12.9 15.4 18.1 sdR-r1-00033575.fit -4.4 -2.4 -0.9 4.9 11.6 13.6 16.4 sdR-r1-00033575.fit -4.4 -2.4 -0.9 4.9 11.6 13.6 16.4 sdR-r2-00033575.fit -5.6 -3.5 -1.7 4.3 10.3 12.3 15.3 sdR-r2-00033575.fit -5.6 -3.5 -1.7 4.3 10.3 12.3 15.3 At the end of the night, endNight failed with the following: im> endNight Error: ICC id5 (crate 2, board 1) is not available Bad ICC We tried rebooting the crates, after changing to Kurt's code that works with the photo ICCs. That made no difference. We note that the monitor for node 5 also does not reset after reboot. So, no endNight tonight. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 5530 22:52Z 23:09Z 100 O 28.53 32.77 42 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n):n QA Procedures Done (y/n):n UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 33531, plate -9999 ------- 01:13 33531 0.0 bias ----- sequence 33533, plate 1850 ------- 03:43 33533 0.0 bias 03:47 33534 10.0 flat 04:02 33535 10.0 flat 04:12 33536 10.0 flat 04:21 33537 2.0 arc 04:39 33538 2.0 arc 04:50 33539 2.0 arc 05:01 33540 2.1 arc 05:03 33541 2.1 arc 05:27 33542 2.1 arc 05:30 33543 2.1 arc 05:41 33544 0.0 bias 05:43 33545 0.0 bias 05:46 33546 0.0 bias ----- sequence 33549, plate -9999 ------- 06:07 33549 0.0 bias 06:23 33551 0.0 bias 06:26 33552 0.0 bias 06:33 33554 0.0 bias 06:35 33555 0.0 bias 06:38 33556 0.0 bias 06:42 33557 0.0 bias 06:47 33558 0.0 bias 06:50 33559 0.0 bias 06:53 33560 0.0 bias 06:57 33561 0.0 bias 07:00 33562 0.0 bias 07:03 33563 0.0 bias 07:05 33564 0.0 bias 07:09 33565 0.0 bias 07:13 33566 0.0 bias 07:15 33567 0.0 bias 07:19 33568 0.0 bias 07:21 33569 0.0 bias 07:24 33570 0.0 bias 07:27 33571 0.0 bias 07:30 33572 0.0 bias 07:32 33573 0.0 bias 07:35 33574 0.0 bias 09:07 33575 0.0 dark 09:27 33576 0.0 dark 09:44 33577 0.0 dark ----- sequence 33578, plate 1850 ------- 10:06 33578 10.0 flat 10:10 33579 10.0 flat 10:13 33580 10.0 flat 10:17 33581 10.0 flat 10:21 33582 10.0 flat 10:25 33583 10.0 flat 10:29 33584 10.0 flat 10:32 33585 2.0 arc 10:35 33586 2.0 arc ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL Stays: JL ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 23:02Z 69 53 7 193 (SSW) 347 - 23:32Z 68 53 8 191 (S) 364 - 00:04Z 68 51 9 208 (SSW) 366 - 00:36Z 68 50 12 215 (SW) 337 - 01:08Z 66 49 8 206 (SSW) 354 - 01:39Z 62 50 4 142 (SE) 382 - 02:09Z 61 51 12 145 (SE) 343 - 02:46Z 59 54 12 144 (SE) 440 - 03:16Z 59 52 6 145 (SE) 385 - 03:47Z 59 51 9 142 (SE) 422 - 04:20Z 60 50 15 159 (SSE) 413 - 04:50Z 61 49 15 169 (S) 419 - 05:20Z 61 49 8 181 (S) 427 - 05:51Z 62 49 14 176 (S) 386 - 06:22Z 62 49 16 179 (S) 375 - 06:51Z 62 48 8 181 (S) 426 - 07:24Z 49 41 26 50 (NE) 1109 - 07:56Z 49 44 26 59 (ENE) 599 - 08:29Z 53 42 9 85 (E) 357 - 09:02Z 58 48 10 200 (SSW) 321 - 09:35Z 58 48 4 189 (S) 378 - 10:05Z 53 46 8 227 (SW) 377 - 10:36Z 57 49 8 222 (SW) 433 - 11:10Z 57 49 4 240 (WSW) 465 - ---=== TELESCOPE STATUS ===--- Never opened. Telescope stowed at 30 deg alt with cartridge 1 mounted. Counterweights at 280. Spectro autofill connected. 10:57Z Spectro dewar weight: 202 lb 10:57ZImager dewar weight: 293 lb ---=== SOFTWARE USED ===--- IOP/SOP: iop Watcher: watcher MCP: v5_26_0 TPM: tpm_v3_0_0 AstroDa: biery TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: SoS: hoggPT: v1_6_9 plate-mapper: ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.5520 0.5580 Axial B 0.6180 0.6200 Axial C 0.9440 0.9350 Trans D -9.9930 -9.9920 Lateral E 10.3759 10.3505 Lateral F 11.9380 11.9253 GALILS Commanded: 4700. -2450. 3000. -7800. 3300. 3000. Actual: 4700. -2450. 3000. -7800. 3300. 3000. SETMIR VALUES PriDesOrient: 0.00 -1.68 7.05 385.25 92.02 PriOrient: 0.00 -1.52 7.02 384.99 93.81 SECONDARY: ---------- Focus: 0.00 Air Temp.: 19.7 Alt.: 29.774262 MIGS TONIGHT NOMINAL Axial A 1.5470 1.5460 Axial B 1.0510 1.0520 Axial C 1.1710 1.1720 Trans D -0.0840 -0.0800 GALILS Commanded: 1593740. 1603674. 1554792. -6800. -5900. Actual: 1593450. 1603650. 1554300. -6800. -5900. SETMIR VALUES SecDesOrient: 1257.00 15.87 0.00 -50.00 136.76 SecOrient: 1257.21 15.75 -0.06 -49.59 136.82 ---=== PROBLEMS IN DETAIL ===---