APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Monday November 21, 2005 (MJD 53696) ---=== OBSERVING TEAM ===--- Howard Brewington Jurek Krzesinski Olena Malanushenko Viktor Malanushenko Steph Snedden Mike Harvanek (swing) Jon Brinkmann - support Kurt Biery (by phone) Eric Neilsen (by phone, all the night) ---=== OBSERVING PLAN ===--- Shakedown. ---=== OBSERVING SUMMARY ===--- PR closed: 6752 dscIpcrm should now correctly clean up IPC services. 6753 "start_servers -k/K" should now gracefully exit iop so that IPC. 6645 FITS header checksums are now implemented for all files types... We have iop v4_9_2 now declared test. We did not declare it current since we couldn't test it with spectrographs. SN 82 S done from lambda -147.8 frame 20, but then we tested some PRs closing and opening petals so there is a good SN stuff (good seeing skippy happy) starting from frame 62, lambda -141.4 -> frame 191, lambda -122.2. The link on our science plan to spool the SN data is broken and we have a problem with shh to sn10 - we are too tired to see what causes it. sorry. ---=== OBSERVING LOG ===--- Afternoon: ---------- Couldn't get the spectros to take a bias. See the Problems section. Engcam is mounted so no spectro collimation check was performed. Night: ------ Poiniting model: ---------------- engcam moutned, stars found, then we got into the problem with dofind: gcam dofind was failing to find stars on a taken frame for several times. Image was displayed but we couldn't get seeing measuraments. The error message was: "gcam dofind failed" We tried to set inst=encam to get engcam initialized again a few times and we saw the following: 0 7 I Text="reading file: TINST:DEFAULT.DAT" 0 7 I Text="reading file: TINST:I_CA1_ENGCAM.DAT;" 0 7 I SecFocus=-300.00 0 7 I GCFocus=0.00 0 0 I Modu="prt_Init_Forth"; Text="initializing TCC_GCAM1; obtaining lock" 0 0 I Modu="prt_Init_Forth"; Text="resynchronizing I/O stream" 0 0 I TrackAdvTime=3.53 0 0 I Modu="prt_Init_Forth"; Text="sending initialization command" 0 0 W Expected="init" 0 0 W Received=" " <==== see that? ####### 0 0 F Modu="prt_ReadMatch"; Text="bad reply" 0 0 F Modu="prt_Init_Forth"; Text="initialization command init failed" 0 0 W Modu="prt_ChangeDev"; Text="the guide camera TCC_GCAM1 will not be usable until you fix the problem" 0 0 W Modu="prt_ChangeDev"; Text="could not initialize new device: TCC_GCAM1" 0 0 I Modu="prt_ChangeDev"; Text="this instrument does not have a: TCC_GMECH" 0 7 I Text="guide camera focus not adjustable" 0 0 I Modu="axe_o_Init"; Text="locking ports: Rot" we tried set inst a few times following with gcam dofind command (failing to read, but sending and displaying and image). When we were just about to call someone for help we tried gcam dofind once more time AND IT WORKED ... we don't know what fixed the problem. After checking the engcam centering we found that it's center is: 776, 534 (not binned) and the old but most recent values in the camera block file are: 768, 533 The block file was corrected. We took a full set of points for our pointing: GRID_DEFAULT_72PT.DAT;1 -> measuraments written to: PTERR_20051122.DAT;3 The RMS for that models is 2.2" After we implemented a new pointing we checked it with a short one: GRID_LAST_20_PTS_OF_DEFAULT_72PT.DAT;1 When we fed a new pointing model to tcc and started a short pointing model, we noticed too many stars not beeing found and well off the ccd center. What was wrong? Well, we looked at telmod.dat file and found there is nothing in that file. We think, the reason for the telmod file not beeing written was that we didn't close all our tpoint sessions (so there was at least one tpoint session still open while we were fitting pointing model in another one). After closing all tpoint sessions, we opened a new one and exported telmod file without a problem (confirming, that it was written properly). Now the short pointing taken with dopterr was finding all stars close to the engcam ccd center. 06:50Z Imager mounted. The other shake task we'll do while scanning 82 S. goDrift failed with the error message: im> goDrift Flavor of this run (science, bias, calibration, engineering, ignore, help) []: science Stripe, Strip (e.g, 22,N or SS,N) [82,S]: Please provide a one line comment [] sn Error: expected integer but got "10 -163.71965700" im> (see tb in the problems section) Eric was called. He corrected the code and now we have iop v4_9_2. Run 5888 bias on the telescope. Run 5889 stripe 82,S. Skippy TEHTAF was 0.13 deg, so we had to correct the pointing. Is our new pointing not good after all? To check PR 6682 we closed ff petals and run skippy from imager server window (which sends results to logtool and to watcher, skippy run from an ordinary iop window, does not change watcher Astrom Data). And we saw that after a while skippy results from skippy get into a watcher (by a minute or less). PR was redirected to sir Robert :). PR 6721 When calcStripParams fails in idReport, it should tell... im> checkRunInIdReport Cannot verify the stripe because there is no TCC connecton <- we did have the connetion science run 5889, drifting on stripe 82,S Coordinate system of the scan great circle: mean (equinox 2000) Coorditate system of the TCC: MEAN (equinox 2000) Great circle node 95, inclination 0 Scan started at mu=35.34, and is ONGOING Boresight offset in x: 22.7402 mm, y: 0 mm CCD clock rate was 26322 usec/unbinned row. Tracking rate was 15.04106 arcsec/TAI-sec. Observers estimated that the quality was unknown im> startDa -tcc A connection seems to already exist 2005-11-22 08:40:32Z: iop connection made to tcc25m.apo.nmsu.edu im> Eric was happy with information here. Also checkGang command worked as advised. We are not closing that PR since we think it's an itermediate step to get proper iop warnings (right Eric?). SN guys: -------- By the way, the test was done on stripe 82 S. We started the scan at lambda -147.8 frame 20, but then we tested above PRs closing and opening petals so there is a good SN stuff (good seeing skippy happy) starting from frame 62, lambda -141.4 beginning of the ramp, start of science at frame 76, lambda -139.4. End of the ramp at frame 191, lambda -122.2. All in photometric conditions. We finished SN scan and move the telescope to legacy stripe: 18,S lambda -64 just for test, but we called it science. run 5890 test scan on stripe 18,S. We expect now two runlogs to be sent by endNight for run: 5889 and 5890. skippy happy (THETAF was 0.02 - withing limits, but close, we made a correction anyway), in focus and in good seeing. in focus on frame: 46, focus=-277 out of focus frame: 55, focus -500 donuts look good out of focus frame: 60, focus +500 donuts look good There is a slight bottom heaviness in donut images, too light in fact, so we decided not to collimate the telescope. We cannot test spectrographs, but we can check spectro guider and pointing with a cartridge mouted: 11:00Z cart 9 plt 2279 mounted. fk5 used to find guide stars (offset was in DEC+6"). 11:47Z cart 6 plt 2285 mounted. fk5 found with a spiral pattern loop. (previous offsets were cleared and new: RA=-8", DEC=+12" offsets were used to center and fk5). But guider display shows too bright sky levels for the fiber 1,8,9,11,6,7 we don't what causes that. But French will try to find out if something is wrong with the fiber or the cart itself (THANK YOU :). We unmounted and mounted back cart 6 to see if we have some problem with slitheads, but the situation was the same. After clearing offsets, we couldn't find the guide stars, but fk5 was offseted RA=+8", DEC+12. So RA offset was different this time. Why? 13:00Z EndNight failed (Eric will deal with that when he will be more awaken, we called him several times all the night looooooong): im> endNight Finished ensuring that the archiver queue is empty. untransferred gangs? checking runs 5885 5886 5887 5888 5889 5890 none 2005-11-22 12:41:49Z: The pool contains no untransferred gangs for runs in the idReport file. Finished verifying that there are no untransferred gangs in the pool (or that you don't care). This is what the idReport file thinks happened on 53696: Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 5885 22:41Z 22:59Z 100 O 110.43 115.14 46 ignore 5886 00:11Z 06:33Z 100 O 133.15 -131.05 30 ignore 5887 07:26Z 07:36Z 100 O -117.78 -115.30 30 ignore 5888 07:39Z 07:55Z 100 O -114.52 -110.69 40 bias 5889 07:58Z 09:49Z 82 S -149.66 -121.87 199 science 5890 09:58Z 10:44Z 18 S -63.72 -52.33 90 science Continue? yes This is what the sdReport file thinks happened on 53696: UT Exp Time flavor comment =============================================== Error: can't read "platesObserved": no such variable im> We did not take any spectro frames tonight, so maybe that causes the problem. Also because of that we couldn't spool the data (sorry SN guys :). Eric was called and he made endNight to finish. we couldnd spoll the data - the link to the instruction was broken and when we tried to ssh to sn_user@sn10 we got information: no route to host iop -t NOT declared done, since we couldn't test spectrographs with it. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 5885 22:41Z 22:59Z 100 O 110.43 115.14 46 ignore 5886 00:11Z 06:33Z 100 O 133.15 -131.05 30 ignore 5887 07:26Z 07:36Z 100 O -117.78 -115.30 30 ignore 5888 07:39Z 07:55Z 100 O -114.52 -110.69 40 bias 5889 07:58Z 09:49Z 82 S -149.66 -121.87 199 science 5890 09:58Z 10:44Z 18 S -63.72 -52.33 90 science ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- 5889 17 4 32 -1.100 0.127 -3.400 0.121 -0.13411 237 40 5889 17 4 32 -1.100 0.127 -3.400 0.121 -0.13411 237 40 5889 26 4 11 -1.300 0.134 -3.200 0.114 -0.00065 237 40 5889 27 2 0 0.000 0.000 0.000 0.000 -0.00000 0 0 5889 48 4 0 0.000 0.000 0.000 0.000 -0.00000 0 0 5889 105 4 64 -2.400 0.155 -3.800 0.138 -0.00002 237 40 5889 157 4 35 -1.600 0.169 -4.000 0.129 0.00128 237 40 5890 8 4 0 0.000 0.000 0.000 0.000 -0.00000 0 0 5890 59 4 0 0.000 0.000 0.000 0.000 -0.00000 0 0 ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ 5889 63 1 40 303 16 -3.064 0.086 -3.954 0.154 0.01329 5889 63 1 40 303 17 -2.690 0.105 -3.736 0.186 0.01256 5889 63 1 40 303 17 -2.191 0.104 -3.294 0.124 0.01107 5889 63 1 40 303 9 -1.778 0.166 -3.155 0.277 0.01061 5889 63 1 40 303 11 -1.454 0.262 -3.197 0.275 0.01075 5889 80 1 40 303 19 -0.970 0.173 -2.907 0.108 0.00977 5889 80 1 40 303 20 -0.530 0.214 -2.558 0.185 0.00860 5889 80 1 40 303 14 -0.046 0.212 -2.360 0.214 0.00794 5889 80 1 40 303 13 0.508 0.136 -2.044 0.179 0.00687 5889 80 1 40 303 15 0.847 0.236 -2.068 0.131 0.00695 5889 114 1 40 303 17 -0.788 0.141 -3.142 0.141 0.01056 5889 114 1 40 303 11 -0.501 0.071 -3.164 0.117 0.01064 5889 114 1 40 303 18 -0.072 0.112 -2.983 0.127 0.01003 5889 114 1 40 303 22 0.474 0.158 -2.751 0.105 0.00925 5889 114 1 40 303 12 0.898 0.098 -2.533 0.193 0.00852 5889 132 1 40 303 19 -0.480 0.205 -2.694 0.128 0.00906 5889 132 1 40 303 17 -0.204 0.165 -2.346 0.160 0.00789 5889 132 1 40 303 23 0.200 0.174 -2.053 0.206 0.00690 5889 132 1 40 303 16 0.723 0.100 -1.759 0.172 0.00591 5889 132 1 40 303 25 1.140 0.148 -1.634 0.159 0.00549 5889 166 1 40 303 11 -1.228 0.274 -2.731 0.175 0.00918 5889 166 1 40 303 23 -0.714 0.213 -2.406 0.143 0.00809 5889 166 1 40 303 20 -0.101 0.279 -2.131 0.170 0.00717 5889 166 1 40 303 19 0.104 0.242 -2.151 0.116 0.00723 5889 166 1 40 303 20 0.484 0.232 -2.283 0.181 0.00768 5889 180 1 40 303 22 -0.578 0.171 -2.843 0.149 0.00956 5889 180 1 40 303 26 -0.065 0.112 -2.401 0.146 0.00807 5889 180 1 40 303 21 0.490 0.134 -2.169 0.138 0.00729 5889 180 1 40 303 19 0.905 0.130 -2.191 0.125 0.00737 5889 180 1 40 303 22 1.450 0.170 -1.853 0.134 0.00623 ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): QA Procedures Done (y/n): UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL Stays: JL ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 22:19Z 46 14 9 189 (S) 529 - 22:49Z 46 15 7 229 (SW) 537 - 01:15Z 39 10 6 108 (ESE) 414 - 01:45Z 39 7 5 105 (ESE) 211 - 02:15Z 40 6 6 126 (SE) 193 - 02:47Z 39 7 7 126 (SE) 278 - 03:18Z 39 6 3 195 (SSW) 183 - 03:48Z 39 6 2 127 (SE) 194 - 04:18Z 41 6 6 204 (SSW) 170 - 04:49Z 40 5 3 186 (S) 185 - 05:19Z 40 7 1 179 (S) 181 - 05:52Z 40 5 1 216 (SW) 145 - 06:24Z 41 5 0 220 (SW) 149 - 06:55Z 40 6 1 260 (W) 139 - 07:25Z 40 7 0 244 (WSW) 104 - 07:55Z 40 7 0 311 (NW) 129 - 08:25Z 40 7 1 341 (NNW) 153 - 08:56Z 40 7 1 291 (WNW) 195 - 09:27Z 40 7 0 327 (NNW) 157 - 09:57Z 40 7 2 278 (W) 140 - 10:29Z 41 5 1 287 (WNW) 161 - 10:59Z 40 6 2 274 (W) 141 - 11:30Z 41 5 4 280 (W) 159 - 12:01Z 40 5 1 270 (W) 142 - 12:31Z 39 6 4 276 (W) 135 - 13:02Z 39 8 2 277 (W) 144 - ---=== TELESCOPE STATUS ===--- 23:45Z Enclosure doors opened, fans and blowers on, louvers opened. 23:55Z Enclosure off. 12:50Z Enclosure on the telescope, hoses hooked up, but fill was not forced (as for French request). ---=== SOFTWARE USED ===--- IOP/SOP: v4_9_0 Watcher: v2_31_0 MCP: v5_26_0 TPM: tpm_v3_1_0 AstroDa: v15_9 TCC: TCC 2.7.2.1 August 6 2004 sdssProcedures: v2_06 SoS: v4_10_7 hoggPT: v1_6_9 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: -5.8380 -5.8440 Axial B: -5.6810 -5.6770 Axial C: 0.9410 0.9420 Trans D: -9.9970 -9.9940 Lateral E: 10.3759 10.3759 Lateral F: 11.9507 11.9380 GALILS Commanded: 4711. -2457. 2997. -7825. 3296. 3024. Actual: 4700. -2450. 3000. -7800. 3300. 3000. SETMIR VALUES primDesOrient: 0.00 -1.68 7.05 385.25 92.02 primOrient: 0.00 -1.52 7.02 384.99 93.81 SECONDARY: ---------- Focus: 0.0 Air temp: 4.2 C Altitude: 30.00 MIGS TONIGHT NOMINAL Axial A: 1.5350 1.5420 Axial B: 1.0460 1.0470 Axial C: 1.1670 1.1650 Trans D: -0.1190 -0.1240 GALILS Commanded: 1593447. 1603642. 1554316. -6820. -5882. Actual: 1593211. 1603850. 1554156. -6800. -5900. SETMIR VALUES secDesOrient: 1257.00 15.87 0.00 -50.00 136.76 secOrient: 1256.95 15.95 0.12 -49.48 136.69 ---=== PROBLEMS IN DETAIL ===--- Spectros won't take a bias: --------------------------- The spectro crates needed rebooting this afternoon. After rebooting and restarting the servers, a spectro bias was attempted but it failed: sp1> goStare 0 -init -bias DA rebooted... attempting to fix exposure number. The attempt will fail, so you MUST take another bias and request that it correct the exposure numbers when prompted. PlateId [-9999]: 2005-11-21 22:39:55Z: setting cameraSet(lines) 2070 Flushing charge for 15 sec creating BEGIN appending END EXPOSURE TIME is: 0 2005-11-21 22:40:53Z: NaN value for SPA in spectro fits header 2005-11-21 22:40:53Z: NaN value for IPA in spectro fits header 2005-11-21 22:40:53Z: NaN value for IPARATE in spectro fits header 2005-11-21 22:40:53Z: NaN value for AZ in spectro fits header 2005-11-21 22:40:53Z: NaN value for ALT in spectro fits header 1132612843 1132612849 creating opConfig parameter file /astrolog/53696/opConfig-53696.par 2005-11-21 22:41:06Z: beginData has failed: waited too long for the daqBusy CAMERA sp1: FAILURE on ftelnet: connection error in ftelnet: connection refused Error sp1> Jon Brinkmann was notified and the crates were robooted again but we got the same result. It was decided to roll back to the previous version of iop and DA and try again. This time we got a slightly different error followed shortly by a watcher warning: sp1> goStare 0 -init -bias PlateId [-9999]: 2005-11-21 23:07:15Z: setting cameraSet(lines) 2070 Flushing charge for 15 sec appending BEGIN appending END EXPOSURE TIME is: 0 2005-11-21 23:08:13Z: NaN value for SPA in spectro fits header 2005-11-21 23:08:13Z: NaN value for IPA in spectro fits header 2005-11-21 23:08:13Z: NaN value for IPARATE in spectro fits header 2005-11-21 23:08:13Z: NaN value for AZ in spectro fits header 2005-11-21 23:08:13Z: NaN value for ALT in spectro fits header 1132614483 1132614489 Error: daqBusy=1: sd1 is/are busy after 80 seconds sp1> Status Busy Run 53696 Frame 34969 dead (Frame=34969 Row=53: 2005-11-21 23:11:40Z) At this point Kurt Biery was called. goDrift error: -------------- im> goDrift Flavor of this run (science, bias, calibration, engineering, ignore, help) []: science Stripe, Strip (e.g, 22,N or SS,N) [82,S]: Please provide a one line comment [] sn Error: expected integer but got "10 -163.71965700" im> tb expected integer but got "10 -163.71965700" while executing "format %d,%1s [keylget standardReferenceList stripe] [keylget standardReferenc eList strip]" invoked from within "set standardReference [format %d,%1s [keylget standardReferenceList stripe] [ keylget standardReferenceList strip]]..." (procedure "checkStripeAgainstTCC" line 20) invoked from within "checkStripeAgainstTCC" invoked from within "if {![checkStripeAgainstTCC]} { puts "Input stripe and strip do not match actual telescope pointing." puts -nonewline "Continue anyway? " ..." invoked from within "if {[cequal $scanType(flavor) science]} { if {![checkStripeAgainstTCC]} { puts "Input stripe and strip do not match actual telescope pointi ... " (procedure "goDrift" line 38) invoked from within "goDrift" im>