APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Friday September 3, 2010 (MJD 55443) ---=== OBSERVING TEAM ===--- Dmitry Bizyaev Elena Malanushenko Craig Loomis - help with STUI ---=== OBSERVING PLAN ===--- Science! 3 Sep 2010 55443.0 0.32 02:50 11:15 18:39 03:06 BOSS 8.4 hours ---=== OBSERVING SUMMARY ===--- We had one hour delay to open because of high humidity. The night was photometric with good seeing. We observed: Cart 11 plate 4083, Done This plate was observed the second time to complete the test of David Schlegel. He wanted to observe the same plates as regular observations (MJD 55441) and with spacers (tonight). Cart 10 plate 4201, Done Cart 14 plate 4221, Done Cart 16 plate 4231, - in progress There were several problems during the night: gcameraICC faulted two times; restarted gcamera and guider one time bossICC failed, Craig helped us twice "Serious boss.SP1PhaseBoot Reported by camCheck sos actor return to life but it's hartmann does not work (Tickets #1004, #1005) sop hartmann produce error "Serial transient not detected in 2 row" (Tickets #1003) sos reduction failed several times during the night. ---=== OBSERVING LOG ===--- Afternoon ---------- Actors checked, all were ok but sos ping ** FAILED ** Cart 17 plate 4066 is mounted Boss collimation ff=118820,21 Flat & arc calibrations ff=22,23 We checked collimation again ff=24,25. We expected to be in spec and in foc, but r1 was not in foc (warning yellow). We made another set of collimation, and confirmed that we are in focus (output is in problem section). Collimation procedure shows error message, filed ticket #1003. ------ SDSSPROC_BADFORMAT: Warning: Serial transient not detected in 2 row COLLIMATE: FILE1 = /data/spectro/55443/sdR-b2-00118824.fit.gz COLLIMATE: FILE2 = /data/spectro/55443/sdR-b2-00118825.fit.gz ----- During calibration and collimation we monitored status of BOSS exposures using new bosExpMon script, and wondering why some of exposures had one pre-reading stage but some others two. Exposure stage monitor output is in problem section for specialist's review. 00:25Z Started ventilation Night ------ It was clear and photometric at sunset. We could not open because of high humidity and nearby radar return. 01:40Z stopped ventilation 03:00Z started ventilation" 03:29 enclosure is off Cart 11 plate 4083 is mounted This plate was DONE on MJD 55441. David Schlegel wanted to observe the same plates again but with spacers. We assumed that this plate was with spacers for this night. 04:09 collimation, ff=0118826,27, adjusted 04:14 calibration, ff=118828,27 - almost in spec, yellow warning 04:26Z Sci. We found out that "sop doCalibs nflat=1 narc=1" did not do guider flat, some file was named as flat f='55443/gimg-0023.fits', lamps were off, cartridge was not right. We do not know how file flat was selected. We completed this sci exposure because we saw stars anyway. 04:43 science. During this exposure we had ecameraICC dead, we rebooted gcamera and guider, but could not start guider again until boss exposure finished as we need to do another guider dark and flat before guider run again. We checked an exposure and it looked ok with good sos feedback. 04:59, 05:17, 05:34 science This plate is DONE. ----------------------------- Cart 10 plate 4201. Craig informed us that the sos actor was running. We ran "gotoFiled" sequence with gotoFiled, sosHartmann, calibration. We got serious alert with sp1PhaseBoot. "Serious boss.SP1PhaseBoot Reported by camCheck After that boss aborted of exposure, and we ran "boss clearExposure" and "boss jack". Unfortunately,it happened twice and with SP1. The third time it was successfully to take hartmann exposures. But sosHartmann as STUI actor did not work: 06:06:36 APO.dmbiz.sop 535 sos i text="running collimate on 118838" 06:06:36 .boss 0 boss i text="wrote local copy /export/home/boss/data/55443/sdR-r1-00118839.fit" 06:06:36 .boss 0 boss i text="wrote local copy /export/home/boss/data/55443/sdR-r2-00118839.fit" 06:06:37 APO.dmbiz.sop 535 sos w text="not yet handling :All files not found: /data/spectro/*/sdR-b2-00118838.fit*, /data/spectro/*/sdR-b2-00118839.fit*:" 06:06:37 APO.dmbiz.sop 535 sos w text="not yet handling :All files not found: /data/spectro/*/sdR-b1-00118838.fit*, /data/spectro/*/sdR-b1-00118839.fit*:" 06:06:37 APO.dmbiz.sop 535 sos f text="collimation process failed" 06:06:37 APO.dmbiz 184 sop i stageState="gotoField.hartmann","failed",0.0,0.0 06:06:37 APO.dmbiz 184 sop i gotoFieldState="running","OK","done","failed","pending","pending" 06:06:37 APO.dmbiz 184 sop i gotoFieldState="failed","failed to take hartmann sequence","done","failed","pending","pending" 06:06:37 APO.dmbiz 184 sop f text="Failed to do Hartmann sequence" We tried do sosHartmann one more time, and got the same error with collimation. Filled Ticket #1004. Craig also filed ticket: 06:54:01 APO.Craig: Please mention bossICC/#1005 as filed against the quick hartmann processing failure. Switched to regular collimation procedure. 06:13 hartmann, ff=118842,43 adjusted. 06:18 calibration, ff=44,45 Found stars on GTF 06:28Z 118846 science We found out that flat exposure was not reduced and follow up exposures. We applied "sos_aporedo" to reduce data. We run sos for each exposure but finally it stopped and we could not reduce last science exposures. 06:44Z science 118847, 48,49,50 During exposure #49 gcamera stopped to respond again. We re-started gcameraICC and guiderActor. Competed exposure without guider, ran guider dark, flat and made one more science exposure. We ran sos3 for each exposure separately. f=118847 was not reduced, but this plate was done anyway. The realtime reduction started again after logfil-55443.fits.lock was deleted. This plate is done. -------- Cart 14 plate 4221 08:00Z hartmann, ff=118851,52, motors adjustments. 08:05 calibration, Flat=118853. motor were not on right position. Dmitry aborted that flat exposure. He made one more flat which looked as completed but was not saved on disk. We tried to do arc but could not run boss exposure. In several minutes we got message that bossICC was dead. Craig helped us to recover. 08:35:45 APO.Craig: Please refer to bossICC/#1006 Found stars on GTF. 08:20 arc, ff=118856 08:31 science, ff=118857 We noted that flat had different position of motors then science and arc, we made another flat. 08:48Z flat ff=118858 08:49Z science ff=59,60, 61,62. Thsi plate is DONE. --------------------- Cart 16 plate 4231. 10:05Z Collimation, ff=118863-64, adjusted 10:10Z Calibration, ff=65-66. 10:18Z, 10:34Z, 10:51Z, 10:07Z - science We did not finish the plate. ----------------- 11:30Z enclosure is on endNight is finished ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): QA Procedures Done (y/n): UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 07:26Z 10/4201 -24.87 0.0000 54.74 0.0000 159.26 0.0000 1.000045 07:16:11 APO.dmbiz.guider 183 tcc I ObjArcOff=-0.000513,0.000000,4790301440.03000,0.001590,0.000000,4790301440.03000 09:02Z 14/4221 -8.42 0.0000 57.04 0.0000 172.91 0.0000 1.000195 09:02:24 APO.dmbiz.guider 766 tcc I ObjArcOff=-0.001008,0.000000,4790307813.12000,0.002033,0.000000,4790307813.12000 10:28Z 16/4231 -16.76 0.0000 56.18 0.0000 165.97 0.0000 1.000195 10:28:14 APO.dmbiz.guider 602 tcc I ObjArcOff=-0.001043,0.000000,4790312962.67000,0.001669,0.000000,4790312962.67000 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 07:27Z 10/4201 1.00005 -443 1337 539 -25 54.6 11.4 6 186 -- 1.2" 09:03Z 14/4221 1.00019 -1924 -115 319 -9 57.0 10.9 5 152 -- 1.4" 10:28Z 16/4231 1.00019 -1924 -68 363 -17 56.2 12.3 3 207 -- 1.5" ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 00:46Z 57 48 2 219 (SW) 974 - 03:08Z 55 46 4 116 (ESE) 1041 - 04:12Z 56 46 1 134 (SE) 978 - 04:44Z 55 46 1 181 (S) 1482 - 05:23Z 55 45 1 192 (SSW) 1010 - 05:53Z 55 44 4 196 (SSW) 971 - 06:27Z 54 43 1 132 (SE) 781 - 07:00Z 53 42 4 190 (S) 627 - 07:33Z 52 41 5 188 (S) 531 - 08:09Z 52 41 5 188 (S) 582 - 08:41Z 52 41 6 186 (S) 544 - 09:13Z 52 40 3 172 (S) 481 - 09:46Z 50 42 7 123 (ESE) 549 - 10:18Z 53 42 0 185 (S) 570 - ---=== TELESCOPE STATUS ===--- 03:00Z - Began ventilation. Doors and louvers opened, fans on. 03:29Z - Opened enclosure. 11:30Z - Enclosure is on, doors and louvers are closed, and fans are off. No interlocks bypassed. Status at: 11:50Z Telescope stowed at: 30,121,00 mount Instrument mounted: Cartridge 16 Counterweights at: 287 lbs LN2 autofill systems: Connected and turned on. 180L LN2 dewar scales: sp2 182 lbs, 18 psi sp1 250 lbs, 24 psi ---=== SOFTWARE USED ===--- IOP/SOP: v4_40_0 TPM: tpm_v3_5_0 getVersions, 2010-09-04 08:03:57 ----STUI software STUI: 1.0b2 2010-07-21 alerts: trunk+svn114742 apo: trunk+svn114701 boss: trunk+svn115542M boss.daq: 1.2.14 boss.specMech: 3.0.1 gcamera: v1_1_2 guider: v1_0_20h hub: Tag: UNTAGGED_REVISION 502:504M mcp: v6_6_5 mcp.plc: 25 platedb: v1_0_5 sop: v1_1_3 sos: v1_1_4 tcc: 2.13.0 -----Other software sdssProcedure(sdss3): v3_06 idlspec2d (sos3) --- v5_4_12 plate-mapper3 ------ NOCVS:v5_0_7 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A -5.5090 -5.5100 Axial B 16.0920 16.0940 Axial C 15.9190 15.9220 Trans D 11.0060 11.0100 Lateral E 10.6172 10.6553 Lateral F 12.2301 12.2301 GALILS Commanded: 10600. -250. 5800. 10250. 13050. 12650. Actual: 10600. -250. 5800. 10250. 13053. 12647. SETMIR VALUES PriDesOrient: 0.00 -13.67 10.53 574.80 742.37 PriOrient: 0.00 -13.67 10.53 574.80 742.37 SECONDARY: ---------- Focus: 0.00 Air Temp.: 14.0 Alt.: 29.999989 MIGS TONIGHT NOMINAL Axial A -7.8350 -7.8320 Axial B -0.0410 -0.0410 Axial C 13.8170 13.8180 Trans D 14.1840 14.1840 GALILS Commanded: 1585299. 1566723. 1598880. -1450. -50. Actual: 1585350. 1566695. 1598880. -1462. -69. SETMIR VALUES SecDesOrient: 1257.00 -9.00 -4.00 -58.00 23.67 SecOrient: 1256.99 -9.00 -3.98 -58.07 23.31 ---=== PROBLEMS IN DETAIL ===--- [observer@sos3 ~]$ spCollimate 118824 SDSSPROC_BADFORMAT: Warning: Serial transient not detected in 2 rows ==> Collimate-55443-b1-00118824.log <== COLLIMATE: 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 COLLIMATE: 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 COLLIMATE: COLLIMATE: Min offset = -0.50 pix COLLIMATE: Max offset = 0.30 pix COLLIMATE: RMS across CCD = 0.28 pix COLLIMATE: COLLIMATE: Mean offset = -0.06 pix COLLIMATE: COLLIMATE: Camera b1 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict blue camera ring movement of 1.4 degrees for spectro-1 COLLIMATE: (if red is already in focus) ==> Collimate-55443-b2-00118824.log <== COLLIMATE: 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 COLLIMATE: 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 COLLIMATE: COLLIMATE: Min offset = -0.40 pix COLLIMATE: Max offset = -0.10 pix COLLIMATE: RMS across CCD = 0.11 pix COLLIMATE: COLLIMATE: Mean offset = -0.20 pix COLLIMATE: COLLIMATE: Camera b2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of 4.5 degrees for spectro-2 COLLIMATE: (if red is already in focus) ==> Collimate-55443-r1-00118824.log <== COLLIMATE: COLLIMATE: Min offset = -0.30 pix COLLIMATE: Max offset = 0.30 pix COLLIMATE: RMS across CCD = 0.16 pix COLLIMATE: COLLIMATE: Mean offset = -0.02 pix COLLIMATE: COLLIMATE: Camera r1 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict (red) piston movement of -122 steps for spectro-1 COLLIMATE: Issue command: "boss moveColl spec=sp1 a=-122 b=-122 c=-122" COLLIMATE: current motorPosition -515 -1978 -350 COLLIMATE: new expected motorPosition -637 -2100 -472 ==> Collimate-55443-r2-00118824.log <== COLLIMATE: COLLIMATE: Min offset = -0.20 pix COLLIMATE: Max offset = 0.50 pix COLLIMATE: RMS across CCD = 0.21 pix COLLIMATE: COLLIMATE: Mean offset = 0.02 pix COLLIMATE: COLLIMATE: Camera r2 appears to be IN-FOCUS (|mean| < 0.15 pix) COLLIMATE: Predict (red) piston movement of 138 steps for spectro-2 COLLIMATE: Issue command: "boss moveColl spec=sp2 a=138 b=138 c=138" COLLIMATE: current motorPosition 2338 -437 1844 COLLIMATE: new expected motorPosition 2476 -299 1982 Kyle's script is done ========================================== Start bossExposure Monitor: 2010-09-04 00:55:24 current: IDLE 00:57:10 FLUSHING, 13.00, file=118819 00:57:29 INTEGRATING, 4.00, file=118819 00:57:33 PREREADING, 3.00, file=118819 00:57:35 LEGIBLE, 0.00, file=118819 00:57:35 PREREADING, 3.00, file=118819 00:57:38 READING, 69.70, file=118819 00:58:38 IDLE 01:05:54 FLUSHING, 13.00, file=118820 01:06:13 INTEGRATING, 4.00, file=118820 01:06:17 PREREADING, 3.00, file=118820 01:06:19 READING, 69.70, file=118820 01:07:22 IDLE 01:07:22 FLUSHING, 13.00, file=118821 01:07:40 INTEGRATING, 4.00, file=118821 01:07:44 PREREADING, 3.00, file=118821 01:07:46 READING, 69.70, file=118821 01:08:47 IDLE 01:14:53 FLUSHING, 13.00, file=118822 01:15:11 INTEGRATING, 30.00, file=118822 01:15:41 PREREADING, 3.00, file=118822 01:15:43 LEGIBLE, 0.00, file=118822 01:15:43 PREREADING, 3.00, file=118822 01:15:46 READING, 69.70, file=118822 01:16:47 IDLE 01:19:15 FLUSHING, 13.00, file=118823 01:19:33 INTEGRATING, 4.00, file=118823 01:19:37 PREREADING, 3.00, file=118823 01:19:39 LEGIBLE, 0.00, file=118823 01:19:39 PREREADING, 3.00, file=118823 01:19:42 READING, 69.70, file=118823 01:20:43 IDLE 01:27:55 FLUSHING, 13.00, file=118824 01:28:13 INTEGRATING, 4.00, file=118824 01:28:17 PREREADING, 3.00, file=118824 01:28:19 READING, 69.70, file=118824 01:29:22 IDLE 01:29:22 FLUSHING, 13.00, file=118825 01:29:40 INTEGRATING, 4.00, file=118825 01:29:44 PREREADING, 3.00, file=118825 01:29:46 READING, 69.70, file=118825 01:30:47 IDLE =========================== Bias check Filename 02% 05% 10% 50% 90% 95% 98% ------------------- ------ ------ ------ ------ ------ ------ ------ sdR-b1-00118816.fit -4.0 -3.1 -2.1 0.0 2.1 3.1 4.2 sdR-b2-00118816.fit -4.0 -3.1 -3.0 0.0 2.1 3.0 4.0 sdR-r1-00118816.fit -4.7 -3.9 -3.1 0.0 3.9 4.7 6.2 sdR-r2-00118816.fit -4.8 -3.3 -3.2 1.6 4.8 6.3 6.6 ===========================