Keck tracks every night with a custom, in-house database. These form a complete log of what occurred every night… The routine, the problems, the small disasters of operating a complex facility on top of a mountain. Reading these logs every morning is a ritual for many of the staff. A synopsis arrives in our e-mail each day, to be read on an iPad over breakfast, or as soon as you sit down at your desk.
For many in the operations department the contents of the logs set the pattern of the day. Was this a quiet night with no issues? Or is this a day when you need to drop everything to address some serious problem on the mountain?
Below is a typical night log from a quiet night. Reading through the logs each morning reveals much about the inner workings of the observatory. Who was working the night, the visiting astronomers and their subject of study. The logs also contain a number of statistics that are used to monitor the performance of the observatory.
Keck staff tracks all manner of time losses and inefficiencies. This night was typical, about nine hours of good dark time available for observation, of which six hours was spent “working”.
Three hours lost? To what? We use a very strict definition of science time, including only the time the instrument is on-target and collecting data. The various inefficiencies; the time spent moving the telescope, setting up the instrument for each new target, reading out the data, etc. are tracked. By keeping track of these time losses we can potentially task someone with increasing the efficiency if we see any potential improvements to be made.
12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364 ==================================================K1 K1 K1 K1 K1 K1 K1 K1 K1 K1 K1 K1 K1 K1 K1 K1 K1==================================================Id: K1-06923Universal Date: 06/02/13From: hhershleyInstitution: UCLAInstrument: MOSFIREObservers: Logsdon, (UCLA), Kulas, Mace, McLeanCARA Staff: hhershley njordan kwages jlykeWeather: Clear WindSeeing: 0.8Snapshot: 107Dome----Opened (UT): 05:10 Temp: out=2.4 in=4.2 mirror=2.2 tube=3.5Closed (UT): 15:01 Temp: out=1.5 in=1.9 mirror=1.6 tube=0.8Moon----Rise (UT): 11:25 Set (UT): Brightness: 0.06==================================================Program:"A Detailed Study of Galaxies in High-Redshift ProtoclustersUsing MOSFIRE"PI: McLeanWeather: The night was clear but with moderate winds that increasedat times (but never closed us). Seeing started very good - 0.45"- but got worse toward morning (CFHT lists 1.89" at 14:30UT).Time Loss:Slews = 00:04Dithers = 00:20Readouts, etc = 02:31MIRA x1 before 12deg evening.Telescope parked at MOSFIRE Stow.Dark Time 08:59Integration TimeScience 06:04Calibration 00:00Engineering Time 00:00-----------------------------TOTAL TIME WORKING 06:04Time Lost ToWeather 00:00Software 00:00Hardware 00:00Inst inefficiency 02:31Tel inefficiency 00:24Other 00:00-----------------------------TOTAL TIME LOST 02:55EndNightlog
Following the usual boilerplate will be a section for each separate writeup, each thing that went wrong in the night. Below you can see a typical writeup for a stage fault in the AO system. Some time during the night a moving optical stage failed to move, indicating an error instead. In this case the stage is AFS, which moves to allow the AO finder camera, ACAM, to focus. The support astronomer re-initialized the stage and continued to observe. It may just have been a quick fault, but it still gets a writeup.
123456789101112131415 **************************************************Id: K1-21753Universal Date: 05/14/13 05:54From: htranTo: echock ahoney acooperUrgency: C-MedTopic: AFS faultKeyword: AO1 ACAMTime Lost: 00:03**************************************************Tonight, as last night, the acquisition camera focus stage (AFS) faulted afterlaser zenith alignment. When going to the LGS checkout star and setting upbench, the aoacq tool stalled at "waiting for afs". The star on ACAM was outof focus. I initialized the AFS and re-setup bench. OK after that.
The writeup has my name on it! Not sure what happened here, these things do just glitch, the system is a complex stew of software and hardware. I will check it out in any case.