Midnight Run

The phone rang just as I was going to bed.

This phone call had a number I knew all too well, even without the caller ID showing the name… K1 Remote Operations. A this time of night it would be a problem, a serious problem. This particular problem would have me on the road back to the summit an hour later.

Keck at Night
Looking towards the Keck 2 dome on a moonlit night

Midnight runs to the summit are not common, but they do occur in my life. Usually we can work remotely, the night attendant serving as our remote eyes and hands. Just press the right button, flip the correct switch, done. Not this time. We tried, for over an hour we tried.

I really did not want to head back up. I had just gotten down a few hours ago, having spent the day on the summit working on the usual long list of things that need to get done. Days on the summit, in the thin air of nearly 14,000ft elevation are physically draining.

The irony of this malfunction is that I had seen it before. The dome had tripped out inexplicably on previous occasions. The problem would occur then disappear. Once it vanished you could not troubleshoot it. Unlike most of our other systems there are no logs from the shutter drive, nothing records what was going wrong.

The Friday before this it had happened to me again. But this time was different, I had a maintenance computer attached to the PLC serial port. This time I saw the error, something in the code labeled speed mismatch. No idea what this was, or how it worked. Again the error disappeared, and I could not troubleshoot further as the weather was getting worse. No opening the shutters again.

I needed a chance to figure out what this fault was… Later that day I read through the code, figured out this feature was a speed check to insure that both sides of the shutter are driven evenly. A check to compare the right and left sides of the shutter and to fault if the difference is too large. Two words of memory were compared, if the difference was too large it faulted the shutter drive.

Continue reading “Midnight Run”

It was one of those weeks…

It was one of those weeks.

Keck 2
The Keck 2 telescope, iPhone photo processed in Prisma
It did not look like it was going to be a bad week. The schedule was for a light week with nothing serious envisioned. Better yet, Tuesday was scheduled to be our departmental retreat, a day at the beach with the operations crew, all good.

One. Deb is having a bad spell. With little warning I took off Monday afternoon to drive her down to Kona to spend a couple hours in the infusion lab for medication.

Two. Monday would just not die easily… The phone calls began just after sunset. The Keck 1 hydraulic bearing system would not come on properly, shutting down just after the main pump came online. It became quickly apparent that I would be joining John and Justin for a trip to the summit in the middle of the night.

Continue reading “It was one of those weeks…”

It’s Broke

Yes, it is broken. Worse, I do not know how to fix it.

Specifically it is the primary fringe tracking camera, FATCAT, that has unacceptable levels of noise. We are due to be observing with it tomorrow night. No fringe tracker, no interferometer. After several days of troubleshooting I still have no idea what is wrong. I do know about a lot of things that are working, having painstakingly checked many parts of the system. The level of frustration is building.

Back to the summit tomorrow. Which sucks. I was supposed to be helping out with the Planet Walk tomorrow. Setting up a solar telescope to allow kids to see our star. Instead, it is back to the frustration of a broken camera.