unplanned outage, 22 SepSubmitted by dwing on Tue, 2009-09-22 16:48 |
On 22-Sep, a UPS failure at 5:58am PDT at our colocation facility caused all systems to lose power. Power was restored at 6:42am. However, willers.employees.org did not reboot successfully due to a corrupted CMOS. It was manually brought up at 3:30pm, disks fsck'd, and is now operating normally.
We suspect the CMOS was corrupted due to a dead CMOS battery, which we plan to replace soon.