dwing's blog

migration complete

DNS records have been updated, and Banjo is the new employees.org server.

If there are any problems, send email to admin@employees.org

mailing lists migrated

All 63 mailing lists that owners said were active have been migrated to the new server. The only change change will be the hostname in the administrative URL. The list's email addresses will remain the same before, during, and after the migration. When we update the DNS records for www to point to Banjo (estimated in September), the hostname for the administrative URL will again be www.employees.org.

unplanned outage, 22 Sep

On 22-Sep, a UPS failure at 5:58am PDT at our colocation facility caused all systems to lose power. Power was restored at 6:42am. However, willers.employees.org did not reboot successfully due to a corrupted CMOS. It was manually brought up at 3:30pm, disks fsck'd, and is now operating normally.

We suspect the CMOS was corrupted due to a dead CMOS battery, which we plan to replace soon.

planned June 26, 2009 outage

Employees.Org will be powered down the afternoon and evening of Friday, June 26, 2009. During this time the cabinet will be re-cabled and new hardware will be installed in the replacement system -- which will finally allow us to begin migrating to faster system with mirrored disks.

July 14-15 outage

At about 5pm PT on Monday, July 14th, Employees.Org encountered errors on its system disk that caused the system to wedge. We rebooted the system at 11:30am PT on Tuesday, July 15th.

Normally, we would communicate outage information by posting to http://status.employees.org -- however, that system was also down for unrelated reasons.

We apologize for the outage.

We have new hardware which we will be bringing live within the next several months.

Email Changes

These changes should be invisible.

To accomplish this change, we will create an MX record for willers.employees.org pointing to the IronPort anti-spam appliance, and soon thereafter will block all unauthenticated email delivery to TCP/25.

Authenticated email to TCP/25, TCP/587, and TCP/1025 will still work as it does today. As a reminder, email should be submitted to mail.employees.org.

Also, due to a configuration error, some email was accidentally bounced on April 23 between 10am and 1:45pm Pacific Time.

Please send questions to "Admin":mailto:admin@employees.org.

New Spam Firewall Installed

The "IronPort":http://www.ironport.com anti-spam appliance has been installed in front of Employees.Org, and has been active for about a month.

It is configured to drop any incoming email that it determines is spam. If you would prefer, instead, that your spam be tagged, please send a request to "admin@employees.org":mailto:admin@employees.org.

If you have any questions about its operation, please also email "admin@employees.org":mailto:admin@employees.org.

Status.Employees.Org

During outages of employees.org, you can visit "status.employees.org":http://status.employees.org for status updates. status.employees.org is hosted on a different computer in a different datacenter.

Server stability issues

Since the move to our new datacenter, employees.org has suffered some system instability. Our suspicion is that connectors were loosened during the drive across town. We have a new power supply and a donated motherboard/CPU/memory. We expect to swap out the existing motherboard and power supply within a few weeks, as our work and personal schedules permit.


Please accept our apologies for the service disruption.


If you have questions, please drop email to admin@employees.org.

RSS feed fixed

To get an RSS feed of Employees.org's news, point your RSS reader at http://www.employees.org/news/RSS

Syndicate content