CloudFail.net

We’re investigating a high error rate and intermittent page loading issues that began at 02:58 UTC (7:58pm PDT)

Update 04:02 UTC (9:02pm PDT) We’ve routed around a troublesome cluster and the error rate has dropped.

The ey00-n01 node is still down but we were able to restore all the customer slices on other nodes so all apps have been restored to full redundancy and all cluster services have been restored.

If you have any questions, please contact us by calling our support line +1-866-518-9275. You can also file a ticket in our support system at http://support.cloud.engineyard.com

Our engineers have responded to a failure of a single node in ey00 node 1.

We are continuing to work hard to resolve the root and auxiliary issues as quickly as possible.

The Rackspace Cloud Live Chat will be
unavailable due to a system maintenance on March 26th 2010 from 12:25 AM to 12:40 AM CST. We will work to complete this maintenance as quickly as possible and apologize for the inconvenience. Our support team will still be available through our 24 hour phone support during this time.

Update 12:25 CST: Currently Live Chat support is down for maintenance.

Update 12:47 CST: Maintenance is complete and Live Chat is back online.

If you have any further questions, please contact a member of our
support team by visiting us in live-chat or by calling 1.877.934.0407
or INTL +1.210.581.0407.

The Rackspace Cloud Live Chat will be
unavailable due to a system maintenance on March 26th 2010 from 12:25
AM to 12:40 AM CST. We will work to complete this maintenance as
quickly as possible and apologize for the inconvenience. Our support
team will still be available through our 24 hour phone support during
this time.

Update 12:25 CST: Currently Live Chat support is down for maintenance.

Update 12:47 CST: Maintenance is complete and Live Chat is back online.

If you have any further questions, please contact a member of our
support team by visiting us in live-chat or by calling 1.877.934.0407
or INTL +1.210.581.0407.

[2:57 PM CST ] We are currently experiencing issues with the authentication portion of our system, and the issue is currently being investigated. We will keep you up to date with information as soon as it is received, and we apologize for any inconvenience.

[3:10 PM CST] The issue has been resolved and authentication is working properly.

Error rates recovered at 7:50am PDT. The service is operating normally.

We can confirm that between 6:37am PDT – 7:50am PDT some instances in the EU-WEST-1 region experienced elevated packet loss or increased latency to the Internet. We can also confirm increased latencies for requests to the Amazon EC2 APIs during this same period of time. The connectivity issues have been resolved, API error rates have recovered, and the service is operating normally.

We are investigating increased error rates for API requests in the EU-WEST-1 region.

We are investigating degraded network connectivity for some instances in the EU-WEST-1 region.