CloudFail.net

As
of 10:00 PM CST, The Rackspace Cloud system engineers have temporarily
disabled CRON in our WC1.SAT1 data center.  We’re working diligently to
resolve some performance issues on this Cloud Sites node in order to
re-enable.

UPDATE: As of 10.:28 PM CST, Rackspace Cloud system engineers have
re-enabled CRON. 

If you have any further questions, please contact a member of our
support team by visiting us in live-chat or by calling 1.877.934.0407
or INTL +1.210.581.0407.

The response team has resolved the emergency issues on the EY01 cluster. The EY01 cluster has been restored to normal operation.

Please file a ticket if you have any questions or experience residual issues.

We are starting to bring slices up and verify they are working correctly.

We are having to perform a reboot of the entire EY01 cluster. We anticipate being back up in one hour.

We are continuing to work hard to resolve the root and auxiliary issues as quickly as possible.

It may still be required to restart some environments.

All nodes are up with the exception of one which should also be up shortly.

Once that last node is brought up we will complete the final steps to bring individual customer environments back online.

At this point we are hoping to start bringing customer sites back online in approximately 20 minutes.

The cabling swapping has been completed. We’re working on getting the nodes and shelf communications back online. From this point we estimate it will take approximately one hour to complete this process.

We continue to work hard to swap out the cables on the switches. We are very sorry for this inconvenience and we’re moving as quickly as possible to resolve this as soon as we can.

Basecamp was down for about 5 minutes for some customers. We’re sorry for the trouble.

The first switch is being swapped now. We will then need to swap a second switch. Much of the network connectivity will be restored when the first swap is completed.