Cloud Fail

As of 8:48 PM CST, The Rackspace Cloud team has determined that there is an issue with the Cloud Server access in the control panel.  At this time we have our development team researching the issue with no ETA  on resolution.  Please check back to this post for updates.  We apologize for this inconvenience and
will update this blog post as we receive more information. 

Update: Currently as of 5 AM CST, The Rackspace Cloud team are still working on the issue with the Cloud Control Panel.

Update: As of 6 AM CST, The Rackspace Cloud team has corrected the issues with the Control Panel.

If you have any questions or concerns please Contact our support team via live chat or at 1-877-934-0407.

As of 11:55 AM CST, The Rackspace Cloud engineers have identified an issue causing degraded performance on MySQL cluster 50-06 in our WC1.DFW1 data center.  You may see slow performance or sites not load at all at this time.  We will continue to update this blog as more information becomes available. 

UPDATE: As of 12:26 PM CST, The Rackspace Cloud Engineers have corrected the issue causing degraded performance on the MySQL 5–06 cluster.  If you have any questions or concerns please contact our support via
live chat or at 1-877-934-0407 international +1.210.581.0407.

As of 11:20 AM CST, The Rackspace Cloud’s domain registration service OpenSRS is temporarily in a degraded state. Customers will be unable to register domains until services have been restored.  We will continue to make updates to this post as they become available.

UPDATE: OpenSRS has corrected the issue with their domain registration service.  You many now once again register domains through your Rackspace Cloud account.

Update @ 3:18PM CST – We have resolved the networking issues affecting some customers in our DFW datacenter. If you’re still seeing issues please drop us an email or swing by chat.

We are investigating issues affecting some customers in our DFW datacenter.

We will update this post with further details as we get them.

If you have additional questions please feel free to open a ticket via the SliceManager by selecting Help -> Contact Slicehost Support or you may swing by chat at https://chat.slicehost.com.

CloudFiles will be performing a routine maintenance on March 3rd 2010 at 8pm CST. During this maintenance window some JungleDisk customers will be read only, and the maintenance is should conclude around 9PM CST. Thank you for your understanding.

[UPDATE 8:00 PM CST] CloudFiles maintenance is currently underway, we will update this post once the maintenance has been completed.

[UPDATE 8:27 PM CST] Maintenance has completed successfully and all Jungle Disk customers are currently read write. Thank you for you patience.

As of 9:35 AM CST, The Rackspace Cloud engineers have detected an issue causing degraded performance in our ASP1-5 cluster in our WC2.DFW1 Cloud Sites data center.  This is an isolated issue affecting only sites on this single node.  Sites on this node will load slowly or not at all.  We will continue to report status updates as they become available.  If you have any issues, please do not hesitate to contact a
member of our support team via live-chat or at the following
telephone numbers: 24-hour toll free 1.877.934.0407 and INTL
+1.210.581.0407.

UPDATE: As of 9:43 AM CST, service has been restored to our ASP1-5 cluster.  Thank you for your patience as we worked to correct the issue.  If you have any other concerns, please visit with a member of our support staff.

On March 2nd from 03:00am – 06:00am CST, The Rackspace Cloud system administrators will be
performing priority maintenance on two of our MySQL database clusters in
our SAT data center.

During the
maintenance window some SQL queries utilizing these clusters will be in a
read locked state (INSERT, UPDATE, DELETE, ALTER queries will be
ignored) for the duration of the maintenance.  There may be a period of
up to 10 minutes in which databases will be unavailable.

We
expect this maintenance to last no longer than the time listed.  We
apologize for the inconvenience, but we need to complete this work in a
timely manner.  Please note that no other technologies will be effected
by this maintenance.

UPDATE: Cloud Engineers have rolled back maintenance changes and the servers are back online.

The Rackspace Cloud’s system engineering team will be performing control
panel maintenance on Tuesday, March 2nd, 2010 from 10:00 PM to
11:00 PM CST.  During this maintenance the control panel will be temporarily offline.  We expect this maintenance
to be completed within this time window and as always work to keep
maintenance down to a minimum. 

UPDATE:  As of 10:41 pm CST, Our Rackspace Cloud Engineers have completed the maintenance and everything should be back online.

If you have any issues, please do not hesitate to contact a
member of our support team via live-chat or at the following
telephone numbers: 24-hour toll free 1.877.934.0407 and INTL
+1.210.581.0407.

As of 11:15 AM CST, the Rackspace Cloud system engineers have detected
an issue that’s causing degraded performance in our DFW Data center.  Our team is actively working to resolve the issue, any updates we have on this issue will be posted here.

If you have any further questions, please contact a member of our
support team by visiting us in live-chat or by calling 1.877.934.0407
or INTL +1.210.581.0407.

Update: As of 11:53 am CST, the Rackspace Cloud system engineers have resolved the issue and normal functionality has been returned to the DFW Datacenter.

[14:42 UTC] CloudFiles is currently performing emergency maintenance. During this period some JungleDisk customers will be in read only mode while the problem is investigated and corrected. We apologize for any inconvenience, and we will have an update for you soon.

[15:43 UTC] The issue has been discovered and we are currently working on correcting the issue. The maintenance should take approximately 4 hours and will conclude are 19:43 UTC. We will keep you up to date on our progress.

[17:51 UTC] The emergency maintenance has concluded, and all JungleDisk customers are currently read/write once more. Thank you for your patience.