CloudFail.net

Basecamp is offline for maintenance.

Campfire is back online.

Campfire is offline briefly.

We’ve got things running smoothly again. Our sincere apology for the frustration we caused the dozen accounts that randomly received an error page in the last few minutes.

We are seeing an elevated number of error pages on Basecamp across all accounts. We’re investigating right now and will update again in just a minute.

Basecamp is back up. The bad code deploy has been rolled back. We are very sorry for the interruption.

Basecamp is currently down due to a bad code deploy, we have identified the cause and are working to fix as soon as possible.

We’ve heard from a few (<5) of our customer’s overseas that they are having trouble reaching Basecamp this morning. Although our monitoring shows everything is working normally, we want to make sure we resolve this issue if it’s something on our end. If you are having trouble accessing any of our products please open a support ticket so we may assist you.

The connectivity problem is Internet wide, and appears to be due to an Issue on Level3′s network in Chicago. We’ve already moved our traffic off Level3, and we wont move it back until we get the all clear from them.

Some people may have not been able to connect to our websites for a few minutes just now, though everything is now working. The problem seems to have been with one of the connections to our servers but we are looking further.