Second Life Grid Status Reports

Update 06-13 07:00 : Our colocation hosting provider is again online. It appears that we have restored full connectivity. If you experience further problems, please check this blog to see if network interruptions have returned.

Update 06-13 06:38 : The outage from our colo hosting provider begin about 15 minutes later than expected, and lasted longer than expected. After a brief few minutes of being connected, the data center has again gone offline. The regions and inventory servers at that colocation facility continue to be affected. We will post more information as it becomes available.

Update 06-13 05:34 : we are closing down the affected inventory servers. If all goes well, they will be reopened, and residents whose inventories are stored on those servers will be able to log in again, in 45 minutes.

The colocation facility hosting some of our servers will be doing scheduled maintenance that will require a brief interruption of network connectivity to that facility. During this brief time, about 20% of the grid will be unavailable. It is expected that this interruption will only last a few minutes.

In addition, some of our inventory servers are housed at this facility. Starting at about 5:30, we will need to require those who have their inventory database on one of those servers to logout, and we will prevent logins requiring those inventory servers. Logins will be reopened as quickly as possible after the network interruption is complete.

All-Clear 9:56 p.m. PDT We have identified and corrected the routing issue.  It is all-clear to conduct transactions and issues stemming from this routing problem should be resolved.

Some residents are reporting problems with appearance and inventory. Operations is tracing potential routing issues. Please do not attempt valuable transactions until an all-clear is given.

[6:35am PDT] The inventory database that was temporarily offline has been brought back online.  Logins may be slow for a short while. We are monitoring this situation and will report any problems if they arise.

[6:15am PDT] Logins continue to be slow for some residents and blocked for others. We are investigating.

[6:00am PDT] One of our inventory servers is currently having difficulties. We are attempting to fix it but in the meantime a small percentage of residents will be unable to access their account. ETA for completion is 15 minutes.

[Resolved 7:18pm PDT] - All lines to support have been restored and we are running at full capabilities again.

We are currently experiencing outages with billing phone support, billing live chat, and out-world live chat, due to connectivity issues. We are expecting this to be resolved quickly, and we will keep you updated here as the situation progresses.

Logins were temporarily disabled to address a database issue for a few minutes, they are open now. In-world transactions and related issues are now behaving well again and you may return to normal activities.

[Resolved 3:18pm PDT] - Logins have been re-enabled and the database issue has been resolved. you can return to normal activities now.

Logins have been temporarily disabled to address the following:

We have identified a technical problem with our database. We are investigating and will keep you updated. This affects all in-world services. Please do not conduct transactions until we give an all clear.

For more information, see this post on the main blog.

[6:00am PDT] The offline inventory server it back online and should be functioning normally

[5:15am PDT] One of our inventory database servers is currently offline. Residents on that server will be unable to log in until it can be brought back online. We anticipate that should happen very soon and update when that happens or if it is going to take longer than expected.

[RESOLVED] Vivox has fixed the issue and voice is once again working.

There is an issue which is affecting inworld voice chat. Operations is working to diagnose the problem. Please monitor this post for further information as it becomes available.

For more information, please see this post on the main blog.