[All Clear 4:11 p.m. PDT] In-World Services are restored. It is clear to conduct transactions.
We have identified a technical problem with our database. We are investigating and will keep you updated. This affects all in-world services. Please do not conduct transactions until we give an all clear.
One of the twenty servers which provide asset management just recovered from a disruption lasting only a few minutes. It recovered while this post was being prepared.
If you are having residual problems with appearance or inventory, please clear your Second Life cache (Preferences->Network) and relog.
ALL CLEAR 3:26 p.m. PDT Logins are fully open and our database issues have been resolved. It may take a little while for the database to catch up.
Update 2:36 p.m. We have closed logins until the database recovers.
We have identified a database issue which is causing in-world services to be unavailable. Logins, groups, profiles, inventory, teleport, and transactions are affected. Please do not conduct transactions until we have an all clear.
[Resolved 1:10pm PDT] - Logins have been re-enabled and the database is feeling much better now. Be gentle, it has a little headache.
Logins have been disabled momentarily to help the database recover. We expect them to re-open within the half hour. You may see some database related issues in the meantime.
[8:51am PDT] Sorry everyone, we just had a slight database hiccup resulting in a short service disruption. Transactions, logins, teleports, just about everything was failing for a bit until the database could recover. You can read more on how it works, what can happen and how we respond here:
http://wiki.secondlife.com/wiki/Service_Disruptions#Central_Database_Cluster
[5:30 am PDT] We are getting increased reports of a significant delay in group IM. This seems to be related to an ongoing problem of a similar nature that mostly affects large groups, but now seems to be happening to smaller groups as well. IMs sent within the group channel can sometimes take minutes or even hours to appear. For more information on this problem please visit the Issue Tracker: http://jira.secondlife.com/browse/VWR-1298
[RESOLVED 10:03 am PDT] We are satisfied that the network problem has been resolved.
[UPDATE 09:06 am PDT] We are cautiously optimistic the failing router has been identitified and switched, and logins are now open again.
However, we don’t resolve this issue quite yet since we’d like to closely monitor the situation for a while before we give the all clear.
If you experience longer wait times upon login than what you’re used to, please don’t quit to start again, but give it a bit more time and keep your place in the login queue.
[UPDATE 08:21 am PDT] Our upstream provider is continuing work on their routing issues. Alas, we have no new details to report.
[UPDATE 07:06 am PDT] We have to close logins for a while to enable the database to process the overflow from earlier. The landstore is not accessible for the moment as well.
[UPDATE 5:51 am PDT] While resolved, we are still seeing some residual effects from our earlier outage. In our attempts to clear them you may see temporary network outages across most regions. When it does you will be unable to rez, teleport, search, etc. These should only last a few minutes and will not affect the entire network at once.
[RESOLVED 05:05 am PDT] The network issues are resolved, but you might see things being a bit slow for a while longer while the systems clear up.
Logins might also be slow, while everybody tries to log back in. Please rather keep your place in the queue than trying a new attempt at login if it’s slow.
[UPDATE 03:55 am PDT] It looks like we have lost connection to our SF network, due to the internet service provider’s problems. Please do not try to rez or buy anything right now, we will keep you updated.
*****
Our internet service provider seems to have issues resulting in serious packet loss, which will have an impact on all inworld services.
This will affect logins, teleports, inventory and profiles not loading, as well as the rezzing of items.
Please do not attempt transactions at this time.
[RESOLVED 11:31 PM Pacific] Some residents also reported brief troubles with TPs. It looks like a regional router on the US West Coast hiccuped. Both residents and support staff are able to access the support portal now.
***
Some residents are getting a connection timeout on the support portal. We’re investigating.
[RESOLVED 11:10] The database issues have been corrected and in-world services have been restored.
We are experiencing database issues which affects in-world services. Do not conduct transactions until we give an all clear. Search, teleport, rezzing, are all affected.
Some regions are also down and being worked on. We will have these regions up as soon as possible.
The Preview Grid “Second Life Beta Server” channel has been updated with server version 1.22.2. This server will be deployed to Second Life this week in a rolling restart. For more information, see this post on the Second Life blog.
Status Report RSS feed