Second Life Grid Status Reports

The next round of upgrade maintenance of our 501 servers is scheduled for the morning of 11/18. The first group will be started at 6:00AM, and the second group at 10:00AM  The regions on those servers will be shut down in a delayed stopping process and shortly after come back up on their own.

Please refer to this post for more information, including lists of the regions affected, which will be posted roughly an hour prior to each round of maintenance.

[COMPLETED 15:40] The current server upgrade maintenance is complete.  There will be more to follow over the course of this week - stay tuned for updates!

[14:20] We are continuing the upgrade maintenance of our 501 servers. The regions on those servers will be shut down in a delayed stopping process and shortly after come back up on their own. Maintenance is scheduled to commence at 15:00.

Please find a list of regions that may be affected by this maintenance after the break. We cannot be 100% accurate because of the way regions are shut down and replaced by another.

(more…)

[RESOLVED 14:50] Voice service has been restored.  Any resident still experiencing voice problems should attempt cycling voice on/off in Preferences->Voice Chat.

[UPDATED 13:57] Voice service is not cooperating and reestablishment is taking longer than first anticipated. The situation is being worked on, and voice will be restored as soon as possible.

[13:43] A network glitch interrupted Second Life’s inworld voice communications briefly. The situation is on the mend now, and voice service is being reestablished.

[17. November '08, 09:23 am PST] The work on the first two server racks is completed.

There will be more to follow over the course of the next week, stay tuned for updates!

[17. November '08, 07:03] We are about to upgrade a few racks of our 501 servers by doubling the amount of RAM on them to improve their performance.  The regions on those servers will be shut down in a delayed stopping process and shortly after come back up on their own.

Please find a list of regions that may be affected by this maintenance after the break.  We cannot be 100% accurate because of the way regions are shut down and replaced by another.

(more…)

[RESOLVED 12:09 PM Pacific] The database issue affecting inworld services has been resolved; all affected services should now be operating normally.

Due to a on overload on our main database, you might see several inworld services not working as desired at the moment, such as transactions timing out, attachment and rezzing problems, teleports failing and login issues.

Please do refrain from making transactions or rezzing no-copy items at this time. We are working to resolve this, and will update here as soon as we have more information.

Due to an interruption in our nightly script that calculates traffic figures, we see a number of regions that report as 0 traffic today. The script is being re-run and should finish in about 10 hours from now.

If you do not see your traffic being correctly calculated by tomorrow 12 am PST, please let our support team know by submitting a ticket that contains the name of the region you’re seeing the issue in.

[16 Nov 08 06:20 PST] The maintenance work has been finished, the support telephone lines are fully operational again.

[16 Nov 08 05:09 am PST] The scheduled maintenance is under way, our support phone lines will be unavailable for another hour or so. You can submit tickets and use our live chat as usual in the meantime.

Our third party provider is undertaking some system maintenance on Sunday 16th November between 4am and 6am Pacific Time.

Telephone lines to Support may be offline for some of the time.  If you find this to be the case then do call again later or file a Support Ticket or use Live Chat.

If there are any changes to the maintenance schedule we will update you on this page.

[Resolved 12:00pm PST] - The Land Store has been re-opened and is functioning as normal once again.

[Update 11:35am PST] - All services have been resolved and are working as normal again, with the exception of the Land Store which will remain closed while we test functionality. We will update this blog when the Land Store has been re-opened.

[9:28am PST] We are looking into issues affecting transactions, logins, account creation and possible extensive related disruptions of services. Please refrain from any transactions as possible while we work to resolve this issue. During this time the Land Store has been closed to avoid further complications.

We will update this blog as information becomes available.

[UPDATE 8:37 pm PST] XML-RPC services are restored.

*****

XML-RPC services in world are temporarily disrupted. Engineers are already repairing the process, and service should return very shortly.

[11:50AM Pacific] The issue causing the teleport problems has been resolved. Thank you for your patience throughout this investigation.

[11:25AM Pacific] Some residents are experiencing teleport failures. We are aware of the problem and are looking into it.