Second Life Grid Status Reports

[19:07pm PDT, July 2 2009] We will be deploying server version 1.27.0 to Second Life during the weeks of July 6th and July 13th.  The rolling restart is scheduled to look like the following:

Wednesday July 8, 7-10AM PDT : a pilot roll of ~500 regions
Tuesday July 14, 7-12AM PDT: half of Second Life will be restarted
Wednesday July 15, 7-12AM PDT: the remainder of Second Life will be restarted

As with all of our server deploys, each region will be restarted once during one of the rolling restart periods.  Most regions should be down no more than 5-10 minutes, although some fraction of the regions will take 20-30 minutes to upgrade.  If your region stays down for more than 30 minutes, please contact support.  Each region will receive warnings starting 5 minutes before that region is restarted.

Questions and discussion about the rolling restart may be directed to the “Rolling Restart to deploy 1.27.0″ thread in the forums.

[18:30pm PDT RESOLVED] The login issues have been resolved.

[17:48pm PDT] Please be advised that we are currently experiencing database issues which may cause issues with logins. We will update this blog with more information as it becomes available, and our engineers are working on the problem now. Please consider waiting on major purchases, land transactions, or rezzing no-copy objects until this issue has passed.

[5:59 AM Pacific] All is back to normal, credit card processing has been fixed.

[4:14 AM Pacific] Our apologies. This issue is not as resolved as we had hoped. We are continuing to work with Global Collect to find the source of the problem and repair it.

[3.39 AM Pacific] This issue is now resolved.

[3.05 AM Pacific] We are experiencing errors with our Global Collect System. This will mean that some credit cards will fail to update and some purchases will not go through. We are working to rectify this as soon as possible and will keep you updated on the situation.

[1st July 2009 - 2:37am Pacific]  Traffic should now be updating again.

[8:50pm PDT] The traffic issues remain, and it will not update tonight.  The estimated time of resolution is not known at this time.  Updates will be posted here as more info becomes available.

[7:25pm PDT] Our traffic statistics are calculating slowly, and are not expected to finish today. Traffic statistics should resume normal updates tomorrow.

[Resolved @ 12:33 pm PDT, June 30, 2009 ] The inventory server rotation has completed. Residents on that particular server should be able to login, although, it may be slow at first. Thank you for your patience.

[Posted @ 11:49 am PDT, June 30, 2009 ] We will commence an inventory server rotation shortly. A small subset of residents will be affected. Those on that server will be automatically logged out and will not be able to login temporarily until the work is complete. Those who are trying to login will not be able to login until the work is complete. Thank you for your patience. Please check back for further updates.

[RESOLVED Jun 29th 4:00pm PDT] The Land Store is now open and operating normally.

[UPDATE 7:00pm PDT] As previously reported, our Land Store at http://land.secondlife.com is continuing to have some issues with the automated delivery of regions. We do not expect this to be resolved before Monday.   As a result, regions are being delivered manually by our staff. If you’ve purchased a new region through the Land Portal and it has not been delivered within 4-8 hours, please contact our Support team at http://secondlife.com/support for assistance. Thank you for your patience.

[UPDATE 3:30pm PDT] - We apologize for the length of time this issue has been outstanding, as it is still unresolved. Work continues to bring back normal operations as soon as possible. Please watch this blog for further updates.

[UPDATE 12:54pm PDT] - While there is no time frame for a resolution, we are continuing to address this issue. Please check back for further updates.

[POSTED 9:48am PDT] - There have been reports from some Residents that the Land Store is experiencing some delays with region creation after purchase. We are aware of the issue and working towards a resolution. Please check back soon.

[UPDATE 3:33pm Pacific] The wiki is experiencing intermittent downtime. We are working to restore it fully.

[UPDATE 12:07pm Pacific] Our hosting service has applied another fix and our testing shows no current problems.

[UPDATE 11:17am Pacific] We’re seeing more sporadic behavior from the public wiki.  We’re investigating.

[UPDATE 5:22am Pacific] The wiki appears to be fully accessible again.

[UPDATE 4:49am Pacific]  We are still pursuing a resolution to this issue

[UPDATE 3:49am Pacific]  We are continuing to monitor this issue.

[2:49am Pacific]  Our Second Life wiki is intermittently unavailable at this time and we are working to have this restored to continued operation.

[RESOLVED 3:51 pm Pacific] The Public Issue Tracker has been restored to service.

The  Second Life Issue Tracker is currently still not accessible, our hosting company is currently working on the problem.  Please keep monitoring  this blog post for further updates.

[13:25 PDT]  We are aware that the Second Life Issue Tracker is currently not accessible and we are working to rectify the problem. Please monitor this blog for updates.

[June 27, 2009 4:40AM Pacific] Traffic has been recalculated.  If your traffic still shows as 0, please try clearing Second Life’s cache then relog.

[June 26, 2009 7:35AM Pacific] Our traffic statistics are still in the process of calculating. If your parcel or region was showing 0 traffic yesterday, it may still reflect that today until the process completes. Will we update this blog when the traffic updating is complete.

[RESOLVED 11:54am PDT] - The credit card issues have been resolved and you may conduct transactions or update information as normal.

[POSTED 11:22am PDT] - There are issues currently which may present failed transactions and/or information updates for credit card usage. This is being addressed and will be resolved as soon as possible, in the meantime you may wish to avoid any credit card usage. Please watch this blog for updates.