Archive for February, 2009

[Resolved] Websites unreachable

Tuesday, February 24th, 2009

[Resolved 05:24am PST] The issues with our webhost have been resolved.

Our website hosting vendor is currently experiencing an issue and as a result you may not be able to access secondlife.com, lindenlab.com and teen.secondlife.com. The issue is being worked on and will be resolved as soon as possible.

[RESOLVED] Intermittent Asset Problems

Monday, February 23rd, 2009

[1:40pm] UPDATE: We have resolved the asset issues. If you are still experiencing problems, please contact support.

[1:25pm] UPDATE: We have identified and fixed what we believe to have been the cause of the problem. Things appear to be improving.

[12:54pm] UPDATE: We’re still investigating the issues.

We are seeing some intermittent problems with assets - things like notecards not loading or saving, attachments not being able to load, things appearing grey for a long time after login - which we are investigating. Please refrain from making inworld transactions and rezzing no copy objects for the time being.

We will update this post when further information is available.

[RESOLVED] Billing and outworld support not available

Sunday, February 22nd, 2009

[Resolved 11:27am PST] Everybody is fine and back to work.

Due to a fire alarm in one of our worksites, the billing and outworld tech support is not available at the moment. We will let you know when they’re safely back at their desks.

[RESOLVED] Inventory Server Rotation

Saturday, February 21st, 2009

[RESOLVED at 4:00AM Pacific] Maintenance is complete!

[UPDATE at 3:00AM Pacific] Scheduled inventory maintenance is now underway.

As part of scheduled maintenance, we will be rotating a cluster of agent databases on Saturday, February 21, at 3:00AM PST.

For a small group of our Residents that will cause inability to log in, or if they are already inworld, they will be logged out.  We do not expect this to take long - no more than 30 minutes altogether.

If we have any changes to the schedule, we will update this blog.

[RESOLVED] Inworld Issues

Saturday, February 21st, 2009

[RESOLVED 2:55AM Pacific] This issue has been resolved. If you continue to have problems, please try clearing Second Life’s cache and relog.

Technicians are currently investigating an issue which may interfere with inworld functionality.
Search and teleports may be slow. Please refrain from making inworld transactions and rezzing
no copy objects for the time being. Please monitor this post for updates and further information.

New groups not showing in search

Friday, February 20th, 2009

[5:00pm PST] A recent search update introduced a small bug on approximately 2/17/2009, that resulted in the omission of indexing newly created groups.  Searching for groups created in the past three days will result in zero results.

This was discovered and fixed promptly. A new index is being created now but will not be completed until 10:00pm PST. At that time all group search results should be up to date.

[COMPLETED] Server Maintenance (minor)

Friday, February 20th, 2009

[Completed 4:00pm PST] The maintenance has completed successfully. Please contact support if you believe an affected region has not returned to normal.

At 3:30pm PST, approximately 100 regions in our Phoenix datacenter will be restarted due to priority maintenance in one of our server racks. The regions will be shutdown, then restarted on another server on the Second Life Grid. Each region should be affected for no more than 5 - 10 minutes.

We will update this blog once the maintenance has completed.

[Completed] Rolling Restarts: Thursday 8PM - Friday 10AM

Friday, February 20th, 2009

[Completed 11:10am PST] The Wednesday rolling restarts have completed. Please watch this blog for updates and information on the next batch, which will commence on Sunday night at 8pm PST and run through Monday 10am PST.

[Update 7:53pm PST] The next batch of rolling restarts will start now and will run until 10AM.

[Update 1:55pm PST] The Region restarts are complete.

[Update 1:15pm PST] The Region restarts are still in progress, we are at about the halfway mark. Please watch this post for updates.

[Update 10:15 PST] A number of Regions are due to restart to alleviate the connection issue. Please watch this post for updates.

We are investigating reports of connection issues with a small number of regions. Residents in these regions will not be able to see or cross into neighboring regions, may experience difficulty teleporting out of the region and transactions in affected regions may fail. Please be aware of your surroundings, and if in an affected region refrain from making purchases or transactions.

[RESOLVED] Issues with land auction site

Thursday, February 19th, 2009

[RESOLVED 12:35] The issues with the Land Auction site have been resolved and the auction site is now accessible.  DUE TO TODAY’S ISSUES ALL AUCTIONS ENDING TODAY HAVE BEEN CANCELED AND WILL BE RE-LISTED LATER TODAY.

We are aware of issues with the land auction site which is preventing some users from being able to log in and to bid. We are working on this and will be looking to resolve as soon as possible.

[RESOLVED] Rolling Restarts Starting Feb 17

Tuesday, February 17th, 2009

[Update Feb 18 8:44am PST] The rolling restart is complete.  The next rolling restart will commence at 8pm tonight.  Watch posts for updates.

[Update Feb 18 7:30am PST] The rolling restart is nearing completion. This post will be updated when the restarts are complete.

[Update Feb 17 8:00pm PST] The rolling restart is commencing now. This post will be updated when the restarts are complete.

[Update Feb 17th 10am PST] The first iteration of our rolling restart marathon this morning got cancelled. The process will commence as planned tonight with a 12 hour roll from 8pm to 8am PST tomorrow morning.

This week we will be doing some major upgrades to the servers we run the grid on.  This will require a rolling restart of the entire grid, but it will go much slower than usual, so we have elected to break it up over several days.

The first rolling restart session will affect a small portion of the grid, and will take place between 8-10am PST on Tuesday, Feb 17th.

Then we will do a marathon rolling restart starting at 8pm on Tuesday, Feb 17th and running for approximately 12 hours, to 8am Wednesday morning.  We will repeat this marathon rolling restart starting 8pm Wednesday night, running until 8am Thursday morning, and likely a fourth on 8pm Thursday night for several hours as well.  We will update this blog with more details as we progress.

Regions restarted will likely come up fairly quickly, but may get restarted more than once during the week.

Please visit our forums to discuss these rolling restarts.