Archive for May, 2008

Rolling Restart for Half of the Grid, Friday Morning 2008-05-16

Thursday, May 15th, 2008

We are going to perform a rolling restart of half of the grid on Friday morning. This rolling restart will not include a new server deploy.  For more information, please see this blog post on the main Second Life blog.

[Resolved] Outdated Map Data

Wednesday, May 14th, 2008

[RESOLVED May 16 @ 11:55 p.m.]  Thanks everyone for your patience, the Map of Second Life has been updated and this issue has been resolved.  - Frontier

[UPDATE 5/15 13:58] Map data was updated for half of the grid this morning. The other half will be updated with the rolling restart scheduled for tomorrow morning.

The Map is currently showing an earlier version of the Second Life grid. This is only affecting the Map - all inworld locations remain unchanged. We are aware of the issue, and the Map data is in the process of updating, which we anticipate being completed overnight.

[ALL CLEAR] Inworld Services Disrupted

Tuesday, May 13th, 2008

[ALL CLEAR 11:43 PM Pacific] Logins are open and the asset system is stabilized.  Please be patient logging in for the next few minutes.  If possible, wait for the first login to complete instead of canceling and retrying, so that you maintain your position in the login queue.

[UPDATE 10:58 PM Pacific] Logins are now Linden-only while Operations repairs the asset system. Please do not attempt valuable transactions until the ALL CLEAR is given.

[UPDATE 10:30 PM Pacific] Operations is continuing to assess the slowdown. They’re sufficiently engaged in the effort that getting more details from them at the moment would be a counterproductive distraction. We’ll ask them for more information when possible, and a follow up post when the slowdown is cleared.

There’s an issue with the asset servers which is interfering with a number of inworld services. It is being investigated, but until the issue is resolved, please refrain from making transactions or rezzing no-copy items.

Land Store is open for business again

Tuesday, May 13th, 2008

Further to the message in the previous status post, the Land Store is open again; feel free to log in.

[RESOLVED] Two Hours of Downtime at Midnight Pacific Tonight

Tuesday, May 13th, 2008

[RESOLVED 12:55 AM, 13th May] - We have completed the maintenance ahead of schedule and logins to Second Life are now back to normal and we’re open again.

[UPDATE 12:05 AM, 13th May] Logins are now restricted to employees only, and the upgrade work is underway. We’ll keep you posted!

[UPDATE 22:40 PST] The land store has anticipated the starter’s pistol and begun the scheduled update early. The land store is now offline and will remain so until 6:00AM PDT.

The Operations Team will be working with one of our hardware vendors tonight to install a patch meant to alleviate the periodic loss of functionality in our asset system, such as the one which struck earlier today.

In order to accomplish this, we must briefly close access to Second Life.

At about 11:45pm Pacific this evening, we’ll make an in world announcement and disable logins shortly thereafter. At midnight, we’ll close all remaining resident connections to the grid and begin the installation process. We’re scheduling two hours for this work to allow for thorough testing.

The Land Store and account registration will also be unavailable during the downtime.

We’re painfully aware that this is short notice; however, this upgrade is essential to increasing the reliability of the asset system.

[ALL CLEAR] LindeX and Land Transactions failing

Monday, May 12th, 2008

[ALL CLEAR] The asset system is stabilized, and logins and registration are open again. Please be patient logging in for the next few minutes as the queues process a surge of requests. If possible, ride a single login attempt all the way through the wait in order to keep your place in the queue, rather than canceling and retrying.

[UPDATE 11:59 PST] Logins are Lindens only while Operations corrects the asset system slowdown.

[UPDATE 11:43 PST] Operations has isolated the trouble, but will need some time to mitigate it. We’ll be disabling registration for a short time. We’ll keep you posted.

There are reports of LindeX and land transactions failing, please do not attempt valuable transactions while we investigate and keep an eye on this blog for further updates. In-world L$ transaction may be affected as well, so please be wary of that as well.

[Resolved] Number of asset servers offline

Monday, May 12th, 2008

[Resolved @ 4:10 AM Pacific] The all-clear has been given and issues with the asset server has been resolved. Thanks everyone for your patience and have a good morning!

[4:00 AM Pacific] No resolution to this issue just yet.

[3:00 AM Pacific] This issue is currently being looked into but remains unresolved.

[2:00 AM Pacific] Logins to Second Life are being restricted while we investigate.

[Monday 1:30 AM Pacific] A number of our asset servers have gone down and we are in the process of bringing them back online. This may take a while. In the meantime please do not rez or transfer valuable (no-copy) assets until we give the all-clear. — Frontier

[RESOLVED] Asset server problems

Sunday, May 11th, 2008

[8:42 pm pacific] Asset servers are returning to their proper operating state. The road may still be a bit bumpy for a little while, but a smooth ride will soon be returning.

[7:39 pm pacific] We are continuing to have problems with our asset server cluster. Please avoid any kind of financial transactions or attempting to rez no-copy objects.

Thank you for your continued patience and support in this matter.

[RESOLVED] Asset server problems

Sunday, May 11th, 2008

[12:39 am - RESOLVED]  Our asset problem has been rectified now.  In-world activities should no longer be affected.

[12:02 am - UPDATE] Logins are now being restored and you will now be able to return to Second Life. Please be patient if this takes a little time as there may be a number of residents trying all at once. It looks like the asset issues is slowly resolving but we’re monitoring this at present and will advise shortly. Thanks.

[11:41 am - UPDATE] Logins to Second Life are being restricted while we investigate.

[11:33 am]  We are receiving reports of our asset storage cluster failing. Symptoms you might see include failure to rez, open notecards or photos, access your inventory.

Please refrain from trying to rez or work on builds at this point in time.

We’re investigating and will get back to you with information as soon as possible.

[RESOLVED] Second Life Traffic Issues

Friday, May 9th, 2008

[6:10 p.m. Pacific] The Second Life traffic issues have been resolved. Thank you for your continued patience

We have received many reports that traffic calculations are showing incorrectly in some private regions and land parcels.  At the present time, we are working to update traffic so that it displays properly.  Updates will be posted here as more info becomes avaialble.  Thank you for your patience.