Advanced Notice of Upcoming Events affecting the Grid
Thursday, January 4th, 2007 at 2:36 PM by: Pathfinder LindenGreetings,
Maintenance issues arise, sometimes beyond our control. We’ve received some notices of such maintenance in the near future, and I want to share them with you so you all are kept in the loop. I’ll be as detailed as possible in describing what’s going to happen and how it might affect everyone in Second Life.
January 6 (4-4:30am PST)
Many of the servers that host regions in Second Life are hosted at a colocation facility in Texas. Engineers at this colocation facility will be working on router software upgrades during this 30 minute time period. At some point during these 30 minutes (we don’t know exactly when), our network connection will go out for a period of 2-3 minutes. Unfortunately, this will cause all of the regions in Second Life that are hosted in Dallas to disconnect. This may or may not require us to close down the entire Grid for a short period during this time interval, and we’ll keep everyone informed in a new blog post if anything comes up during that time.
January 5 (12:01am-2:00am PST) and January 15 (12:01am-6:00am PST)
Our network provider will be performing some upgrades during these time periods. This will have the temporary effect of “router reconvergence” and “sub-optimal routing,” which basically means there may be a temporary increase in lag spikes and other transient connectivity issues. We don’t expect this will cause the Grid to go down, but if anything serious happens we will keep everyone informed of the details on a new blog post.
Please know that we are absolutely working to introduce more redundancy to the Grid and our network connectivity so that we don’t have single point failures in the future. This is our ultimate goal, and we’re actively working on it as quickly as possible. Thank you in advance for patience, and we’ll continue to keep you informed in as much detail as possible.
Take care,
-Pathfinder Linden
January 4th, 2007 at 2:44 PM
Thanks for the heads up!
January 4th, 2007 at 2:50 PM
Thought I would get in first before the lot who complain all the time. LOL
Thanks for the update and not easy running a network with this rate of growth and complexity. Praise to you all. Lets make SL rock.
January 4th, 2007 at 3:03 PM
Thanks for keeping us in the loop with specifics. This is very critical and it’s what we all look for when we come to this blog. Detailed, factual, and useful. Thanks again.
January 4th, 2007 at 3:05 PM
All I can say is thanks for letting us know
January 4th, 2007 at 3:26 PM
Thank you for the notice. I appreciate it. Good luck.
January 4th, 2007 at 3:27 PM
“All i can is thanks for letting us know”
Its a minimum *run fast*
*=^.^=*
January 4th, 2007 at 3:29 PM
Thanks for the headsup Pathfinder. It helps being able to plan around known downtimes.
January 4th, 2007 at 3:33 PM
This is good News Indeed
I am sure many can Suffice the short time fer some New software..
New software that will Hopefully Contain less glitches :D.. Keep up da good work Linden liasons da Housecat us happy things have been planned ta get better =^_^=
January 4th, 2007 at 3:33 PM
Thanks for giving us the early info - it is much appreciated guys!
January 4th, 2007 at 3:50 PM
Thanks for the early warning system. Now all we need is a tornado siren and a grid-wide PA system, then we can quickly alert everyone of the imminent lag storms. xD
Yes, I had fun typing that last one, but seriously, thanks for the heads up. Now if the grid dies, the people who actually read the blog will sit there, laughing, while everyone else tries to figure out what’s wrong.
As for all of the techno-jargon that some of you may be scratching your head over, I think I can sum it up: You get more stable connections, and in the future you’ll get less unplanned grid downtime.
To reduce my block of text to one word: Yay!
January 4th, 2007 at 3:57 PM
Thank you Lindens for the advance warnings. It is greatly appreciated.
January 4th, 2007 at 3:58 PM
Excellent! It’s nice to get the warning ahead of time so I may plan around it better, thank you! =)
January 4th, 2007 at 4:11 PM
Thank you, Linden Labs, hopefully this will help to improve the SL experience. I appreciate it!! Now if only you can plan a grid down-time that would have the end results of reducing the phenominal lag we have been suffering lately!
January 4th, 2007 at 4:20 PM
This sort of advanced warning is always good. Now if someone whinges that the grid went down, at least you can say you gave advance warning. Congratulations.
January 4th, 2007 at 4:22 PM
I can imagine the grid wide pa siren thing. “This is a test of the secondlife emergency alert system. This is only a test. *annoying two toned attention signal lasting for 60 seconds* This is a test of the second life emergency alert system. This is a test of the Emergency Broadcast . The broadcasters of your area in voluntary cooperation with Linden Labs and other authorities have developed this system to keep you informed in the event of an emergency. Had this been an actual emergency, the attention signal you just heard would have been followed by news, information, or instructions. This concludes this test of the secondlife emergency alert sytem”
Now if someone would actually build something like that, I’d be impressed.
January 4th, 2007 at 4:26 PM
Next best thing to a perfict glitch free system is advanced warning.
Now if we can get advanced warnings on gray goo attacks… Now someone find a way to post notices into the past please? Not everything is forseeable
January 4th, 2007 at 4:26 PM
Okay, now for some obligatory off topic whining…..
/me rambles insessantly about how slow the grid is, inserting colorful metaphors randomly.
/me complains something about griefers on the grid and somehow ties it in with unverified accounts even though it’s totally baseless.
/me nitpicks about account specific problems; though about 75% of the problems can be solved with a phone call.
(insert your preferred cheese that goes well with whine here)
/me complains about things on the Linden Answers forum in which the answers could be found on the Knowledge Base.
…and now, in closing, I still would like to thank Pathfinder for the heads up anyways. I’d much rather have advanced notice than none at all.
I hope I brought an ironic smile to someone’s face.
January 4th, 2007 at 4:35 PM
Giving advanced notice: Excellent.
Offering technical explanations: Excellent.
Ultimate Goal: *does happy dance*
January 4th, 2007 at 4:38 PM
Thank-you Linden Labs for keeping the SL experience going. Good Luck on the upgrades.
January 4th, 2007 at 4:40 PM
Yay, two grids operational
January 4th, 2007 at 4:53 PM
Everyone take pictures of the grid during this 2-3 minutes so we see all the red squares (red squares of dewm! :D) on the map. It might be the largest non-griefer induced partial grid shutdown in SL history! (Or maybe it isnt, I dunno)
Well, thanks for the notice. I’ll go ahead and plan +/- 1 hour just in case there is a problem.
Good luck guys!
Alpha Zaius
January 4th, 2007 at 4:53 PM
An informed inconvenience is MUCH MO’ BETTER than being left in the dark wondering if it is something I did. I expect SL to be woogie during the “mad dash to login” which leads to “everything is not perfect right now damnit” posts… Update days are always scary but we can brace for that…
Now you complete the spell by informing us WHEN there MIGHT be other problems? Are you trying to stop the WHINERS? If so - Good Go!
January 4th, 2007 at 4:54 PM
Since such things are unavoidable, and can be a real pain when unexpected, thanks for the heads up.
January 4th, 2007 at 5:02 PM
Thank you for so much heads up. It’s nice to have such an advanced warning this time instead of “Closing in 1 minute”. This is a step in the right direction for pleasing your customers. Kudos.
January 4th, 2007 at 5:16 PM
Thanks for the early warning and technical information
that comes in quite handy, really and is much approved, especially a more technical way of information.
January 4th, 2007 at 5:25 PM
Thanks for the info and advance notice!
January 4th, 2007 at 5:29 PM
This is good information. Thanks Pathfinder.
January 4th, 2007 at 5:29 PM
w0rd to the advance notice. thanks for rocking the network upgrades and the advance notice!
-Rob
January 4th, 2007 at 5:38 PM
I agree, it is nice to know these things ahead of time. I still have a question though…. don’t we have a choice where our region is hosted? I barely found out the other day that mine is Texas, and was told of all the trouble they have been having there… don’t you have Class 5 machines in S.F.?
I don’t know much about the technical side of your infrastructure, if this knowledge is publicly available, can you point me in the right direction so that I can learn about it?
January 4th, 2007 at 5:50 PM
@Jesse Murdock
“I agree, it is nice to know these things ahead of time. I still have a question though…. don’t we have a choice where our region is hosted? I barely found out the other day that mine is Texas, and was told of all the trouble they have been having there… don’t you have Class 5 machines in S.F.?
I don’t know much about the technical side of your infrastructure, if this knowledge is publicly available, can you point me in the right direction so that I can learn about it?”
We host regions wherever we have server resources, which might be in Texas or might be in SF, depending on how our facilities are configured at any given time. We’re working towards more redundancy no matter where a region physically “lives” in RL, so ultimately it shouldn’t matter.
As for the question about the technical side of our infrastructure, I’ll see if someone from our ops group can make a blog post about this in the near future. Thanks for the idea.
January 4th, 2007 at 6:16 PM
Thanks for the heads-up! Hopefully the new software will make it a little easier for second life residents!
January 4th, 2007 at 6:19 PM
Thanks for the info.
January 4th, 2007 at 6:22 PM
That’s whassup. Keep up the good work.
January 4th, 2007 at 6:25 PM
Good that this is being done at time of minimum demand (at least in Western Hemisphere), rather than relatively prime time.
January 4th, 2007 at 6:56 PM
Isn’t there a planned Jan 10th software upgrade? Or am I losing it?
Kudos on all the stuff others said earlier
OS
January 4th, 2007 at 6:58 PM
It’s hard for me to understand how, given the extremely excessive amount of time I spend reading about SL, I could possibly have missed hearing about sims beings hosted anywhere other than SF, or even backed up anywhere else. I did however manage this annoying feat.
Any way to get a list of which sims are hosted where so you can go see if there is any performance difference?
January 4th, 2007 at 7:25 PM
Pathfinder, Once again Thank you for the advanced notice, and thorough explanation of what’s going on. I think by the general Good response you seem to be getting from these announcements, you have hit on an Excellent Policy for customer relations. PLEASE keep it up.
Angel.
January 4th, 2007 at 7:47 PM
Thanks for the heads-up.
January 4th, 2007 at 7:49 PM
Lindens. Help prevent nooblag and sim crashes by banning crashers from the sims for good.
January 4th, 2007 at 8:07 PM
@Oceanna Shannon
“Isn’t there a planned Jan 10th software upgrade? Or am I losing it?
Kudos on all the stuff others said earlier :)”
You’re not losing it. I’m going to blog about that tomorrow morning.
January 4th, 2007 at 8:09 PM
@Sue Baskerville
“It’s hard for me to understand how, given the extremely excessive amount of time I spend reading about SL, I could possibly have missed hearing about sims beings hosted anywhere other than SF, or even backed up anywhere else. I did however manage this annoying feat.
Any way to get a list of which sims are hosted where so you can go see if there is any performance difference?”
I don’t know. But I’ll ask our ops group and see if information like that is possible to share in some way. Thanks for the idea.
January 4th, 2007 at 8:30 PM
Advance notice, partial outage for a short time over a small window, sufficient technical detail to understand, w/o loosing the non CCIEs in the audience - Excellent, thanks!
January 4th, 2007 at 8:41 PM
Thanks for posting this. More of this kind of communication = good.
This part:
“Please know that we are absolutely working to introduce more redundancy to the Grid and our network connectivity so that we don’t have single point failures in the future. This is our ultimate goal, and we’re actively working on it as quickly as possible”
made me feel all warm-and-tingly.
January 4th, 2007 at 8:58 PM
Delightful to know scheduled downtime/grid affecting maintenance ahead of time. This way, if the whiners start crying about this stuff you can tell them to, in the idiom of some of my friends from the UK, piss off. *grin*
I really don’t think the whiners understood how valuable the position of comms monkey was going to be when they bitched about LL doing that instead of working on the grid, not that they had a clue, this was in addition to working on the grid, not instead of. And now, the thoughtfulness has paid off in a good concise flow of information to make our SL experience better because we know what’s going on now.
January 4th, 2007 at 9:31 PM
“This is the Second Life emergency broadcast system, all citizens should head to the nearest underground virtual shelter……………………..”
Hmm do we have virtual bomb/fallout shelters, what if there’s a real nuclear war are our servers & AV’s safe even if we aren’t ?
Cool for the warnings, many will now know not to start a 4 hour build job 3.5 hours before sutdown without saving
January 4th, 2007 at 10:03 PM
Not that I’m rushing an update…god forbid, but … since the grid’s going to be partially unstable over the weekend, why not take advantage of it and roll out the new crop of bugs ……………………………………………. fixes. *grin*
January 4th, 2007 at 10:07 PM
Yes, i noticed the lag spikes, and this explains it lol. Ty for telling us!
January 4th, 2007 at 10:45 PM
Although the SL community is becoming more and more global, there are daily cyclical fluctuations in server workload (I assume every SL participant has noticed this). Moreover, I assume there are also weekly cyclical fluctuations (apart from holiday effects).
I hope that the maintenance experts do their invaluable work in those hours of the day and days of the week that most of the SL people are not logged in.
Thanks for the advance warning! that is very important information - keep them coming!
Therefore I’d like to see a graph of the (mean) number of people logged on to their SL account during the week. This would help in the same way as an advance maintenance or update warning : people who have limited time could plan their SL visit better …
Thank you for your attention.
January 4th, 2007 at 11:08 PM
It is much more reasuring to hear of a potential problem before it arises, than to just suddenly get an unexpected grid failure. TY
January 4th, 2007 at 11:12 PM
Stop squashing my post.
Linden Labs likes to do its major SL upgrades 7:00 AM- Noon PST/SLT which is a terrible time for folks in the UK/EU. It ruins their evenings, and anyone else who has friends in the UK/EU.
LL should take a lesson from the maintenance above which finishes well before 12 Noon PST/SLT in the early morning hours.
Lindens Labs should take lesson and do their major upgrade so that it finishes WELL BEFORE Noon PST so that is has less impact on people in the US (East and West Coast) and UK.
January 4th, 2007 at 11:28 PM
Thank forthe Heads Up,Nice to know in advance Keep up the good work
January 4th, 2007 at 11:29 PM
“Linden Labs likes to do its major SL upgrades 7:00 AM- Noon PST/SLT which is a terrible time for folks in the UK/EU. It ruins their evenings, and anyone else who has friends in the UK/EU.
LL should take a lesson from the maintenance above which finishes well before 12 Noon PST/SLT in the early morning hours.
Lindens Labs should take lesson and do their major upgrade so that it finishes WELL BEFORE Noon PST so that is has less impact on people in the US (East and West Coast) and UK.”
And less impact on Alaskans, Australians and Singapore people too
Perhaps because they are always going to affect someone in the worlds favorite time, then you will probably find it is because it is when they have maximum staff coverage incase something goes wrong. Which is goosd in a way because management might actually notice what’s happening and believe what their people are trying to tell them if it doesn’t occur at 3am.
January 5th, 2007 at 12:11 AM
Great post, thanks for the advance notice! I really must say that communication has improved vastly since I joined nearly a year ago.
And about maintenance times: it doesn’t make sense discussing specific times of day in a world wide network. LL does the only sensible thing and does all possible work during their normal office hours. And all other maintenance times are dependant on the colocation facilities, so out of LL hands anyway.
Keep up the great work and keep the information coming
Zi!
January 5th, 2007 at 12:25 AM
Some more reaction from Europe…
I think, for people with less understanding of technical issues, everyone should be aware of the fact that Pathfinder not only notices us of planned downtime. One of the future things he ’sees’ is making the grid more redundant. The redundancy thingy makes it possible to make downtime of servers possible WITHOUT downtime or log for the grid itself. That way, it doesnt even matter wether the servers are hosted in SF, Texas, Alaska, Antarctica or the Netherlands.
As someone else stated: Yay, two grids.. in fact: that is what redundancy stands for ..
Keep up the good work, Lindens. You have made an impressive piece of work, massive in size, still growing and all of you deserve maximum respect. Hopefully you manage to improve even more to facilitate the ‘whiners’
January 5th, 2007 at 12:39 AM
WHAT … A WHLOE 30 MINZ WITH NO SECONDLIFE ??? … OMGZ WHAT THE HELL WILL WE DO ? ….
good luck guys ..and thanks for thinking about the little guys
January 5th, 2007 at 12:42 AM
I love seeing this level of transparency. Thanks for the heads-up! =)
** RE: The 7am-12pm PST/SLT upgrade window:
LL is based in San Francisco, and this window (for them) falls right at the start of the normal workday. That way, if/when something goes wrong, they’re able to take care of it during the normal workday. I think it’s safe to assume that the Lindens have lives (first, second, or otherwise) beyond work, so I don’t think it’s unreasonable for them to try to get things done under more-or-less normal working hours. Besides, no matter when they schedule their downtime, it will /always/ be inconvenient for somebody.
** RE: Demands for more warning for, and complaints about, unplanned downtime:
One thing that everyone needs to understand is that sometimes conditions require an /immediate/ EMERGENCY shutdown of the system, which is true anywhere. We saw an example of this just recently with the (rather catastrophic) hardware failure incident. Any delay could have lead to vast amounts of data being lost or corrupted. Here’s a non-computing parallel: Suppose you’re driving down the highway in the middle of nowhere, and your car catches on fire. Do you keep going until you reach someplace convenient, or do you pull over RIGHT NOW and get out of the burning car?
While life and limb may not be at stake in SL, a whole lot of data is. YOUR data, at that. Advance warning is great, but in some (thankfully rare) situations that luxury just isn’t an option. In those cases, the next best thing is an immediate and thorough explanation as to just what’s going on. LL has made great strides recently when it comes to keeping us informed, and I hope they continue in that direction. =)
The more technobabble, the better. I just hope it doesn’t get to this level: http://video.google.com/videoplay?docid=5125780462773187994
hehehe…. Take care!
- SDW ^..^
January 5th, 2007 at 1:55 AM
Thanks for letting us know, another great post Pathfinder, you are really keeping us informed ^_^
Incidentally if you do become aware of issues in time, would it be possible to give a heads-up in-world? When we’re actually in SL we’re not checking the blog
“Maintenance taking place in the next half hour, grid may go down unexpectedly, do not work on anything unreproduceable” would be a HUGE help to everyone who may not have seen this blog or has forgotten.
January 5th, 2007 at 2:48 AM
Thanks for the heads up.
You know, it won’t be long that LL will need a Super-Wallmart size building full of servers and networking routers. It was just this past summer the grid started seeing 10,000 users online and that was when the packet-loss and lag began to go up. Now the grid regularly sees 20,000 users during prime-time hours. I’ll bet most of the growth is from new basic free accounts. It seems Linden Labs needs to slow down user growth so it will not exceed the rate at which the hardware can grow.
20,000 users, amazing. That could be the population of a decent size town and everyone using the phone at once. I don’t know of any other online 3D game/simulation with that many users on at the same time. Even with all of it’s problems, Second Life is an amazing service.
January 5th, 2007 at 4:32 AM
Thank you for the warning! you are right, grid for some in texas/oklahoma has cause grid to not load as if its in downtime. Unlucky me! I want my SL!!! Slowly goes into SL withdrawal symptoms as keep trying to load SL*
January 5th, 2007 at 4:44 AM
SDW, it doesn’t matter that Linden Lab is based in California; they provide a 24 hour service and as such, should provide 24 hour coverage through maintenance and support. Given that almost 50% of the playerbase is from outside of the US, Linden Lab really needs to consider much more flexibility and pick times to do things that don’t always screw Europe.
Broccoli
January 5th, 2007 at 5:44 AM
Thanks for the notice. However, as Sue Baskerville said, it would be most helpful if a list of sims that will be affected could be provided (IF, of course, this is practical). Also, please continue working towards solving the time dilation and packet loss issues that occur at times of 20,000+ resident concurrencies. Yesterday, the time dilation on some sims (for instance, Frontenac) was as bad as 0.13.
January 5th, 2007 at 5:46 AM
Thanks Path.. it is now 5:42 am and I am noticing problems with rezzing objects on Dreams, not being able to use the camera while in edit, pricing not sticking, etc. So, if that is related, we will ride it out!
January 5th, 2007 at 6:18 AM
Thanks Pathfinder!
As ever, you rock
January 5th, 2007 at 6:33 AM
SDW, it doesn’t matter that Linden Lab is based in California; they provide a 24 hour service and as such, should provide 24 hour coverage through maintenance and support. Given that almost 50% of the playerbase is from outside of the US, Linden Lab really needs to consider much more flexibility and pick times to do things that don’t always screw Europe
So it’s ok to screw other countries just to please europeans?
Of the remaining 50%, how many are actually in Europe, not Australia, Asia, Greenland?
The rest of us could be down all night because the resources aren’t there to recover from major problems at 10pm, when it could have been fixed in half the time on Dayshift with the people writing the new content present to bughunt.
January 5th, 2007 at 6:57 AM
I love you, Pathfinder. (*gives creepy double-eyebrow raise*)
January 5th, 2007 at 8:11 AM
Nice to have a warning…events planned can be finished up before anything goes haywire. TY!
January 5th, 2007 at 8:14 AM
Kath, I didn’t mean it should always be a certain time just to please Europeans, but some official recognition of the international nature of Second Life, by staggering maintenance times so different groups are inconvenienced each time, would be a big bonus to the many people outside of the USA.
Broccoli
January 5th, 2007 at 9:24 AM
Has something happened to the Web page of Second Life?
January 5th, 2007 at 12:40 PM
For us who are not so accustomed to the US hours it would be useful if, at the top of the blog, you would post the SL time/hours. This would ease our calculations on at what time in Europe (and probably elsewhere too) something will take place in SL.
Thank you for your work.
January 5th, 2007 at 12:41 PM
Just letting you know it’s not a scheduled time and I cant TP anywhere…
(sigh)
S T A B I L I T Y
Please, please?
Thank Youuuuuuuuuuuuuuuuuuuuuuuuu!
January 5th, 2007 at 1:25 PM
[...] enero 5, 2007 at 8:33 pm | In SecondLife, Technology & Gadgets | Agradezco éste nivel de información sobre los próximos tiempos de desconexión y posibles dificultades. En esta [...]
January 5th, 2007 at 2:11 PM
Thanks for the heads up…and for giving us a peek “behind the screens” into what’s going to keep this trailblazing virtual world humming.
January 5th, 2007 at 7:24 PM
There was a lady who posted of topic about the email verification earlier not working she is correct. It is not working properly tried to change my email address and the web site repeatedly tells me I have put it the wrong password, I even went as far as changing it through yahoo, but no go website will not allow you to change your own email address, So it seems they are both linked. The Grid and the website.
I am very happy they are working on the grid issues and if it fixes the problems we are all having fantastic dont mind at all having some downtime. BBut Pathfinder dont rush the fixes won’t kill all of us to wait for a while. I am in Australia so the problems are worse here as we have no servers in aus at all. When America is awake it is impossible to actually do any work. I wait till you guys go to bed to do my work more peaceful to tehn but it just happens to be in the middle of my night. Keep up the good work lindens very frustrating for all but what can we do but wait and be patient.
January 6th, 2007 at 2:05 AM
grid seems down a little early
January 6th, 2007 at 2:21 AM
Ok its 2:18am on the 6th weird things are happening. Created items that don’t know i created / own them! Sure you told Texas it is supposed to be Pacific time?
January 6th, 2007 at 2:22 AM
Perhaps this wasn’t PST that this was to take place cause right at 4am Central time which is where the colocation is located the grid got all screwy.
January 6th, 2007 at 2:24 AM
I think they started early rofl
January 6th, 2007 at 2:25 AM
Another thing, who works this early? >.
January 6th, 2007 at 2:40 AM
oh it started at 4am in Dallas all right. Actually, more like 4:25. AND SO GLAD THEY LIVE UP TO THEIR WORDS ON TIME FRAMES. Now its’s 4:40 and cant get in!
January 6th, 2007 at 11:02 AM
Region: Arsheba, no TP, no payment availability.
January 6th, 2007 at 11:46 AM
[...] Read‘|’Permalink‘|’Email this‘|’Linking’Blogs‘|’Comments [...]
January 8th, 2007 at 4:15 AM
[...] good to see Pathfinder Linden publishing advance notification of upcoming events affecting grid performance which will greatly assist residents in working around [...]
January 14th, 2007 at 5:24 AM
is anyone else having major teleporting problems i have a club and isle in sl and no one including myself have been allowed to teleport threre in 2 days now
January 14th, 2007 at 5:40 AM
what would be a fantastic idea is to get someone working at linden over the weekends i have had it up to the teeth in sending bug reports and especially E mails i never ever had one reply yet and i dont suppose i will i am having major problems with my sim and no one to talk to (linden) give me a job anyone would be better than no one , i had events and hosts for this weekend wich have gone out the window i cant, and no one else can get on my isle????????
January 15th, 2007 at 9:42 AM
So.. How’d todays work go?
September 20th, 2007 at 8:40 AM
hp portable ordinateur [url=http://www.computershop-fr.info/tools/1113.html]hp portable ordinateur[/url] http://www.computershop-fr.info/tools/1113.html trucco free gioco pc [url=http://www.1-assistenza-computer.info/post/trucco-free-gioco-pc]trucco free gioco pc[/url] http://www.1-assistenza-computer.info/post/trucco-free-gioco-pc hacker gunbound programa [url=http://www.1descargar-software.info/articles/1327.php]hacker gunbound programa[/url] http://www.1descargar-software.info/articles/1327.php programa descarga cancion [url=http://www.software-freeware-es.info/info/1070.asp]programa descarga cancion[/url] http://www.software-freeware-es.info/info/1070.asp software development life cycle diagram [url=http://www.123software-de.info/software-development-life-cycle-diagram]software development life cycle diagram[/url] http://www.123software-de.info/software-development-life-cycle-diagram y torrent download [url=http://www.12software-kaufen.info/today/y-torrent-download.asp]y torrent download[/url] http://www.12software-kaufen.info/today/y-torrent-download.asp free software downloads [url=http://www.12software-de.info/blog/1933.asp]free software downloads[/url] http://www.12software-de.info/blog/1933.asp wireless monitor [url=http://www.de-computer-12.info/1594]wireless monitor[/url] http://www.de-computer-12.info/1594 computer networking san antonio [url=http://www.computer-kaufen.info/1687.html]computer networking san antonio[/url] http://www.computer-kaufen.info/1687.html online degrees computer science [url=http://www.12ordenador.info/online-degrees-computer-science.asp]online degrees computer science[/url] http://www.12ordenador.info/online-degrees-computer-science.asp
September 20th, 2007 at 9:34 AM
sony pc portable vgn s5m [url=http://www.12ordinateur.info/ads/1412.asp]sony pc portable vgn s5m[/url] http://www.12ordinateur.info/ads/1412.asp firefox gratis download [url=http://www.123-handy-software.info/1749.php]firefox gratis download[/url] http://www.123-handy-software.info/1749.php pocket pc smartphone [url=http://www.computer-discount-it.info/3/pocket-pc-smartphone]pocket pc smartphone[/url] http://www.computer-discount-it.info/3/pocket-pc-smartphone download demo gioco pc [url=http://www.123computer-it.info/1453.html]download demo gioco pc[/url] http://www.123computer-it.info/1453.html mcafee firewall [url=http://www.12-antivirussoftware.info/today/1227.html]mcafee firewall[/url] http://www.12-antivirussoftware.info/today/1227.html ankauf pc monitore [url=http://www.123computer-de.info/9/ankauf-pc-monitore]ankauf pc monitore[/url] http://www.123computer-de.info/9/ankauf-pc-monitore descarga de cd de musica [url=http://www.1antivirus-software-es.info/1900.asp]descarga de cd de musica[/url] http://www.1antivirus-software-es.info/1900.asp emule telechargement musique gratuit [url=http://www.software-distribution-fr.info/article/1095.asp]emule telechargement musique gratuit[/url] http://www.software-distribution-fr.info/article/1095.asp poket pc software pocket [url=http://www.computer-portatili.info/article/poket-pc-software-pocket.asp]poket pc software pocket[/url] http://www.computer-portatili.info/article/poket-pc-software-pocket.asp telecharger logiciel de creation de jeu [url=http://www.123software-fr.info/1248.php]telecharger logiciel de creation de jeu[/url] http://www.123software-fr.info/1248.php
December 24th, 2007 at 12:24 PM
advance advance america cash
Most advance cash day in loan pay uk advance cash loan online
January 8th, 2008 at 2:31 AM
30 day payday loan
There advance advance america cash advance cash day pay
February 1st, 2008 at 12:17 PM
As mentioned klingeltöne gratis downloaden keno insurance middle arabische klingeltöne front rolled queens coup flush bet custom cell phone wallpaper exotic gross natural!
February 5th, 2008 at 7:14 AM
Dal actuellement casino on net rajoute 100 de bonus élever keno bien téléphone dénomination caraïbe casino black jack game online symboles incliner jardin supermarche casino en ligne sud cercle réuni surélever tirer au sort offre.
March 7th, 2008 at 7:49 AM
advance cash day in loan pay uk pay day cash advance advance cash day pay
In cash loan payday till advance cash line loan
May 1st, 2008 at 10:49 AM
roulette gratuitement…
Breathe blog casino online gambling blackjack…
May 2nd, 2008 at 12:55 PM
unsecured visa credit card…
Through bank card credit services us download free ringtones samsung…
May 2nd, 2008 at 1:00 PM
cheap loan long payday term…
Let’’s start with download free new ringtones fast cash advance payday loan…
May 3rd, 2008 at 3:44 AM
application canadian card credit visa…
Three jeux des casino application canadian card credit visa…
May 4th, 2008 at 3:54 AM
roulette casino game online roulette game roulette game…
It seems account card credit sears online gewinnen…
May 29th, 2008 at 3:14 AM
giocare a black jack…
There is on line casino casino bonus senza deposito casino online sicuri casino on line gambling gioco roulette per pc…
July 11th, 2008 at 8:29 AM
juhy bgrf cxwa\lokm gybzw aput
juhy bgrf cxwa\lokm gybzw aput