I came in this morning to read on Netcraft that MySpace had been knocked offline by a power outage at their datacenter. [here]

The question is now one of how did this happen. There should have been contingency planning in the extreme for this type of event, especially for operations in the Western US. Backup generators, UPS, etc. should have been in place.

It would be very interesting to sit in on a post-mortem of this event.

Technorati Tags: MySpace, Web performance

Tags: app, data, EAD, HTML, HTTP, it, LAN, Om, One, outage, performance, Technorati, web, Web Performance

Gee, I guess you don’t want my business anymore…

Technorati Tags: American Express, Web performance, outage

Tags: ARIN, business, HTTP, IE, IM, it, Om, outage, performance, pr, Technorati, web, Web Performance

Ok, looks like the GrabPERF server was unreachable from 00:36 GMT until 01:24 GMT (20:36 EST - 21:24 EST).

This is very embarassing, as I am the one who is usually calling out folks for outages.

I will be checking with my hosting team to see what the root cause was.

Excuse me while I decide what to do about the teeth marks in my butt.

UPDATE: Just heard from my hosting provider that there was a planned outage last night. Sorry folks.

Technorati Tags: GrabPERF

Tags: GrabPERF, HTTP, it, LAN, Om, One, outage, pr, server, Technorati, update

Netcraft reported that World of Warcraft was having a wee bit o’ performance hell. [here]

Guess a few wizards are going through withdrawal right now.

Looks like Joi Ito, a serious World of Warcraft fiend, might have to mount up his troops for an all out assault on this one!

PS: Looks like it just staggered to life! Watch the onhoing saga here!

Technorati Tags: Netcraft, World of Warcraft, Joi Ito, GrabPERF, Web Performance

Tags: ARIN, EAD, Google, GrabPERF, GrabPERF.org, HTML, HTTP, IE, IM, it, Om, One, outage, performance, PHP, pr, search, Technorati, trim, web, Web Performance

Two separate cuts. [here]

Ugh.

Not again.

Tags: HTML, HTTP, Om, outage

Just noticed this.

CLICK IMAGE

Anyone have troubles getting PubSub sites today?

Technorati: PubSub

IceRocket: PubSub

Tags: blog, HTTP, IM, Issues, it, media, Om, One, outage, Technorati

Wow. It’s not often you read something like this.

Oh yeah, it’s the blogosphere.

Take away quote:

The question then is: if you ran out of space and were having problems, why did you continue to take on new customers during this period? Surely a responsible business with serious capacity issues would have closed their doors to new business to assure that its current clients were taken care of.

Its called greed.

Tags: blog, business, client, current, customers, EAD, HTTP, IE, Issues, it, Om, outage, pr

For reasons that I have yet to discover, my outbound connection to the Internet appears to have been down between the times listed in the title.

As I have said before, my connection is less than “professional grade”, i.e. “don’t do this at home”.

If I find a cause, I will update.

I apologize for the incovenience.

UPDATE: Ouch.

Found a MONDO huge problem with mysqldump in MySQL 5.0.15 — it locked the tables. Totally.

I backup the database by taking a dump 4 times a day, 12 hours apart on two machines.

The Web server machine, where I was testing MySQL 5.0.15 prior to the production upgrade, is using the version mysqldump that shipped with that.

I need to read the docs and disable the table locks.

Tags: app, data, database, EAD, GrabPERF, IE, IM, Internet, IP, it, Mac, mysql, Om, outage, pr, server, testing, update, web, Web server

Last night, I upgraded the Local Network GrabPERF measurement Agent to the WWW-Curl-3.02 PERL module. I will be doing the same thing on the Gomez Agent tomorrow morning, once I bring it back up from it’s power-outage induced slumber.

Tags: GrabPERF, it, measurement, Om, outage, Perl

CLICK IMAGE

’nuff said.

UPDATE: From Technorati

10.11.2005
TypePad Service

The TypePad application is currently experiencing performance degradation. You may be experiencing application errors due to the issue with published blog content noted below. We are aware of the issue and are working hard to correct it as soon as possible; we apologize for the inconvenience.

UPDATE (1:10 pm) We have been working on correcting this and you should see the improvement currently.

At present, the stats page continues to be disabled. We expect that stats will be restored today.

Posted by Six Apart Ops at 11:15 AM

10.11.2005
TypePad Blogs

UPDATE (1:10 PM). Service has been restored to published weblogs shortly after the last update and is continuing solid.

—————

UPDATE (12:31 PM). We are currently restoring service to published weblogs. While we restore service, you may experience degraded performance. We appreciate and thank you for your patience.

—————

UPDATE (12:02 PM). One of the main servers has gone off line. We are in the process of restarting it.

We apologize for the inconvenience, and we will post an update here as soon as possible.

Posted by Six Apart Ops at 11:16 AM

Technorati: typepad, grabperf

IceRocket: typepad, grabperf

Tags: ads, app, application, blog, content, current, EAD, GrabPERF, HTTP, IE, IM, improvement, it, media, Om, One, outage, performance, pr, server, Technorati, update, web