Normally when I discuss the performance of a page I am measuring using GrabPERF, it’s either good news (”you just got 5 times faster!”) or bad news (”your page hasn’t loaded in 6 months; you still there?”).

Today, something a little different: a question. What’s the question?

Why is the performance of a Technorati Blog (aka Traditional) Search so different from a Technorati Tag Search?

For those of you who have been around for a while, you know that Technorati allows you to search for results based on a Traditional search engine methodology, which is date-ranked, most recent first. It also provides a way to search through the user-defined tags that are appended to posts, or listed as category titles.

The issue that I have been seeing from my measurements is that Tag Searching is performance substantially worse than Traditional Search.

TRADITIONAL SEARCH

---

TAG SEARCH

What I need to understand from the Technorati team is the particular technical challenges that differentiate Traditional v. Tag Searching, because the difference in performance is astonishing.

And then there is the success rate of the Tag Search.

TECHNORATI TAG SEARCH SUCCESS RATE

When I examine the data, almost all of the errors on the Tag Search measurement are Operation Timeouts. I have set the GrabPERF Agent to time out when no response has come back for the server in 60 seconds. So, effectively 15% of the Tag Searches do not return data to the client in 60 seconds.

So, while the Traditional Search has been tuned and optimized, there appears to be much work left to make the Tag Search an effective and useful tool.

Technorati: technorati, search, tagging, seo

IceRocket: technorati, search, tagging, seo

Tags: app, ARIN, blog, Challenges, client, data, GrabPERF, GrabPERF.org, HTTP, IE, IM, it, measurement, media, normal, Om, optimize, performance, posts, pr, search, seo, server, Technorati

The weekly GrabPERF Search Index Results are in.

NOTES:

• Level3/Cogent Peering Dispute affected all results this week

Week of October 04-10, 2005

TEST                                 RESULT  SUCCESS  ATTEMPTS
--------------------------------  ---------  -------  --------
PubSub - Search                   0.4032768    99.86      6644
Google - Search                   0.5196460   100.00      6735
Yahoo - Search                    0.6926705   100.00      6694
MSN - Search                      0.7543688   100.00      6722
Google Blogsearch (ATOM)- Search  0.8480318    99.82      6725
Google Blogsearch - Search        0.8880010    99.84      6731
eBay - Search                     0.9723281   100.00      6736
Newsgator - Search                0.9935382    99.61      6685
BestBuy.com - Search              1.2988528    99.94      6721
Findory - Search                  1.3819290    99.93      6693
Technorati - Search               1.4609834    99.88      6671
Amazon - Search                   1.6579611    98.94      1799
BENCHMARK RESULTS                 1.7649221    99.56    108774
Feedster - Search                 2.4226014    99.73      6671
IceRocket - Search                2.6644861    99.51      6698
Blogdigger - Search               2.7916678    99.14      6378
BlogLines - Search                3.5648172    96.84      6735
Blogpulse - Search                6.6344053    98.96      6736

These results are based on data gathered from two remote measurement locations in North America. Each location takes a measurement approximately once every five minutes.

The measurements are for the base HTML document only. No images or referenced files are included.

Technorati: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

IceRocket: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

Tags: app, blog, data, digg, feeds, Google, GrabPERF, GrabPERF.org, HTML, HTTP, IM, ISP, it, measurement, North America, Om, performance, performance measurement, pr, search, seo, Technorati, web, Web Performance, Web performance measurement, Web+performance

The weekly GrabPERF Search Index Results are in.

NOTES:

• Findory blog search added to index
• Google standard search takes top spot with 100% availability

Week of September 26 - October 03, 2005

TEST                                 RESULT  SUCCESS  ATTEMPTS
--------------------------------  ---------  -------  --------
Google - Search                   0.2477162   100.00      7062
PubSub - Search                   0.2538995    99.80      7043
Google Blogsearch (ATOM)- Search  0.5839898    99.90      7064
MSN - Search                      0.6146201    99.99      7063
Yahoo - Search                    0.6154676    99.99      7060
Google Blogsearch - Search        0.6547768    99.92      7064
eBay - Search                     0.6940026   100.00      7058
BestBuy.com - Search              1.0745931    99.91      7056
Technorati - Search               1.1970990    99.92      7062
Findory - Search                  1.2055845    99.91      6725
Amazon - Search                   1.2378869    99.33      1803
Feedster - Search                 1.2583286    99.92      7061
BENCHMARK RESULTS                 1.4132893    99.73    114382
Newsgator - Search                1.5429696    99.29      7062
Blogdigger - Search               1.7054253    99.99      7058
BlogLines - Search                1.7401694    98.99      7061
IceRocket - Search                3.7427026    98.57      7012
Blogpulse - Search                5.5294509    99.72      7062

These results are based on data gathered from two remote measurement locations in North America. Each location takes a measurement approximately once every five minutes.

The measurements are for the base HTML document only. No images or referenced files are included.

Technorati: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

IceRocket: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

Tags: app, blog, data, digg, feeds, Google, GrabPERF, GrabPERF.org, HTML, HTTP, IM, it, measurement, North America, Om, performance, performance measurement, pr, search, seo, Technorati, web, Web Performance, Web performance measurement, Web+performance

The weekly GrabPERF Search Index Results are in.

Week of September 19-25, 2005

TEST                                 RESULT  SUCCESS  ATTEMPTS
--------------------------------  ---------  -------  --------
PubSub - Search                   0.1641161    99.82      7037
Google - Search                   0.2469639   100.00      7037
Google Blogsearch (ATOM)- Search  0.5754907    99.89      6201
Google Blogsearch - Search        0.5844869    99.67      7037
MSN - Search                      0.6129932    99.99      7036
Yahoo - Search                    0.6375895    99.94      7031
eBay - Search                     0.6750205   100.00      7036
Amazon - Search                   1.0858985    99.95      1832
Technorati - Search               1.1052304    99.89      7036
BestBuy.com - Search              1.3558370    99.52      7036
Newsgator - Search                1.5025822    99.97      7037
Feedster - Search                 1.5255779    99.52      7036
BENCHMARK RESULTS                 1.5572177    99.66    106498
Blogdigger - Search               1.7119017    99.94      7016
BlogLines - Search                2.6147261    97.24      7036
IceRocket - Search                3.4088173    99.86      7018
Blogpulse - Search                6.6481991    99.55      7036

These results are based on data gathered from two remote measurement locations in North America. Each location takes a measurement approximately once every five minutes.

The measurements are for the base HTML document only. No images or referenced files are included.

Technorati: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

IceRocket: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

Tags: app, blog, data, digg, feeds, Google, GrabPERF, GrabPERF.org, HTML, HTTP, IM, it, measurement, North America, Om, performance, performance measurement, pr, search, seo, Technorati, web, Web Performance, Web performance measurement, Web+performance

The weekly GrabPERF Search Index Results are in.

This Week’s Notes

1. ERTW.com Agent location taken offline
2. Addition of Google Blogsearch to the Index
3. Numerous performance improvements to the GrabPERF interface

Week of September 12-18, 2005

TEST                           RESULT  SUCCESS  ATTEMPTS
--------------------------  ---------  -------  --------
PubSub - Search             0.2688096    99.82      6532
Google - Search             0.4013164    99.97      6532
Google Blogsearch - Search  0.5818507    98.60      4214
MSN - Search                0.6981630    99.83      6532
Yahoo - Search              0.7159974    99.95      6527
eBay - Search               0.8345692   100.00      6528
BlogLines - Search          1.0204595    99.95      6531
BestBuy.com - Search        1.1687228    99.97      6530
Feedster - Search           1.3112797    99.82      6531
Technorati - Search         1.3240335    99.95      6528
Amazon - Search             1.5195445    99.72      2481
Newsgator - Search          1.5823492    99.72      6529
Blogdigger - Search         1.7142475    99.97      6506
BENCHMARK RESULTS           2.0313721    99.50     76849
IceRocket - Search          4.2792600    98.79      6515
Blogpulse - Search          6.5226776    99.29      6522

These results are based on data gathered from two remote measurement locations in North America. Each location takes a measurement approximately once every five minutes.

The measurements are for the base HTML document only. No images or referenced files are included.

Technorati: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

IceRocket: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

Tags: app, blog, data, digg, feeds, Google, GrabPERF, GrabPERF.org, HTML, HTTP, IM, improvement, it, measurement, North America, Om, performance, performance improvement, performance measurement, pr, search, seo, Technorati, web, Web Performance, Web performance measurement, Web+performance

The weekly GrabPERF Search Index Results are in.

Week of September 4-11, 2005

TEST                     RESULT  SUCCESS  ATTEMPTS
--------------------  ---------  -------  --------
PubSub - Search       0.5421396    99.72      5680
Google - Search       0.5741554   100.00      5681
Yahoo - Search        0.8028792    99.95      5678
eBay - Search         0.9255761   100.00      5681
Feedster - Search     1.2524916    99.86      5679
MSN - Search          1.2737601    98.40      5681
BestBuy.com - Search  1.3964269    99.91      5680
Technorati - Search   1.4128937    99.98      5681
BlogLines - Search    1.6020669    99.16      5681
Amazon - Search       1.9909649    99.74      3108
BENCHMARK RESULTS     2.0313721    99.50     76849
Blogdigger - Search   2.3336642    98.53      5577
Newsgator - Search    2.5181818    99.68      5681
IceRocket - Search    4.3043685    99.77      5680
Blogpulse - Search    7.4959768    98.40      5681

These results are based on data gathered from three remote measurement locations in North America. Each location takes a measurement approximately once every five minutes.

The measurements are for the base HTML document only. No images or referenced files are included.

Technorati: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

IceRocket: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

Tags: app, blog, data, digg, feeds, Google, GrabPERF, GrabPERF.org, HTML, HTTP, IM, it, measurement, North America, Om, performance, performance measurement, pr, search, seo, Technorati, web, Web Performance, Web performance measurement, Web+performance

The weekly GrabPERF Search Index Results are in. Sorry for the delay.

Week of August 29, 2005 - September 4, 2005

TEST                     RESULT  SUCCESS  ATTEMPTS
--------------------  ---------  -------  --------
PubSub - Search       0.4132426    99.95      5561
Google - Search       0.5546451   100.00      5570
MSN - Search          0.7807107    99.87      5572
Yahoo - Search        0.7996602    99.98      5571
eBay - Search         0.9371296   100.00      5571
Feedster - Search     1.1738754    99.96      5569
Newsgator - Search    1.2168921    99.96      5569
BlogLines - Search    1.2857559    99.71      5571
BestBuy.com - Search  1.4136253    99.98      5572
Blogdigger - Search   1.8896126    99.74      5462
BENCHMARK RESULTS     1.9096960    99.79     75419
Amazon - Search       1.9795655    99.84      3123
Technorati - Search   2.7727073    99.60      5566
IceRocket - Search    5.0256308    99.43      5571
Blogpulse - Search    6.5206247    98.98      5571

These results are based on data gathered from three remote measurement locations in North America. Each location takes a measurement approximately once every five minutes.

The measurements are for the base HTML document only. No images or referenced files are included.

Technorati: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

IceRocket: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

Tags: app, blog, data, digg, feeds, Google, GrabPERF, GrabPERF.org, HTML, HTTP, IM, it, measurement, North America, Om, performance, performance measurement, pr, search, seo, Technorati, web, Web Performance, Web performance measurement, Web+performance

Dave Sifry released a state of the search post yesterday. Between re-building my laptop and getting a client project out, I missed the original post.[here]

Thanks Dave! And continued success.

Technorati: Technorati, Web Performance, Capacity Planning, Web 2.0, SEO, traffic analysis

IceRocket: Technorati, Web Performance, Capacity Planning, Web 2.0, SEO, traffic analysis

Tags: analysis, blog, client, GrabPERF, HTML, HTTP, IE, IM, improvement, it, LAN, Om, performance, pr, search, seo, Technorati, the Origin, traffic, web, web 2.0, Web Performance, Web+performance

The first weekly GrabPERF Search Index Results are in.

Week of August 22, 2005 - August 28, 2005

TEST                     RESULT  SUCCESS  ATTEMPTS
--------------------  ---------  -------  --------
Google - Search       0.4394034    99.99      8639
PubSub - Search       0.4935380    99.95      8323
MSN - Search          0.7689598    99.87      8641
Yahoo - Search        0.7798988    99.98      8640
Newsgator - Search    0.9057921    99.95      8640
eBay - Search         0.9452582   100.00      8640
BestBuy.com - Search  1.3353797    99.99      8641
BlogLines - Search    1.5031604    99.76      8629
Amazon - Search       1.9376345    99.75      4854
Feedster - Search     1.9999550    98.72      8624
Technorati - Search   2.0764670    99.66      8636
BENCHMARK RESULTS     2.3325742    99.15    116663
Blogdigger - Search   3.2704594    98.01      8478
IceRocket - Search    6.4609440    99.25      8637
Blogpulse - Search    9.5151287    93.53      8641

These results are based on data gathered from three remote measurement locations in North America. Each location takes a measurement approximately once every five minutes.

The measurements are for the base HTML document only. No images or referenced files are included.

Technorati: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

IceRocket: GrabPERF, Web Performance, Web Performance Measurement, Web Performance Monitoring, search index, SEO

Tags: app, blog, data, digg, feeds, Google, GrabPERF, GrabPERF.org, HTML, HTTP, IM, it, measurement, North America, Om, performance, performance measurement, pr, search, seo, Technorati, web, Web Performance, Web performance measurement, Web+performance

Ping-O-Matic. Weblogs.com.

Two of the sites that have seen surges in Web traffic recently.

My unsubstantiated theory is that as summer ends, Web traffic is seeing its usual surge, amplified by the new interest in blogs and Web 2.0 properties.

For the small companies who have effectively had the summer off, it’s time to re-adjust your capacity-planning estimates…upward.

Why? Rising oil prices will reduce travel. Disenchantment with movies will reduce going out. Gourmet take-home will reduce restaurant visitation. And increasing broadband access will increase demand for online services.

Be afraid…and get ready for more traffic. Lots more traffic.

Have you optimized your site for maximum performance yet?

Technorati: Web Performance, Capacity Planning, Web 2.0, SEO, traffic analysis

IceRocket: Web Performance, Capacity Planning, Web 2.0, SEO, traffic analysis

Tags: analysis, blog, broadband, EAD, HTTP, IE, IM, it, LAN, Om, online, optimize, performance, pr, seo, Technorati, traffic, web, web 2.0, Web Performance, Web+performance