Posts Tagged ‘server’

Performance Improvement From Caching and Compression

October 3rd, 2006 by smp | Comments | Filed in Web Performance, WebPerformance.Org

This paper is an extension of the work done for another article that highlighted the performance benefits of retrieving uncompressed and compressed objects directly from the origin server. I wanted to add a proxy server into the stream and determine if proxy servers helped improve the performance of object downloads, and by how much.

Using the same series of objects in the original compression article[1], the CURL tests were re-run 3 times:

 

  1. Directly from the origin server
  2. Through the proxy server, to load the files into cache
  3. Through the proxy server, to avoid retrieving files from the origin.[2]

This series of three tests was repeated twice: once for the uncompressed files, and then for the compressed objects.[3]

As can be seen clearly in the plots below, compression caused web page download times to improve greatly, when the objects were retrieved from the source. However, the performance difference between compressed and uncompressed data all but disappears when retrieving objects from a proxy server on a corporate LAN.

uncompressed_pages

compressed_pages

Instead of the linear growth between object size and download time seen in both of the retrieval tests that used the origin server (Source and Proxy Load data), the Proxy Draw data clearly shows the benefits that accrue when a proxy server is added to a network to assist with serving HTTP traffic.

  MEAN DOWNLOAD TIME
Uncompressed Pages
Total Time Uncompressed — No Proxy 0.256
Total Time Uncompressed — Proxy Load 0.254
Total Time Uncompressed — Proxy Draw 0.110
Compressed Pages
Total Time Compressed — No Proxy 0.181
Total Time Compressed — Proxy Load 0.140
Total Time Compressed — Proxy Draw 0.104

The data above shows just how much of an improvement is gained by adding a local proxy server, explicit caching descriptions and compression can add to a Web site. For sites that do force a great of requests to be returned directly to the origin server, compression will be of great help in reducing bandwidth costs and improving performance. However, by allowing pages to be cached in local proxy servers, the difference between compressed and uncompressed pages vanishes.

Conclusion

Compression is a very good start when attempting to optimize performance. The addition of explicit caching messages in server responses which allow proxy servers to serve cached data to clients on remote local LANs can improve performance to even a greater extent than compression can. These two should be used together to improve the overall performance of Web sites.


[1]The test set was made up of the 1952 HTML files located in the top directory of the Linux Documentation Project HTML archive.

[2]All of the pages in these tests announced the following server response header indicating its cacheability:

Cache-Control: max-age=3600

[3]A note on the compressed files: all compression was performed dynamically by mod_gzip for Apache/1.3.27.

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

GMAIL SMTP Server Outage?

September 28th, 2006 by smp | Comments | Filed in Life

Judging by the flood of mail coming into my account for the last 15 minutes, there was an outage with the GMAIL SMTP servers sometime overnight or early this morning.

Anyone know what happened?

Technorati Tags: , ,

Tags: , , , , , , , ,

GrabPERF: Back in Business

September 27th, 2006 by smp | Comments | Filed in GrabPERF

Many thanks go out to the technical team for getting the GrabPERF Web server back on the Interweb.

All the good (and bad) news about Web performance is back.

Tags: , , , , , ,

GrabPERF: Frustrated and Demoralized

September 26th, 2006 by smp | Comments | Filed in GrabPERF, Life, RANTING

The GrabPERF Web server has been offline for more than 4 days, after it was moved to a new rack.

Kevin Burton complained about the lack of availability today [here].

I have enquired about an ETA for return to service. None has been forthcoming.

At this point, I guess you can consider GrabPERF offline until further notice.

Tags: , , , , , , , , , , ,

GrabPERF: Web server still out

September 23rd, 2006 by smp | Comments | Filed in GrabPERF

The folks who host the server are slammed and trying to figure out what is happening. Hopefully it will return to action tomorrow.

Tags: , , , , , ,

GrabPERF: Web Server Offline

September 21st, 2006 by smp | Comments | Filed in GrabPERF, Web Performance

Last night, the folks at the hosting facility moved the servers to a new rack. The database server is up and data is coming in from the measurement agents, but the Web server is not yet back up.

I hope that this will be resolved later today. Sorry for the inconvenience.

Tags: , , , , , , , , ,

Welcome aboard!

September 19th, 2006 by smp | Comments | Filed in Blogging, Life

I finally tired of running my own blog server, and since most folks use the feeds, I figure I will abuse Matt Mullenweg’s bandwidth rather than my own.

Welcome back?

Tags: , , , , ,

Caching for Performance Article Posted

August 24th, 2006 by smp | Comments | Filed in Technology, Web Performance

A few years ago, I wrote an article ablout how to best set up Web server cache-control messages to take advantage of this free form of content distribution. Until now, it has only existed as a PDF file.

Last night, I sent a copy to Kevin Burton of TailRank in response to some of his recent musings around making TailRank faster by sending explicit caching messages in his server responses. His response to the PDF was “make it an HTML file”.

You can now find the Caching for Performance article at Webperformance.org, in the Caching Library.

Use it. Live it.

Technorati Tags: , , , ,

Tags: , , , , , , , , , , , , , , , , , , ,

GrabPERF: New Agent Deployed

August 11th, 2006 by smp | Comments | Filed in GrabPERF, Web Performance

The new GrabPERF Agent code, with support for plain text or regular expression content matching, is now in production on all active measurement agents.

I added one more feature before I rolled out the new code: when a content match error occurs, the server headers and HTML content for 14 days.

I have not exposed this feature yet, but will be doing so in the next few days.

Again, thanks to the GrabPERF community for your continued support.

Technorati Tags: , , , ,

Tags: , , , , , , , , , , , , , , ,

Blog Search: Technorati, where art thou bot?

August 11th, 2006 by smp | Comments | Filed in Blogging

July 25, 2006 at 19:48:24 GMT.

That’s the last time that the Technorati bot indexed my blog.

I am confused, because of all the sites out there, my blog should be pretty easy for Technorati to index — this server, as well as the GrabPERF servers is hosted in Technorati’s racks. Theoretically, the bot should be able to index my blog without leaving the building.

I posted something this morning, and IceRocket, Google Blogsearch, Ask.com Blog Search all have it.

I am wondering if anyone else is noticing this.

Technorati Tags: , , , , ,

Tags: , , , , , , , , , , ,