A performance comparison of dynamic Web technologies

ABSTRACT

Today, many Web sites dynamically generate responses "on the fly" when user requests are received. In this paper, we experimentally evaluate the impact of three different dynamic content technologies (Perl, PHP, and Java) on Web server performance. We quantify achievable performance first for static content serving, and then for dynamic content generation, considering cases both with and without database access. The results show that the overheads of dynamic content generation reduce the peak request rate supported by a Web server up to a factor of 8, depending on the workload characteristics and the technologies used. In general, our results show that Java server technologies typically outperform both Perl and PHP for dynamic content generation, though performance under overload conditions can be erratic for some implementations.

REFERENCES

• 1: Characterizing the scalability of a large web-based shopping system, ACM Transactions on Internet Technology (TOIT), v.1 n.1, p.44-69, Aug. 2001 [doi>10.1145/383034.383036]
• 2: Paul Barford , Mark Crovella, Measuring Web performance in the wide area, ACM SIGMETRICS Performance Evaluation Review, v.27 n.2, p.37-48, 9.1.99 [doi>10.1145/332944.332953]
• 3: E. Cecchet, A. Chanda, S. Elnikety, J. Marguerite, and W. Zwaenepoel, "Performance Comparison of Middleware Architectures for Generating Dynamic Web Content", Proceedings of 4th Middleware Conference, Rio de Janeiro, Brazil, June 2003.
• 4: Daniel F. García , Javier García, TPC-W E-Commerce Benchmark Evaluation, Computer, v.36 n.2, p.42-48, February 2003 [doi>10.1109/MC.2003.1178045 ]
• 5: J. Hu, S. Mungee, and D. Schmidt, "Techniques for Developing and Measuring High-Performance Web Servers over ATM Networks", Proceedings of IEEE INFOCOM, San Francisco, CA, March/April 1998.
• 6: Y. Hu, A. Nanda, and Q. Yang, "Measurement, Analysis, and Performance Improvement of the Apache Web Server", Technical Report No. 1097--0001, University of Rhode Island, 1997.
• 7: R. Jain, The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation and Modeling, John Wiley & Sons, Inc., New York, NY, 1991.
• 8: David Mosberger , Tai Jin, httperf—a tool for measuring web server performance, ACM SIGMETRICS Performance Evaluation Review, v.26 n.3, p.31-37, Dec. 1998 [doi>10.1145/306225.306235]
• 9: Erich Nahum , Tsipora Barzilai , Dilip D. Kandlur, Performance issues in WWW servers, IEEE/ACM Transactions on Networking (TON), v.10 n.1, p.2-11, February 2002 [doi>10.1109/90.986497]
• 10: Erich M. Nahum , Marcel-Catalin Rosu , Srinivasan Seshan , Jussara Almeida, The effects of wide-area conditions on WWW server performance, Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.257-267, June 2001, Cambridge, Massachusetts, United States
• 11: M. Nielsen, "How to use a RAMdisk for Linux", http://www.linuxfocus, org/English/November1999/article124.html
• 12: SecuritySpace, "Apache Module Report", April 2003, http://www.securityspace.com/s_survey/data/man.200308/apachemods.html.
• 13: W. Shi, R. Wright, E. Collins, and V. Karamcheti, "Workload Characterization of a Personalized Web Site -- And Its Implications for Dynamic Content Caching", Proceedings of the 7th International Workshop on Web Caching and Content Distribution (WCW '02), Boulder, CO, August 2002.
• 14: L. Titchkosky, M. Arlitt, and C. Williamson, "Performance Benchmarking of Dynamic Web Technologies", Proceedings of IEEE MASCOTS 2003, October, 2003.
• 15: Red Hat, "Tux Web Server Manuals", http://www.redhat.com/docs/manuals/tux
• 16: Sun Microsystems, "Java 2 Platform, Standard Edition (J2SE), Version 1.4.2 Performance White Paper", java.sun.com/j2se/l.4.2/l.4.2_whitepaper.html
• 17: Udaykiran Vallamsetty , Krishna Kant , Prasant Mohapatra, Characterization of E-Commerce Traffic, Electronic Commerce Research, v.3 n.1-2, p.167-192, January-April 2003
• 18: Carey Williamson , Rob Simmonds , Martin Arlitt, A case study of web server benchmarking using parallel WAN emulation, Performance Evaluation, v.49 n.1-4, p.111-127, September 2002 [doi>10.1016/S0166-5316(02)00107-4 ]
• 19: Nancy J. Yeager , Robert E. McGrath, Web server technology: the advanced guide for World Wide Web information providers, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1996

INDEX TERMS

Keywords:
Dynamic Content Generation, Performance Evaluation, Web Performance, Web Server Benchmarking