Proxy-based acceleration of dynamically generated content on the world wide web: An approach and implementation

ABSTRACT

As Internet traffic continues to grow and websites become increasingly complex, performance and scalability are major issues for websites. Websites are increasingly relying on dynamic content generation applications to provide website visitors with dynamic, interactive, and personalized experiences. However, dynamic content generation comes at a cost---each request requires computation as well as communication across multiple components.To address these issues, various dynamic content caching approaches have been proposed. Proxy-based caching approaches store content at various locations outside the site infrastructure and can improve website performance by reducing content generation delays, firewall processing delays, and bandwidth requirements. However, existing proxy-based caching approaches either (a) cache at the page level, which does not guarantee that correct pages are served and provides very limited reusability, or (b) cache at the fragment level, which is associated with several design-level and runtime scalability issues. To address these issues, several back-end caching approaches have been proposed, including query result caching and fragment level caching. While back-end approaches guarantee the correctness of results and offer the advantages of fine-grained caching, they neither address firewall delays nor reduce bandwidth requirements.In this article, we present an approach and an implementation of a dynamic proxy caching technique which combines the benefits of both proxy-based and back-end caching approaches, yet does not suffer from their above-mentioned limitations. Our dynamic proxy caching technique allows granular, proxy-based caching in highly dynamic scenarios, accessible outside the site infrastructure. We present two possible configurations for our dynamic proxy caching technique: (1) a reverse proxy configuration, and (2) a forward proxy configuration. Analysis of the performance of our approach indicates that it is capable of providing significant reductions in bandwidth. We have deployed our proposed dynamic proxy caching technique at a major financial institution. The results of this implementation indicate that our technique is capable of providing up to 3x reductions in bandwidth and response times in real-world dynamic Web applications when compared to existing caching solutions.

REFERENCES

• 1: Akamai Technologies. 2003. http://www.akamai.com.
• 2: Virgílio Almeida , Azer Bestavros , Mark Crovella , Adriana de Oliveira, Characterizing reference locality in the WWW, Proceedings of the fourth international conference on on Parallel and distributed information systems, p.92-107, December 18-20, 1996, Miami Beach, Florida, United States
• 3: Altinel, M., Bornhovd, C., Krishnamurthy, S., Mohan, C., Pirahesh, H., and Reinwald, B. 2003. Cache tables: Paving the way for an adaptive database cache. In Proceedings of the 29th International Conference on Very Large Data Bases (VLDB) (Berlin, Germany). Morgan-Kaufmann, San Francisco, Calif., 718--729.
• 4: Amiri, K., Tewari, R., Park, S., and Padmanabhan, S. 2002. On space management in a dynamic edge cache. In Proceedings of the Fifth International Workshop on the Web and Databases (WebDB 2002) (Madison, Wisc.). ACM, New York, 37--42.
• 5: Jesse Anton , Lawrence Jacobs , Xiang Liu , Jordan Parker , Zheng Zeng , Tie Zhong, Web caching for database applications with Oracle Web Cache, Proceedings of the 2002 ACM SIGMOD international conference on Management of data, June 03-06, 2002, Madison, Wisconsin [doi>10.1145/564691.564762]
• 6: Apache HTTP Server Project. 2003. Apache HTTP server. http://httpd.apache.org/.
• 7: BEA Systems. 2003. Weblogic application server. http://www.bea.com.
• 8: CacheFlow. 1999. Accelerating e-commerce with CacheFlow internet caching appliances (a CacheFlow white paper).
• 9: Cain, B., Spatscheck, O., May, M., and Barbir, A. 2001. Request-routing requirements for content internetworking. http://www.ietf.org/internet-drafts/draft-cain-request-routing-req-03.txt.
• 10: K. Selçuk Candan , Wen-Syan Li , Qiong Luo , Wang-Pin Hsiung , Divyakant Agrawal, Enabling dynamic content caching for database-driven web sites, Proceedings of the 2001 ACM SIGMOD international conference on Management of data, p.532-543, May 21-24, 2001, Santa Barbara, California, United States
• 11: Challenger, J., Dantzig, P., and Iyengar, A. 1999. A scalable system for consistently caching dynamic web data. In Proceedings of the 18th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM) (New York, N.Y.). IEEE Computer Society Press, Los Alamitos, Calif., 294--303.
• 12: Carlos Cunha , Azer Bestavros , Mark Crovella, Characteristics of WWW Client-based Traces, Boston University, Boston, MA, 1995
• 13: ESI Consortium. 2001. Edge side includes. http://www.esi.org.
• 14: S. Gadde , M. Rabinovich , J. Chase, Reduce, Reuse, Recycle: An Approach to Building Large Internet Caches, Proceedings of the 6th Workshop on Hot Topics in Operating Systems (HotOS-VI), p.93, May 05-06, 1997
• 15: Erich Gamma , Richard Helm , Ralph Johnson , John Vlissides, Design patterns: elements of reusable object-oriented software, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 16: IBM Corporation 2001. IBM websphere edge server version 2.0 (Product documentation).
• 17: IBM Corporation 2003. Websphere application server. http://www.ibm.com.
• 18: Inktomi Corporation 2002. Inktomi network products. http://www.inktomi.com/products/network/.
• 19: Keynote Systems. 2000. Keynote consumer 40 internet performance index. http://www.keynote. com/solutions/performance_indices/consumer_index/consumer_40.html.
• 20: Labrinidis, A. and Roussopoulos, N. 2003. Balancing performance and data freshness in web database servers. In Proceedings of the 29th International Conference on Very Large Data Bases (VLDB) (Berlin, Germany). Morgan-Kaufmann, San Francisco, Calif., 393--404.
• 21: Loosley, C., Gimarc, R., and Spellman, A. 2000. E-commerce response time: A reference model. A Keynote Systems White Paper: http://www.keynote.com/services/html/product_lib.html.
• 22: Qiong Luo , Sailesh Krishnamurthy , C. Mohan , Hamid Pirahesh , Honguk Woo , Bruce G. Lindsay , Jeffrey F. Naughton, Middle-tier database caching for e-business, Proceedings of the 2002 ACM SIGMOD international conference on Management of data, June 03-06, 2002, Madison, Wisconsin [doi>10.1145/564691.564763]
• 23: Qiong Luo , Jeffrey F. Naughton, Form-Based Proxy Caching for Database-Backed Web Sites, Proceedings of the 27th International Conference on Very Large Data Bases, p.191-200, September 11-14, 2001
• 24: Meyers, A., Chuang, J., Hengartner, U., Xie, Y., Zhuang, W., and Zhang, H. 2001. A secure, publisher-centric web caching infrastructure. In Proceedings of the 20th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM) (Anchorage, Alaska). IEEE Computer Society Press, Los Alamitos, Calif., 1235--1243.
• 25: Microsoft Corporation 2003a. ASP, c#, vbscript, and ASP+. http://www.microsoft.com.
• 26: Microsoft Corporation 2003b. Microsoft ISA server. http://www.microsoft.com/isaserver.
• 27: C. Mohan, Caching Technologies for Web Applications, Proceedings of the 27th International Conference on Very Large Data Bases, p.726, September 11-14, 2001
• 28: Morgan Stanley Dean Witter. 2000. Analyst Report: The Internet Evolution---Content Delivery Networks. Morgan Stanley Dean Witter, New York, N.Y.
• 29: Network Appliance. 2003. http://www.netapp.com.
• 30: Network Associates. 2003. Sniffer technologies. http://www.networkassociates.com.
• 31: Oracle Corporation 2001. Oracle 9i Application Server Web Cache. http://otn.oracle.com/products/ias/htdocs/9iaswebcache_fov.html.
• 32: Perl. 2003. http://www.perl.org.
• 33: Michael Rabinovich , Amit Aggarwal, RaDaR: a scalable architecture for a global Web hosting service, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.31 n.11-16, p.1545-1561, May 17, 1999
• 34: Radview. 2003. http://www.radview.com.
• 35: Savvis. 2004. http://www.savvis.net.
• 36: Shi, W. and Karamcheti, V. 2001. Conca: An architecture for consistent nomadic content access. In Proceedings of the Workshop on Cache, Coherence, and Consistency, International Conference on Supercomputing (Sorrento, Napoli, Italy). ACM, New York.
• 37: Sun Microsystems. 2003. Java servlets and jsp. http://java.sun.com.
• 38: TimesTen Software. 2003. http://www.timesten.com.
• 39: The TimesTen Team, Mid-tier caching: the TimesTen approach, Proceedings of the 2002 ACM SIGMOD international conference on Management of data, June 03-06, 2002, Madison, Wisconsin [doi>10.1145/564691.564761]
• 40: Vignette Corp. 2003. Vignette content suite. http://www.vignette.com.
• 41: Warp Solutions. 2003. http://www.warpsolutions.com.
• 42: Wills, C. E. and Mikhailov, M. 2000. Studying the impact of more complete server information on web caching. In Proceedings of the 5th International Web Caching and Content Delivery Workship (WCW'00) (Lisbon, Portugal). International Web Content Caching and Distribution Workshops (IWCW).
• 43: Khaled Yagoub , Daniela Florescu , Valérie Issarny , Patrick Valduriez, Caching Strategies for Data-Intensive Web Sites, Proceedings of the 26th International Conference on Very Large Data Bases, p.188-199, September 10-14, 2000
• 44: Research & Education Association, C++, Research & Education Association, 2000

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems
          Subjects: Distributed applications

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software
          Subjects: Performance evaluation (efficiency and effectiveness); Information networks
      H.3.5 On-line Information Services
          Subjects: Web-based services
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.m Miscellaneous

General Terms:
Algorithms, Design, Experimentation, Performance

Keywords:
Edge caching, caching dynamically generated content, fragment caching, implementation, proxy caching, world wide web