Soft timers: efficient microsecond software timer support for network processing

ABSTRACT

This paper proposes and evaluates soft timers, a new operating system facility that allows the efficient scheduling of software events at a granularity down to tens of microseconds. Soft timers can be used to avoid interrupts and reduce context switches associated with network processing without sacrificing low communication delays.More specifically, soft timers enable transport protocols like TCP to efficiently perform rate-based clocking of packet transmissions. Experiments show that rate-based clocking can improve HTTP response time over connections with high bandwidth-delay products by up to 89% and that soft timers allow a server to employ rate-based clocking with little CPU overhead (2-6%) at high aggregate bandwidths.Soft timers can also be used to perform network polling, which eliminates network interrupts and increases the memory access locality of the network subsystem without sacrificing delay. Experiments show that this technique can improve the throughput of a Web server by up to 25%.

REFERENCES

• 1: M. Allman, C. Hayes, H. Kruse, and S. Ostermann. TCP Performance over Satellite Links. In Proceedings of 5th International Conference on Telecommunication Systems, pages 456-469, Nashville, TN, Mar. 1997.
• 2: Mark Allman , Vern Paxson, On estimating end-to-end network path properties, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.263-274, August 30-September 03, 1999, Cambridge, Massachusetts, United States
• 3: Apache. http://www, apache.org/.
• 4: Martin F. Arlitt , Carey L. Williamson, Web server workload characterization: the search for invariants, Proceedings of the 1996 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.126-137, May 23-26, 1996, Philadelphia, Pennsylvania, United States
• 5: Hari Balakrishnan , Venkata N. Padmanabhan , Randy H. Katz, The effects of asymmetry on TCP performance, Proceedings of the 3rd annual ACM/IEEE international conference on Mobile computing and networking, p.77-89, September 26-30, 1997, Budapest, Hungary [doi>10.1145/262116.262134]
• 6: H. Balakrishnan, V. N. Padmanabhan, S. Seshan, M. Stemm, and R. H. Katz. TCP behavior of a busy internet server: Analysis and improvements. In Proceedings of lEEE INFOCOM '98, pages 252-262, San Francisco, CA, Apr. 1998.
• 7: T. Berners-Lee, R. Fielding, and H. Frystyk. RFC 1945: Hypertext transfer protocol- HTTP/1.0, May 1996. ftp://ftp.merit.edu/documents/rfc/rfc 1945.txt.
• 8: Lawrence S. Brakmo , Larry L. Peterson, Performance problems in BSD4. 4TCP, ACM SIGCOMM Computer Communication Review, v.25 n.5, p.69-86, Oct. 1995 [doi>10.1145/216701.216706]
• 9: L. Brakmo and L. Peterson. TCP Vegas: End to End Congestion Avoidance on a Global Internet. IEEE Journal on Selected Areas in Communications, 13(8):1465-1480, Oct. 1995.
• 10: Wu-chang Feng , Dilip D. Kandlur , Debanjan Saha , Kang G. Shin, Understanding and improving TCP performance over networks with minimum rate guarantees, IEEE/ACM Transactions on Networking (TON), v.7 n.2, p.173-187, April 1999 [doi>10.1109/90.769766]
• 11: Kevin Fall , Sally Floyd, Simulation-based comparisons of Tahoe, Reno and SACK TCP, ACM SIGCOMM Computer Communication Review, v.26 n.3, p.5-21, July 1996 [doi>10.1145/235160.235162]
• 12: R. Fielding, J. Gettys, J. Mogul, H. Nielsen, and T. Berners-Lee. RFC 2068: Hypertext transfer protocol - HTTP/1.1, Jan. 1997. ftp ://ftp.merit.edu/documents/rfc/rfc2068.txt.
• 13: Janey C. Hoe, Improving the start-up behavior of a congestion control scheme for TCP, Conference proceedings on Applications, technologies, architectures, and protocols for computer communications, p.270-280, August 28-30, 1996, Palo Alto, California, United States
• 14: Srinivasan Keshav, A control-theoretic approach to flow control, Proceedings of the conference on Communications architecture & protocols, p.3-15, September 03-06, 1991, Zurich, Switzerland
• 15: Jeffrey C. Mogul, Observing TCP dynamics in real networks, Conference proceedings on Communications architectures & protocols, p.305-317, August 17-20, 1992, Baltimore, Maryland, United States
• 16: Jeffrey C. Mogul, The case for persistent-connection HTTP, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.299-313, August 28-September 01, 1995, Cambridge, Massachusetts, United States
• 17: Jeffrey C. Mogul , K. K. Ramakrishnan, Eliminating receive livelock in an interrupt-driven kernel, ACM Transactions on Computer Systems (TOCS), v.15 n.3, p.217-252, Aug. 1997 [doi>10.1145/263326.263335]
• 18: V. N. Padmanabhan and R. H. Katz. TCP Fast Start: A Technique For Speeding Up Web Transfers. In Proceedings of the IEEE GLOBECOM '98 Conference, pages 41-46, Sydney, Australia, Nov. 1998.
• 19: V. N. Padmanabhan and J. C. Mogul. Improving HTTP Latency. In Proceedings of the Second International WWW Conference, pages 995-1005, Chicago, IL, Oct. 1994.
• 20: V. S. Pai, P. Druschel, and W. Zwaenepoel. Flash: An efficient and portable Web server. In Proceeding of the Usenix 1999 Annual Technical Conference, pages 199- 212, Monterey, CA, June 1999.
• 21: Vern Paxson, End-to-end Internet packet dynamics, Proceedings of the ACM SIGCOMM '97 conference on Applications, technologies, architectures, and protocols for computer communication, p.139-152, September 14-18, 1997, Cannes, France
• 22: RealPlayer. http://www, realplayer.com/.
• 23: J. M. Smith and C. B. S. Traw. Giving applications access to Gb/s networking. IEEE Network, 7(4):44-52, July 1993.
• 24: G. Varghese , T. Lauck, Hashed and hierarchical timing wheels: data structures for the efficient implementation of a timer facility, Proceedings of the eleventh ACM Symposium on Operating systems principles, p.25-38, November 08-11, 1987, Austin, Texas, United States
• 25: V. Visweswaraiah and J. Heidemann. Improving restart of idle TCP connections. Technical Report 97-661, University of Southern California, November 1997.
• 26: J. Wroclawski. RFC 2211: Specification of controlled-load network element service, Sept. 1997. ftp://ftp.merit.edu/documents/rfc/rfc2211.txt.
• 27: Lixia Zhang , Scott Shenker , Daivd D. Clark, Observations on the dynamics of a congestion control algorithm: the effects of two-way traffic, Proceedings of the conference on Communications architecture & protocols, p.133-147, September 03-06, 1991, Zurich, Switzerland

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS

General Terms:
Design