Characterizing residential broadband networks

ABSTRACT

A large and rapidly growing proportion of users connect to the Internet via residential broadband networks such as Digital Subscriber Lines (DSL) and cable. Residential networks are often the bottleneck in the last mile of today's Internet. Their characteristics critically affect Internet applications, including voice-over-IP, online games, and peer-to-peer content sharing/delivery systems. However, to date, few studies have investigated commercial broadband deployments, and rigorous measurement data that characterize these networks at scale are lacking.

In this paper, we present the first large-scale measurement study of major cable and DSL providers in North America and Europe. We describe and evaluate the measurement tools we developed for this purpose. Our study characterizes several properties of broadband networks, including link capacities, packet round-trip times and jitter, packet loss rates, queue lengths, and queue drop policies. Our analysis reveals important ways in which residential networks differ from how the Internet is conventionally thought to operate. We also discuss the implications of our findings for many emerging protocols and systems, including delay-based congestion control (e.g., PCP) and network coordinate systems (e.g., Vivaldi).

REFERENCES

• 1: Aditya Akella , Srinivasan Seshan , Anees Shaikh, An empirical evaluation of wide-area internet bottlenecks, Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement, October 27-29, 2003, Miami Beach, FL, USA [doi>10.1145/948205.948219]
• 2: David G. Andersen , Hari Balakrishnan , M. Frans Kaashoek , Robert Morris, Experience with an evolving overlay network testbed, ACM SIGCOMM Computer Communication Review, v.33 n.3, July 2003 [doi>10.1145/956993.956996]
• 3: Thomas Anderson , Andrew Collins , Arvind Krishnamurthy , John Zahorjan, PCP: efficient endpoint congestion control, Proceedings of the 3rd conference on Networked Systems Design & Implementation, p.15-15, May 08-10, 2006, San Jose, CA
• 4: Guido Appenzeller , Isaac Keslassy , Nick McKeown, Sizing router buffers, Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications, August 30-September 03, 2004, Portland, Oregon, USA
• 5: S. Banerjee, T. G. Griffin, and M. Pias. The interdomain connectivity of PlanetLab nodes. In Proceedings of the 5th Passive and Active Measurement Conference (PAM), Apr 2004.
• 6: John Bellardo , Stefan Savage, Measuring packet reordering, Proceedings of the 2nd ACM SIGCOMM Workshop on Internet measurment, November 06-08, 2002, Marseille, France [doi>10.1145/637201.637216]
• 7: R. Bhagwan, S. Savage, and G. M. Voelker. Understanding availability. In Proceedings of 1st International Workshop on Peer-to-Peer Systems (IPTPS), Boston, MA, March 2002.
• 8: Bittorrent. http://bittorrent.com.
• 9: L. S. Brakmo and L. Peterson. TCP Vegas: End to end congestion avoidance on a global Internet. IEEE Journal on Selected Areas in Communication, 13(8):1465--1480, Oct 1995.
• 10: CableLabs. DOCSIS 1.1 interface specification, 2006. http://www.cablemodem.com/specifications/specifications11.html.
• 11: Bharat Chandra , Mike Dahlin , Lei Gao , Amol Nayate, End-to-end WAN service availability, Proceedings of the 3rd conference on USENIX Symposium on Internet Technologies and Systems, p.9-9, March 26-28, 2001, San Francisco, California
• 12: Kenjiro Cho , Kensuke Fukuda , Hiroshi Esaki , Akira Kato, The impact and implications of the growth in residential user-to-user traffic, Proceedings of the 2006 conference on Applications, technologies, architectures, and protocols for computer communications, September 11-15, 2006, Pisa, Italy
• 13: Cisco Systems Inc., Internetworking Technologies Handbook, Third Edition, Cisco Press, 2000
• 14: M. Claypool, R. Kinicki, M. Li, J. Nichols, and H. Wu. Inferring queue sizes in access networks by active measurement. In Proceedings of the 4th Passive and Active Measurement Workshop (PAM), Antibes Juan-les-Pins, France, Apr 2004.
• 15: Comcast PowerBoost press release, Jun 2006. http://www.cmcsk.com/phoenix.zhtml?c=147565&allp=irol-newsArticle&ID=890297.
• 16: Frank Dabek , Russ Cox , Frans Kaashoek , Robert Morris, Vivaldi: a decentralized network coordinate system, Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications, August 30-September 03, 2004, Portland, Oregon, USA
• 17: Constantinos Dovrolis , Parameswaran Ramanathan , David Moore, Packet-dispersion techniques and a capacity-estimation methodology, IEEE/ACM Transactions on Networking (TON), v.12 n.6, p.963-977, December 2004 [doi>10.1109/TNET.2004.838606]
• 18: Federal Communications Commission ComCom, Switzerland. Broadband in the universal service, Sep 2006.
• 19: Sally Floyd , Mark Handley , Jitendra Padhye , Jörg Widmer, Equation-based congestion control for unicast applications, Proceedings of the conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, p.43-56, August 28-September 01, 2000, Stockholm, Sweden
• 20: Sally Floyd , Van Jacobson, Random early detection gateways for congestion avoidance, IEEE/ACM Transactions on Networking (TON), v.1 n.4, p.397-413, Aug. 1993 [doi>10.1109/90.251892]
• 21: R. Govindan and V. Paxson. Estimating router ICMP generation delays. In Proceedings of Passive and Active Measurement (PAM), Fort Collins, CO, USA, 2002.
• 22: Bamba Gueye , Artur Ziviani , Mark Crovella , Serge Fdida, Constraint-based geolocation of internet hosts, IEEE/ACM Transactions on Networking (TON), v.14 n.6, p.1219-1232, December 2006 [doi>10.1109/TNET.2006.886332]
• 23: Andreas Haeberlen , Marcel Dischinger , Krishna P. Gummadi , Stefan Saroiu, Monarch: a tool to emulate transport protocol flowsover the internet at large, Proceedings of the 6th ACM SIGCOMM conference on Internet measurement, October 25-27, 2006, Rio de Janeriro, Brazil [doi>10.1145/1177080.1177095]
• 24: Yang-hua Chu , Aditya Ganjam , T. S. Eugene Ng , Sanjay G. Rao , Kunwadee Sripanidkulchai , Jibin Zhan , Hui Zhang, Early experience with an internet broadcast system based on overlay multicast, Proceedings of the annual conference on USENIX Annual Technical Conference, p.12-12, June 27-July 02, 2004, Boston, MA
• 25: Yang Chu , Sanjay Rao , Srinivasan Seshan , Hui Zhang, Enabling conferencing applications on the internet using an overlay muilticast architecture, Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, p.55-67, August 2001, San Diego, California, United States
• 26: Gianluca Iannaccone , Chen-nee Chuah , Richard Mortier , Supratik Bhattacharyya , Christophe Diot, Analysis of link failures in an IP backbone, Proceedings of the 2nd ACM SIGCOMM Workshop on Internet measurment, November 06-08, 2002, Marseille, France [doi>10.1145/637201.637238]
• 27: ISP Planet. Top 24 U.S. ISPs by subscriber: Q3 2005, 2006. http://www.isp-planet.com/research/rankings/usa.html.
• 28: ISP Planet. Top seven ISPs in Canada by subscriber: Q4 2006, 2006. http://www.isp-planet.com/research/rankings/2006/canada_q42006.html.
• 29: Manish Jain , Constantinos Dovrolis, End-to-end available bandwidth: measurement methodology, dynamics, and relation with TCP throughput, IEEE/ACM Transactions on Networking (TON), v.11 n.4, p.537-549, August 2003 [doi>10.1109/TNET.2003.815304]
• 30: Tom Jehaes , Danny De Vleeschauwer , Toon Coppens , Bart Van Doorselaer , Eva Deckers , W. Naudts , K. Spruyt , R. Smets, Access network delay in networked games, Proceedings of the 2nd workshop on Network and system support for games, p.63-71, May 22-23, 2003, Redwood City, California [doi>10.1145/963900.963906]
• 31: Srinivasan Keshav, A control-theoretic approach to flow control, Proceedings of the conference on Communications architecture & protocols, p.3-15, September 03-06, 1991, Zurich, Switzerland
• 32: Karthik Lakshminarayanan , Venkata N. Padmanabhan, Some findings on the network performance of broadband hosts, Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement, October 27-29, 2003, Miami Beach, FL, USA [doi>10.1145/948205.948212]
• 33: Karthik Lakshminarayanan , Venkata N. Padmanabhan , Jitendra Padhye, Bandwidth estimation in broadband access networks, Proceedings of the 4th ACM SIGCOMM conference on Internet measurement, October 25-27, 2004, Taormina, Sicily, Italy [doi>10.1145/1028788.1028832]
• 34: J. Ledlie, P. Gardner, and M. Seltzer. Network coordinates in the wild. In Proceedings of NSDI'07, Apr 2007.
• 35: S.-J. Lee, P. Sharma, S. Banerjee, S. Basu, and R. Fonseca. Measuring bandwidth between PlanetLab nodes. In Proceedings of the Passive and Active Measurement Workshop (PAM), March 2005.
• 36: Ratul Mahajan , Neil Spring , David Wetherall , Thomas Anderson, User-level internet path diagnosis, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
• 37: T. Ng and H. Zhang. Predicting Internet network distance with coordinates-based approaches. In Proc. INFOCOM 2002, New York, NY, USA, June 2002.
• 38: Nielsen/NetRatings. U.S. broadband connections reach critical mass, 2004. http://www.nielsen-netratings.com/pr/pr_040818.pdf.
• 39: OECD broadband statistics, Dec 2005. http://www.oecd.org/sti/ict/broadband.
• 40: Vern Paxson, End-to-end routing behavior in the Internet, IEEE/ACM Transactions on Networking (TON), v.5 n.5, p.601-615, Oct. 1997 [doi>10.1109/90.649563]
• 41: PlanetLab. http://www.planet-lab.org/.
• 42: Point Topic Ltd. UK broadband market monitor, 2006. http://point-topic.com/content/ukplus/email%20archive/wukbbmm7050602.htm.
• 43: Himabindu Pucha , Y. Charlie Hu , Z. Morley Mao, On the impact of research network based testbeds on wide-area experiments, Proceedings of the 6th ACM SIGCOMM conference on Internet measurement, October 25-27, 2006, Rio de Janeriro, Brazil [doi>10.1145/1177080.1177097]
• 44: S. Saroiu, K. P. Gummadi, and S. D. Gribble. A measurement study of peer-to-peer file sharing systems. In Proceedings of the Multimedia Computing and Networking (MMCN), San Jose, CA, Jan 2002.
• 45: Subhabrata Sen , Jia Wang, Analyzing peer-to-peer traffic across large networks, Proceedings of the 2nd ACM SIGCOMM Workshop on Internet measurment, November 06-08, 2002, Marseille, France [doi>10.1145/637201.637222]
• 46: M. Siekkinen, D. Collange, G. Urvoy-Keller, and E. Biersack. Performance limitations of ADSL users: A case study. In Proceedings of the 8th Passive and Active Measurement Conference (PAM), Apr 2007.
• 47: Neil Spring , Ratul Mahajan , David Wetherall , Thomas Anderson, Measuring ISP topologies with rocketfuel, IEEE/ACM Transactions on Networking (TON), v.12 n.1, p.2-16, February 2004 [doi>10.1109/TNET.2003.822655]
• 48: United Kingdom e-Minister and e-Envoy. UK online: The broadband future, 2001.
• 49: Curtis Villamizar , Cheng Song, High performance TCP in ANSNET, ACM SIGCOMM Computer Communication Review, v.24 n.5, p.45-60, Oct. 1994 [doi>10.1145/205511.205520]
• 50: Wikipedia. Broadband Internet access in the Netherlands, 2006. http://en.wikipedia.org/w/index.php?title=Broadband_Internet_access_in_the_Netherlands&oldid=152236688.
• 51: Windsor Oaks Group, LLC. Market outlook report, May 2005. http://www.broadbandtrends.com/Report%20Summary/2006/BBT_GlobalBBOutlook2006_061110_TOC.pdf.
• 52: B. Wong, I. Stoyanov, and E. G. Sirer. Octant: A comprehensive framework for the geolocalization of Internet hosts. In Proceeedings of NSDI'07, Apr 2007.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.5 Local and Wide-Area Networks

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.3 Network Operations
  C.4 PERFORMANCE OF SYSTEMS

General Terms:
Experimentation, Measurement, Performance

Keywords:
broadband access networks, cable, dsl, network measurement