Deriving traffic demands for operational IP networks: methodology and experience

ABSTRACT

Engineering a large IP backbone network without an accurate, network-wide view of the traffic demands is challenging. Shifts in user behavior, changes in routing policies, and failures of network elements can result in significant (and sudden) fluctuations in load. In this paper, we present a model of traffic demands to support traffic engineering and performance debugging of large Internet Service Provider networks. By defining a traffic demand as a volume of load originating from an ingress link and destined to a set of egress links, we can capture and predict how routing affects the traffic traveling between domains. To infer the traffic demands, we propose a measurement methodology that combines flow-level measurements collected at all ingress links with reachability information about all egress links. We discuss how to cope with situations where practical considerations limit the amount and quality of the necessary data. Specifically, we show how to infer interdomain traffic demands using measurements collected at a smaller number of edge links --- the peering links connecting to neighboring providers. We report on our experiences in deriving the traffic demands in the AT&T IP Backbone, by collecting, validating, and joining very large and diverse sets of usage, configuration, and routing data over extended periods of time. The paper concludes with a preliminary analysis of the observed dynamics of the traffic demands and a discussion of the practical implications for traffic engineering.

References

1. 1.V. Paxson, G. Almes, J. Mahdavi, and M. Mathis, Framework for IP performance metrics." Request for Comments 2330, May 1998.
2. 2.W. Stallings, SNMP, SNMPv2, SNMPv3 and RMON 1 and 2. Addison-Wesley, 1999.
3. 3.K. Thompson, G. J. Miller, and R. Wilder, Wide-area internet traffic patterns and characteristics," IEEE Network Magazine, vol. 11, pp. 10-23, November/December 1997.
4. 4.D. O. Awduche, A. Chiu, A. Elwalid, I. Widjaja, and X. Xiao, A framework for Internet traffic engineering." Internet Draft draft-ietf-tewg-framework-01.txt, May 2000.
5. 5.D. O. Awduche, MPLS and trac engineering in IP networks," IEEE Communication Magazine, pp. 42-47, December 1999.
6. 6.X. Xiao, A. Hannan, B. Bailey, and L. Ni, Trac engineering with MPLS in the Internet," IEEE Network Magazine, March 2000.
7. 7.A. Feldmann, A. Greenberg, C. Lund, N. Reingold, and J. Rexford, NetScope: Trac engineering for IP networks," IEEE Network Magazine, March 2000.
8. 8.B. Halabi, Internet Routing Architectures. Cisco Press, 1997.
9. 9.N. Dueld, P. Goyal, A. Greenberg, P. Mishra, K. Ramakrishnan, and J. van der Merwe, A exible model for resource management in virtual private networks," in Proc. ACM SIGCOMM, September 1999.
10. 10.B. Fortz and M. Thorup, Internet trac engineering by optimizing OSPF weights," in Proc. IEEE INFOCOM, March 2000.
11. 11.C. Labovitz, R. Malan, and F. Jahanian, Internet routing stability," IEEE/ACM Trans. Networking, vol. 6, pp. 515-558, October 1998.
12. 12.C. Labovitz, A. Ahuja, and F. Jahanian, Experimental study of Internet stability and wide-area network failures," in Proc. International Symposium on Fault-Tolerant Computing, June 1999.
13. 13.B. Krishnamurthy and J. Wang, On network-aware clustering of Web clients," in Proc. ACM SIGCOMM, August/September 2000.
14. 14.Cisco Net ow. http://www.cisco.com/warp/public/732/net ow/index.html.
15. 15.S. Handelman, S. Stibler, N. Brownlee, and G. Ruth, RTFM: New attributes for trac ow measurement." Request for Comments 2724, October 1999.
16. 16.P. Ferguson and D. Senie, Network ingress filtering: Defeating denial of service attacks which employ IP source address spoofiung." Request for Comments 2267, January 1998.
17. 17.A. Feldmann and J. Rexford, IP network configuration for trac engineering," Tech. Rep. 000526-02, AT&T Labs - Research, May 2000.
18. 18.W. Fang and L. Peterson, Inter-AS trac patterns and their implications," in Proc. IEEE Global Internet Symposium, December 1999.
19. 19.M. E. Crovella and A. Bestavros, Self-similarity in World Wide Web trac: Evidence and possible causes," IEEE/ACM Trans. Networking, vol. 5, pp. 835-846, December 1997.
20. 20.L. Breslau, P. Cao, L. Fan, G. Philips, and S. Shenker, Web caching and Zipf-like distributions: Evidence and implications," in Proc. IEEE INFOCOM, pp. 126-134, March 1999.

Index Terms

• Computer systems organization

  • Dependable and fault-tolerant systems and networks

• General and reference

  • Cross-computing tools and techniques

    • Performance

• Networks

  • Network performance evaluation

  • Network protocols

  • Network services

• Theory of computation

  • Design and analysis of algorithms

    • Approximation algorithms analysis

      • Routing and network design problems