An empirical evaluation of TCP performance in online games

ABSTRACT

A fundamental design question to ask in the development of a network game is---Which transport protocol should be used---TCP, UDP, or some other protocols? Seeking an objective answer to the choice of communication protocol for MMORPGs, we assess whether TCP, a popular choice, is suitable for MMORPGs based on empirical evidence. To the best of our knowledge, this work is the first evaluation of transport protocol performance using real-life game traces.We analyze a 1, 356-million-packet trace from ShenZhou Online, a TCP-based, commercial, mid-sized MMORPG. Our analysis indicates that TCP is unwieldy and inappropriate for MMORPGs. This is due to four distinctive characteristics of MMORPG traffic: 1) tiny packets, 2) low packet rate, 3) application-limited traffic generation, and 4) bidirectional traffic. We show that because TCP was originally designed for unidirectional and network-limited bulk data transfers, it cannot adapt well to MMORPG traffic. In particular, the window-based congestion control and the fast retransmit algorithm for loss recovery are ineffective. Furthermore, TCP is overkill, as not every game packet needs to be transmitted in a reliably and orderly manner. We also show that the degraded network performance did impact users' willingness to continue a game. Finally, we discuss guidelines in designing transport protocols for online games.

REFERENCES

• 1: ShenZhou Online. http://www.ewsoft.com.tw/.
• 2: FAQ - Multiplayer and Network Programming. GameDev.Net, 2004.
• 3: M. Allman , V. Paxson , W. Stevens, TCP Congestion Control, RFC Editor, 1999
• 4: Jon C. R. Bennett , Craig Partridge , Nicholas Shectman, Packet reordering is not pathological network behavior, IEEE/ACM Transactions on Networking (TON), v.7 n.6, p.789-798, Dec. 1999 [doi>10.1109/90.811445]
• 5: R. Braden, Requirements for Internet Hosts - Communication Layers, RFC Editor, 1989
• 6: K.-T. Chen, P. Huang, and C.-L. Lei. Game traffic analysis: An MMORPG perspective. Computer Networks, 51(3), 2007. Article In Press.
• 7: K.-T. Chen, P. Huang, G.-S. Wang, C.-Y. Huang, and C.-L. Lei. On the sensitivity of online game playing time to network QoS. In Proceedings of IEEE INFOCOM'06, Barcelona, Spain, Apr. 2006.
• 8: Wu-chang Feng , Francis Chang , Wu-chi Feng , Jonathan Walpole, A traffic characterization of popular on-line games, IEEE/ACM Transactions on Networking (TON), v.13 n.3, p.488-500, June 2005 [doi>10.1109/TNET.2005.850221]
• 9: M. Mathis , J. Mahdavi , S. Floyd , A. Romanow, TCP Selective Acknowledgement Options, RFC Editor, 1996
• 10: M. Mauve, V. Hilt, C. Kuhmünch, and W. Effelsberg. RTP/I - toward a common application level protocol for distributed interactive media. IEEE Transactions on Multimedia, 2001.
• 11: S. Pack, E. Hong, Y. Choi, llkyu Park, J.-S. Kim, and D. Ko. Game transport protocol: lightweight reliable transport protocol for massive interactive on-line game. In Proceedings of the SPIE, volume 4861, pages 83--94, 2002.
• 12: Peter Quax , Patrick Monsieurs , Wim Lamotte , Danny De Vleeschauwer , Natalie Degrande, Objective and subjective evaluation of the influence of small amounts of delay and jitter on a recent first person shooter game, Proceedings of 3rd ACM SIGCOMM workshop on Network and system support for games, August 30-30, 2004, Portland, Oregon, USA [doi>10.1145/1016540.1016557]
• 13: Sandeep Singhal , Michael Zyda, Networked virtual environments: design and implementation, ACM Press/Addison-Wesley Publishing Co., New York, NY, 1999
• 14: W. Richard Stevens , Gary R. Wright, TCP/IP illustrated (vol. 2): the implementation, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 15: B. S. Woodcock. An analysis of MMOG subscription growth -- version 18.0.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.2 Network Protocols

Additional Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Performance attributes; Measurement techniques

General Terms:
Algorithms, Measurement, Performance

Keywords:
MMOG, internet measurement, network games, performance analysis, transport protocols