Performance Benchmark of a Parallel and Distributed Network Simulator

ABSTRACT

Simulation of large-scale networks requires enormous amounts of memory and processing time. One way of speeding up these simulations is to distribute the model over a number of connected workstations. However, this introduces inefficiencies caused by the need for synchronization and message passing between machines. In distributed network simulation, one of the factors affecting message passing overhead is the amount of cross-traffic between machines. We perform an independent benchmark of theParallel/Distributed Network Simulator (PDNS) based on experimental results processed at the Australian Centre for Advanced Computing and Communications (AC3) supercomputing cluster. We measure the effect of cross-traffic on wall-clock time needed to complete a simulation for a set of basic network topologies by comparing the result with the wall-clock time needed on a single processor. Our results show that although efficiency is reduced with large amounts of cross-traffic, speedup can still be achieved with PDNS. With these results, we developed a performance model that can be used as a guideline for designing future simulations.

REFERENCES

• 1: [1] S. Lee, N. Sheridan-Smith, T. O'Neill, J. Leaney, K. Sandrasegaran, and S. Markovits, "Managing the Enriched Experience Network -- Learning-Outcome Approach to the Experimental Design Life-Cycle," presented at Australian Telecommunication Networks and Applications Conference (ATNAC'03), Melbourne, Australia, 2003.
• 2: [2] B. Liu, D. R. Figueiredo, Y. Guo, J. Kurose, and D. Towsley, "A Study of Networks Simulation Efficiency: Fluid Simulation vs. Packet-level Simulation," presented at IEEE INFOCOM'2001, Anchorage, Alaska, 2001.
• 3: R. Brown, Calendar queues: a fast 0(1) priority queue implementation for the simulation event set problem, Communications of the ACM, v.31 n.10, p.1220-1227, Oct. 1988 [doi>10.1145/63039.63045]
• 4: G. F. Riley , T. M. Jaafar , R. M. Fujimoto, Integrated Fluid and Packet Network Simulations, Proceedings of the 10th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems (MASCOTS'02), p.511, October 11-16, 2002
• 5: Richard M. Fujimoto, Parallel and Distribution Simulation Systems, John Wiley & Sons, Inc., New York, NY, 1999
• 6: [6] K. M. Chandy and J. Misra, "Distributed Simulation: A Case Study in Design and Verification of Distributed Programs," IEEE Transactions on Software Engineering, vol. 5, pp. 440-452, 1979.
• 7: David R. Jefferson, Virtual time, ACM Transactions on Programming Languages and Systems (TOPLAS), v.7 n.3, p.404-425, July 1985 [doi>10.1145/3916.3988]
• 8: [8] S. Bhatt, R. Fujimoto, A. Ogielski, and K. Perumalla, "Parallel Simulation Techniques for Large Scale Networks," IEEE Communications Magazine, vol. 36, pp. 42-47, 2002.
• 9: [9] "PDNS - Parallel/Distributed NS." http://www.cc.gatech.edu/computing/compass/pdns/, 2004.
• 10: [10] "The Network Simulator - ns-2." http://www.isi.edu/nsnam/ns/, 2004.
• 11: [11] "GTNetS - Georgia Tech Network Simulator." http://www.ece.gatech.edu/research/labs/MANIACS/GTNet S/, 2004.
• 12: [12] "Dartmouth Scalable Simulation Framework (DaSSF)." http://www.cs.dartmouth.edu/research/DaSSF/, 2004.
• 13: [13] Georgia Tech, "Federated Simulations Development Kit." http://www.cc.gatech.edu/computing/pads/fdk.html, 2001.
• 14: [14] K. Perumalla, "libSynk library." http://www.cc.gatech.edu/computing/pads/kalyan/libsynk.ht m, 2004.
• 15: James H. Cowie , David M. Nicol , Andy T. Ogielski, Modeling the Global Internet, Computing in Science and Engineering, v.1 n.1, p.42-50, January 1999 [doi>10.1109/5992.743621 ]
• 16: [16] "Australian Centre for Advanced Computing and Communications." http://www.ac3.edu.au/edu/, 2004.
• 17: Kalyan S. Perumalla , Alfred Park , Richard M. Fujimoto , George F. Riley, Scalable RTI-Based Parallel Simulation of Networks, Proceedings of the seventeenth workshop on Parallel and distributed simulation, p.97, June 10-13, 2003
• 18: [18] R. M. Fujimoto, K. Perumalla, A. Park, H. Wu, and M. H. Ammar, "Large-Scale Network Simulation: How Big? How Fast?," presented at Meeting of the IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), 2003.
• 19: George F. Riley , Mostafa H. Ammar , Richard M. Fujimoto , Alfred Park , Kalyan Perumalla , Donghua Xu, A federated approach to distributed network simulation, ACM Transactions on Modeling and Computer Simulation (TOMACS), v.14 n.2, p.116-148, April 2004 [doi>10.1145/985793.985795]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.8 Types of Simulation
          Subjects: Distributed

Additional Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS

  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.8 Types of Simulation
          Subjects: Parallel

General Terms:
Design, Experimentation, Measurement, Performance