Memory system behavior of Java programs: methodology and analysis

ABSTRACT

This paper studies the memory system behavior of Java programs by analyzing memory reference traces of several SPECjvm98 applications running with a Just-In-Time (JIT) compiler. Trace information is collected by an exception-based tracing tool called JTRACE, without any instrumentation to the Java programs or the JIT compiler.First, we find that the overall cache miss ratio is increased due to garbage collection, which suffers from higher cache misses compared to the application. We also note that going beyond 2-way cache associativity improves the cache miss ratio marginally. Second, we observe that Java programs generate a substantial amount of short-lived objects. However, the size of frequently-referenced long-lived objects is more important to the cache performance, because it tends to determine the application's working set size. Finally, we note that the default heap configuration which starts from a small initial heap size is very inefficient since it invokes a garbage collector frequently. Although the direct costs of garbage collection decrease as we increase the available heap size, there exists an optimal heap size which minimizes the total execution time due to the interaction with the virtual memory performance.

REFERENCES

• 1: Luiz André Barroso , Kourosh Gharachorloo , Edouard Bugnion, Memory system characterization of commercial workloads, Proceedings of the 25th annual international symposium on Computer architecture, p.3-14, June 27-July 02, 1998, Barcelona, Spain
• 2: S. Dasgupta and E. Serwn-Schreiber. Cache behavior of the SPEC95 benchmark suite. University of California at Berkeley, http ://http. es. berkeley, edu/-dasgupta, 1996.
• 3: Amer Diwan , David Tarditi , Eliot Moss, Memory system performance of programs with intensive heap allocation, ACM Transactions on Computer Systems (TOCS), v.13 n.3, p.244-273, Aug. 1995 [doi>10.1145/210126.210129]
• 4: J. Edler and M. D. Hill. Dinero IV trace-driven uniprocessor cache simulator, http://wuw.neci.nj .nec.com/ homepages/edler/d4/, 1998.
• 5: J. Gecsei, D. R. Slutz, and I. L. Traiger. Evaluation techniques for storage hierarchies. IBM Systems Journal, 9(~):7s-11~, 1970
• 6: Marcelo J. R. Gonçalves , Andrew W. Appel, Cache performance of fast-allocating programs, Proceedings of the seventh international conference on Functional programming languages and computer architecture, p.293-305, June 26-28, 1995, La Jolla, California, United States [doi>10.1145/224164.224219]
• 7: James Gosling , Bill Joy , Guy L. Steele, The Java Language Specification, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1996
• 8: C.-H. A. Hsieh , M. T. Conte , T. L. Johnson , J. C. Gyllenhaal , W.-M. W. Hwu, A study of the cache and branch performance issues with running Java on current hardware platforms, Proceedings of the 42nd IEEE International Computer Conference, p.211, February 23-26, 1997
• 9: IBM Corp. AIX Version ~.3 Kernel Extensions and Device Support Programming Concepts. 1998.
• 10: IBM Corp. PowerPC 60~e RISC Microprocessor User's Manual. 1998.
• 11: Yul H. Kim , Mark D. Hill , David A. Wood, Implementing stack simulation for highly-associative memories, Proceedings of the 1991 ACM SIGMETRICS conference on Measurement and modeling of computer systems, p.212-213, May 21-24, 1991, San Diego, California, United States
• 12: James R. Larus , Eric Schnarr, EEL: machine-independent executable editing, Proceedings of the ACM SIGPLAN 1995 conference on Programming language design and implementation, p.291-300, June 18-21, 1995, La Jolla, California, United States
• 13: Tim Lindholm , Frank Yellin, Java Virtual Machine Specification, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 14: Ann Marie Grizzaffi Maynard , Colette M. Donnelly , Bret R. Olszewski, Contrasting characteristics and cache performance of technical and multi-user commercial workloads, Proceedings of the sixth international conference on Architectural support for programming languages and operating systems, p.145-156, October 05-07, 1994, San Jose, California, United States
• 15: R. Radhakrishnan, J. Rubio, L. K. John, and N. Vijaykrishnan. Execution characteristics of just-in-time compilers. Technical Report TR-990717-0t, University of Texas at Austin, 1999.L
• 16: Mark B. Reinhold, Cache performance of garbage-collected programs, Proceedings of the ACM SIGPLAN 1994 conference on Programming language design and implementation, p.206-217, June 20-24, 1994, Orlando, Florida, United States
• 17: Theodore H. Romer , Dennis Lee , Geoffrey M. Voelker , Alec Wolman , Wayne A. Wong , Jean-Loup Baer , Brian N. Bershad , Henry M. Levy, The structure and performance of interpreters, Proceedings of the seventh international conference on Architectural support for programming languages and operating systems, p.150-159, October 01-04, 1996, Cambridge, Massachusetts, United States
• 18: Amitabh Srivastava , Alan Eustace, ATOM: a system for building customized program analysis tools, Proceedings of the ACM SIGPLAN 1994 conference on Programming language design and implementation, p.196-205, June 20-24, 1994, Orlando, Florida, United States
• 19: Standard Performance Evaluation Council. SPEC JVM98 benchmarks, htl;p://www.spec, org/osg/jvmg8/, 1998.
• 20: T. Suganuma , T. Ogasawara , M. Takeuchi , T. Yasue , M. Kawahito , K. Ishizaki , H. Komatsu , T. Nakatani, Overview of the IBM Java just-in-time compiler, IBM Systems Journal, v.39 n.1, p.175-193, January 2000
• 21: Paul Tyma, Why are we using Java again?, Communications of the ACM, v.41 n.6, p.38-42, June 1998 [doi>10.1145/276609.276617]
• 22: B. G. Zorn. The effect of garbage collection on cache performance. Technical Report CU-CS-528-91, University of Colorado at Boulder, May 1991.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS

Additional Classification:
  B. Hardware
  B.3 MEMORY STRUCTURES

  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications

          Nouns: Java
  D.4 OPERATING SYSTEMS

  G. Mathematics of Computing

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.2 Installation Management
          Subjects: Benchmarks

General Terms:
Design, Experimentation, Languages, Measurement, Performance, Standardization, Theory