skip to main content
article

Towards the measurement of tuple space performance

Published: 01 December 2005 Publication History

Abstract

Many applications rely upon a tuple space within distributed system middleware to provide loosely coupled communication and service coordination. This paper describes an approach for measuring the throughput and response time of a tuple space when it handles concurrent local space interactions. Furthermore, it discusses a technique that populates a tuple space with tuples before the execution of a benchmark in order to age the tuple space and provide a worst-case measurement of space performance. We apply the tuple space benchmarking and aging methods to the measurement of the performance of a JavaSpace, a current example of a tuple space that integrates with the Jini network technology. The experiment results indicate that: (i) the JavaSpace exhibits limited scalability as the number of concurrent interactions from local space clients increases, (ii) the aging technique can operate with acceptable time overhead, and (iii) the aging technique does ensure that the results from benchmarking capture the worst-case performance of a tuple space.

References

[1]
G. C. Arnold, G. M. Kapfhammer, and R. S. Roos. Implementation and analysis of a JavaSpace supported by a relational database. In Proceedings of the 8th International Conference on Parallel and Distributed Processing Techniques and Applications, Las Vegas, Nevada, June 2002.]]
[2]
L. Bulej, T. Kalibera, and P. Tuma. Repeated results analysis for middleware regression benchmarking. Performance Evaluation, 60(1-4):345--358, 2005.]]
[3]
N. Carriero and D. Gelernter. A computational model of everything. Communications of the ACM, 44(11):77--81, November 2001.]]
[4]
E. Cecchet, J. Marguerite, and W. Zwaenepoel. Performance and scalability of EJB applications. In Proceedings of the 17th ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications, pages 246--261, 2002.]]
[5]
B. Dufour, K. Driesen, L. Hendren, and C. Verbrugge. Dynamic metrics for Java. In Proceedings of the 18th ACM SIGPLAN Conference on Object-Oriented Programing, Systems, Languages, and Applications, pages 149--168, 2003.]]
[6]
C. J. Fleckenstein and D. Hemmendinger. Using a global name space for parallel execution of UNIX tools. Communications of the ACM, 32(9):1085--1090, 1989.]]
[7]
E. Freeman, S. Hupfer, and K. Arnold. JavaSpaces: Principles, Patterns, and Practice. Addison-Wesley, Reading, Massachusetts, 1999.]]
[8]
F. Hancke, G. Stuer, D. Dewolfs, J. Broeckhove, F. Arickx, and T. Dhaene. Modelling overhead in JavaSpaces. In Proceedings of EuroMedia, pages 77--81, 2003.]]
[9]
M. Hauswirth, P. F. Sweeney, A. Diwan, and M. Hind. Vertical profiling: understanding the behavior of object-oriented applications. In Proceedings of the 19th ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications, pages 251--269, 2004.]]
[10]
J. Horgan, J. Power, and J. Waldron. Measurement and analysis of runtime profiling data for Java programs. In IEEE International Workshop on Source Code Analysis and Manipulation, pages 124--132, November, 2001.]]
[11]
R. Jain. The Art of Computer Systems Performance Analysis. John Wiley and Sons, Inc., New York, 1991.]]
[12]
G. M. Kapfhammer. Automatically and transparently distributing the execution of regression test suites. In Proceedings of the 18th International Conference on Testing Computer Software, Washington, D.C., June 2001.]]
[13]
G. M. Kapfhammer. The Computer Science Handbook, chapter 105: Software Testing. CRC Press, Boca Raton, Fl, second edition, 2004.]]
[14]
D. J. Lilja. Measuring Computer Performance: A Practicioner's Guide. Cambridge University Press, 2000.]]
[15]
H. D. Neve, F. Hancke, T. Dhaene, J. Broeckhove, and F. Arickx. On the use of DOE for the characterization of Java-Spaces. In Proceedings of the European Simulation and Modelling Conference, pages 24--29, 2003.]]
[16]
M. S. Noble and S. Zlateva. Scientific computation with Java-Spaces: In Proceedings of the 9th European Conference on High Performance Computing and Networking, June 2001.]]
[17]
G. P. Picco, A. L. Murphy, and G.-C. Roman. LIME: Linda meets mobility. In Proceedings of the 21st International Conference on Software Engineering, pages 368--377, 1999.]]
[18]
B. Pugh and J. Spacco. RUBiS revisited: why J2EE benchmarking is hard. In Companion to the 19th ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications, pages 204--205, 2004.]]
[19]
G. Rothermel and M. J. Harrold. A safe, efficient regression test selection technique. ACM Transactions on Software Engineering and Methodology, 6(2):173--210, April 1997.]]
[20]
M. Rummel, G. M. Kapfhammer, and A. Thall. Towards the prioritization of regression test suites with data flow information. In Proceedings of the 20th Symposium on Applied Computing, Santa Fe, New Mexico, March 2005.]]
[21]
K. A. Smith and M. I. Seltzer. File system aging -- increasing the relevance of file system benchmarks. In Proceedings of the 1997 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, pages 203--213, 1997.]]
[22]
H. D. Sterck, R. S. Markel, and R. Knight. Parallel Computing in Bioinformatics and Computational Biology, chapter TaskSpaces: A Software Framework for Parallel Bioinformatics on Computational Grids. John Wiley and Sons, 2005.]]
[23]
H. D. Sterck, R. S. Markel, T. Phol, and U. Rude. A lightweight Java TaskSpaces framework for scientific computing on computational grids. In Proceedings of the ACM SIGAPP Symposium on Applied Computing, pages 1024--1030, 2003.]]
[24]
P. F. Sweeney, M. Hauswirth, B. Cahoon, P. Cheng, A. Diwan, D. Grove, and M. Hind. Using hardware performance monitors to understand the behavior of Java applications. In Proceedings of the 3rd Virtual Machine Research and Technology Symposium, May 2004.]]
[25]
P. Wyckoff, S. McLaughry, and T. Lehman. T Spaces. IBM Systems Journal, pages 454--474, 1998.]]
[26]
X. Zhang and M. Seltzer. HBench:Java: an application-specific benchmarking framework for Java virtual machines. In Proceedings of the ACM Conference on Java Grande, pages 62--70, 2000.]]
[27]
B. Zorman, G. M. Kapfhammer, and R. S. Roos. Creation and analysis of a JavaSpace-based genetic algorithm. In Proceedings of the 8th International Conference on Parallel and Distributed Processing Techniques and Applications, Las Vegas, NV, June 2002.]]

Cited By

View all
  • (2017)MemSpaces: Evaluating the Tuple Space Paradigm in the Context of Memory-Centric Architectures2017 Fifth International Symposium on Computing and Networking (CANDAR)10.1109/CANDAR.2017.55(284-290)Online publication date: Nov-2017
  • (2014)Cwmwl, a LINDA-based PaaS Fabric for the CloudJournal of Communications10.12720/jcm.9.4.286-2989:4(286-298)Online publication date: 2014
  • (2013)A High Performance Protocol for Fault Tolerant Distributed Shared Memory (FaTP)Journal of Applied Sciences10.3923/jas.2013.790.79913:6(790-799)Online publication date: 1-Jun-2013
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM SIGMETRICS Performance Evaluation Review
ACM SIGMETRICS Performance Evaluation Review  Volume 33, Issue 3
Special issue on the First ACM SIGMETRICS Workshop on Large Scale Network Inference (LSNI 2005)
December 2005
61 pages
ISSN:0163-5999
DOI:10.1145/1111572
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2005
Published in SIGMETRICS Volume 33, Issue 3

Check for updates

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2017)MemSpaces: Evaluating the Tuple Space Paradigm in the Context of Memory-Centric Architectures2017 Fifth International Symposium on Computing and Networking (CANDAR)10.1109/CANDAR.2017.55(284-290)Online publication date: Nov-2017
  • (2014)Cwmwl, a LINDA-based PaaS Fabric for the CloudJournal of Communications10.12720/jcm.9.4.286-2989:4(286-298)Online publication date: 2014
  • (2013)A High Performance Protocol for Fault Tolerant Distributed Shared Memory (FaTP)Journal of Applied Sciences10.3923/jas.2013.790.79913:6(790-799)Online publication date: 1-Jun-2013
  • (2013)SimfrastructureProceedings of the 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2013.78(506-513)Online publication date: 13-May-2013
  • (2012)An empirical comparison of Java remote communication primitives for intra-node data transmissionACM SIGMETRICS Performance Evaluation Review10.1145/2185395.218539739:4(2-11)Online publication date: 9-Apr-2012
  • (2011)Space-based multi-core programming in JavaProceedings of the 9th International Conference on Principles and Practice of Programming in Java10.1145/2093157.2093164(41-50)Online publication date: 24-Aug-2011
  • (2011)Tuple Spaces in Hardware for Accelerated Implicit RoutingProceedings of the 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and PhD Forum10.1109/IPDPS.2011.138(166-173)Online publication date: 16-May-2011
  • (2007)DRLindaProceedings of the 8th international conference on E-commerce and web technologies10.5555/1780034.1780063(212-221)Online publication date: 3-Sep-2007
  • (2007)DRLinda: A Distributed Message Broker for Collaborative Interactions Among Business ProcessesE-Commerce and Web Technologies10.1007/978-3-540-74563-1_21(212-221)Online publication date: 2007
  • (2006)RLindaProceedings of the 7th international conference on E-Commerce and Web Technologies10.1007/11823865_19(183-192)Online publication date: 5-Sep-2006

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media