skip to main content
10.1145/1216993.1217019acmconferencesArticle/Chapter ViewAbstractPublication PagesicpeConference Proceedingsconference-collections
Article

Engineering grid applications and middleware for high performance

Published: 05 February 2007 Publication History

Abstract

Meeting QoS objectives of applications while maintaining high system utilization is a challenging task in multi-institutional Grids. In this paper, we effectively engineer Grid applications and resource management middleware for achieving user satisfaction and high resource utilizations. The paper presents a complete framework based on advance reservations (ARs) for resource management in Grids. The framework is capable of providing QoS guarantees to applications while maintaining high resource utilizations. The paper focuses on the scheduling component of the framework and presents a novel heuristic-based algorithm, Grid Scheduling with Deadlines (GSD), for an NP-Complete problem of scheduling ARs with laxities on a shared resource. GSD can be configured with the help of pluggable strategies to adapt to various workload conditions and needs of the system. The paper studies with the aid of an extensive set of experiments the effect of various workload and system parameters on system performance. It is not always possible to accurately predict the runtimes of the jobs. The paper discusses the impact of error in user-estimated runtimes on system performance and investigates strategies to avoid substandard performance resulting from such inaccuracies. Experimental results demonstrate the efficacy of our methodology.

References

[1]
S. Camorlinga, B. Schofield, "Modeling of Workflow-Engaged Networks on Radiology Transfers Across a Metro Network," in IEEE Transactions on Information Technology in Biomedicine, 10(2): 275--281, April 2006.
[2]
L. Weigang, M. V. P. Dib, D. A. Cardoso, "Grid Service Agents for Real Time Traffic Synchronization," in the Proceedings. of the Int'l Conference on Web Intelligence, September 2004.
[3]
P. R Hobson, "Providing a real-time Grid for distributed instrumentation," White Paper, 2005. http://www.gridcc.org/
[4]
A. A. Sawchuk, E. Chew, R. Zimmermann, C. Papadopoulos, C. Kyriakakis, "From Remote Media Immersion to Distributed Immersive Performance," in the Proceedings of the ACM Workshop on Experiential Telepresence, November 2003.
[5]
I. Foster, C. Kesselman, C. Lee, R. Lindell, K. Nahrstedt, A. Roy, "A Distributed Resource Management Architecture that Supports Advance Reservations and Co-Allocation," in the Proceedings of the 7th Int'l Workshop on QoS, May 1999.
[6]
T. Lavian, S. Merrill, H. Cohen, D. Hoang, J. Mambretti, S. Figueira, D. Cutrell, S. Naiksatam, F. Travostino, "A Grid Network Service Architecture for Dynamic Optical Networks," submitted to the Journal of Grid Computing.
[7]
U. Farooq, S. Majumdar, E. W. Parsons, "Dynamic Scheduling of Lightpaths in Lambda Grids," in the Proceedings of the 2nd IEEE Int'l Workshop on Networks for Grid Applications, October 2005.
[8]
A. Sulistio, R. Buyya, "A Grid Simulation Infrastructure Supporting Advance Reservation," in the Proceedings of the 16th Int'l Conf. on Parallel and Distributed Computing and Systems, November 2004.
[9]
W. Smith, I. Foster, V. Taylor, "On Scheduling with Advanced Reservations," in the Proceedings of the 14th Int'l Parallel and Distributed Processing Symposium, May 2000.
[10]
Connie U. Smith, Software Performance Engineering, 2002.
[11]
U. Farooq, S. Majumdar, E. W. Parsons, "A Framework to Achieve Guaranteed QoS for Applications and High System Performance in Multi-Institutional Grid Computing", in the Proceedings of the 35th Int'l Conference on Parallel Processing, August 2006.
[12]
F. A. B. da Silva, I. D. Scherson, "Improvements in Parallel Job Scheduling Using Gang Service," in the Proceedings of the 1999 Int'l Symposium on Parallel Architectures, 1999.
[13]
S. Figueira, N. Kaushik, S. Naiksatam, S. A. Chiappari, N. Bhatnagar, "Advance Reservation of Light-paths in Optical-Network Based Grids," in the Proceedings of 1st Int'l Workshop on Networks for Grid, October 2004.
[14]
I. Foster, A. Roy, V. Sander, "A Quality of Service Architecture that Combines Resource Reservation and Application Adaptation," in the Proceedings of the 8th Int'l Workshop on Quality of Service, June 2000.
[15]
The Maui Scheduling System. http://www.mhpcc.edu/maui.
[16]
M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, 1979.
[17]
U. Farooq, S. Majumdar, E. W. Parsons, "Efficiently Scheduling Advance Reservations in Grids," Technical Report SCE-05-14, Dept. of Systems & Computer Engineering, Carleton University, Ottawa, Canada, August 2005.
[18]
S. Funk, J. Goossens, S. Baruah, "On-Line Scheduling on Uniform Multiprocessors," in the Proceedings of the 22nd IEEE Real-Time Systems Symposium, December 2001.
[19]
Y. Zhang, A. Sivasubramaniam, "Scheduling Best-effort and Real-time Pipelined Applications on Time-Shared Clusters," in the Proceedings of the 13th ACM Symposium on Parallel Algorithms and Architectures, July 2001.
[20]
K. Ramamritham, J. A. Stankovic, P. F. Shiah, "Efficient Scheduling Algorithms for Real-Time Multiprocessor Systems," in IEEE Transactions on Parallel and Distributed Systems, 1(2): 184--194, April 1990.
[21]
P. Dinda, "Online Prediction of Runtime of Tasks," in the Proceedings of the 10th IEEE Int'l Symposium on High Performance Distributed Computing, August 2001.
[22]
W. Smith, Improving Resource Selection and Scheduling Using Predictions," in Grid Resource Management, State of the Art and Future Trends, pp. 237--253, 2003.
[23]
U. Farooq, S. Majumdar, E. Parsons, Scheduling Advance Reservations on Shared Grid Resources", Technical Report SCE-06-13, Dept. of Systems & Computer Engineering, Carleton University, Ottawa, Canada, July 2006.
[24]
U. Lublin, D. G. Feitelson, The Workload on Parallel Supercomputers: Modeling the Characteristics of Rigid Jobs," in Journal of Parallel and Distributed Computing, 63(11): 1105--1122, November 2003.

Cited By

View all
  • (2012)Business-driven short-term management of a hybrid IT infrastructureJournal of Parallel and Distributed Computing10.1016/j.jpdc.2011.11.00172:2(106-119)Online publication date: 1-Feb-2012
  • (2009)Achieving efficiency, quality of service and robustness in multi-organizational GridsJournal of Systems and Software10.1016/j.jss.2008.03.06482:1(23-38)Online publication date: 1-Jan-2009

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WOSP '07: Proceedings of the 6th international workshop on Software and performance
February 2007
216 pages
ISBN:1595932976
DOI:10.1145/1216993
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 February 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. QoS in grids
  2. grid computing
  3. grid scheduling
  4. matchmaking
  5. resource management
  6. service oriented architecture

Qualifiers

  • Article

Conference

WOSP07
WOSP07: Workshop on Software and Performance
February 5 - 8, 2007
Buenes Aires, Argentina

Acceptance Rates

Overall Acceptance Rate 149 of 241 submissions, 62%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2012)Business-driven short-term management of a hybrid IT infrastructureJournal of Parallel and Distributed Computing10.1016/j.jpdc.2011.11.00172:2(106-119)Online publication date: 1-Feb-2012
  • (2009)Achieving efficiency, quality of service and robustness in multi-organizational GridsJournal of Systems and Software10.1016/j.jss.2008.03.06482:1(23-38)Online publication date: 1-Jan-2009

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media