skip to main content
10.5555/1218112.1218327acmconferencesArticle/Chapter ViewAbstractPublication PageswscConference Proceedingsconference-collections
Article

Simulation of job scheduling for small scale clusters

Published: 03 December 2006 Publication History

Abstract

Despite growing popularity of small-scale clusters built out of off-the-shelf components, there has been little research on how these small-scale clusters behave under different scheduling policies. Batch scheduling policies with backfilling provide excellent space-sharing strategy for parallel jobs. However, as the performances of uniprocessor and symmetric multiprocessor have improved with timesharing scheduling strategies, it is intuitive that the performance of a cluster of PCs with distributed memory may also improve with time-sharing strategies, or a combination of time-sharing and space-sharing strategies. Apart from the batch scheduling policies, this research explores the possibilities of using synchronized time-sharing scheduling algorithms for clusters. This paper describes simulation of the Gang scheduling policies on top of an existing batch scheme. The simulation results indicate that time-sharing scheduler for clusters could exhibit superior performance over a batch policy.

References

[1]
Bode, B., D. M. Halstead, R. Kendall, and Z. Lei. 1999. The Portable Batch Scheduler and the Maui Scheduler on Linux Clusters. In Annual Technical Conference, USENIX 1999.
[2]
Choi, G. S., J. Kim, D. Ersoz, A. B. Yoo, and C. R. Das. 2004. Coscheduling in Clusters: Is It a Viable Alternative?, In Proceedings of Super Computing (SC).
[3]
Frachtenberg E., F. Petrini, S. Coll, and W. C. Feng. 2001. Gang Scheduling with Lightweight User-Level Communication. International Conference on Parallel Processing (ICPP) Workshops, pp. 339--348.
[4]
Góes, L. F. W., and C. A. P. S. Martins. 2004. Reconfigurable Gang Scheduling Algorithm. 10th Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP). LNCS.
[5]
Gonzalez Jr., Mario. 1997. Deterministic Processor Scheduling. ACM Computing Surveys, Vol.9, No. 3.
[6]
Hori, A., H. Tezuka, and Y. Ishikawa. 1998. Highly Efficient Gang Scheduling Implementation. In Proceedings of Supercomputing '98.
[7]
Lawson, B. G. and E. Smirni. 2002. Multiple-Queue Backfilling Scheduling with Priorities and Reservations of Parallel Systems. In Proceedings of 8th Job Scheduling Strategies for Parallel Processing.
[8]
MPI: Message Passing Interface. Available via <http://www.mpi-forum.org>.
[9]
Rajaei, H., and M. Dadfar. 2005. Job Scheduling in a Cluster Computing. In Proceedings of the 2005 American Society for Engineering Education Annual Conference. ASEE.
[10]
Rajaei, H., and M. Dadfar. 2006. Comparison of Backfilling Algorithms for Job Scheduling in Distributed Memory Parallel System. In Proceedings of the 2006 American Society for Engineering Education Annual Conference. ASEE.
[11]
Shmueli, E. and D. G. Feitelson. 2003. Backfilling with Lookahead to Optimize the Performance of Parallel Job Scheduling. Job Scheduling Strategies for Parallel Processing (JSSPP). Lecture Notes in Computer Science, 2862, Springer-Verlag, pp. 228--251.
[12]
Srinivasan, S., R. Kettimuthu, V. Subramani, and P. Sadayappan. 2002. Characterization of Backfilling Strategies for Parallel Job Scheduling. In Proceedings of IEEE International Conference on Parallel Processing Workshops, pages 514--519.
[13]
Talby, D., and D. G. Feitelson. 1999. Supporting Priorities and Improving Utilization of the IBM SP2 Scheduler Using Slack-based Backfilling. In Proceedings of the 13th IEEE International Parallel Processing Symposium, pp. 513.
[14]
Uwe, S., and Y. Ramin. 1998. Improving First-Come-First-Serve Job Scheduling by Gang Scheduling. Job Scheduling Strategies for Parallel Processing (JSSPP) pp. 180--198.
[15]
Wiseman, Y., and D. G. Feitelson. 2003. Paired Gang Scheduling. IEEE Transactions on Parallel and Distributed Systems. 14(6), pp. 581--592.
[16]
Zhang, Y., H. Franke, J. Moreira, and A. Sivasubrama-niam. 2003. An Integrated Approach to Parallel Scheduling Using Gang-Scheduling, Backfilling, and Migration. IEEE Transactions on Parallel and Distributed Systems. 14(3), pp. 236--247.

Cited By

View all
  • (2011)Hybrid reliable load balancing with MOSIX as middleware and its formal verification using process algebraFuture Generation Computer Systems10.1016/j.future.2010.12.00727:5(506-526)Online publication date: 1-May-2011

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WSC '06: Proceedings of the 38th conference on Winter simulation
December 2006
2429 pages
ISBN:1424405017

Sponsors

  • IIE: Institute of Industrial Engineers
  • ASA: American Statistical Association
  • IEICE ESS: Institute of Electronics, Information and Communication Engineers, Engineering Sciences Society
  • IEEE-CS\DATC: The IEEE Computer Society
  • SIGSIM: ACM Special Interest Group on Simulation and Modeling
  • NIST: National Institute of Standards and Technology
  • (SCS): The Society for Modeling and Simulation International
  • INFORMS-CS: Institute for Operations Research and the Management Sciences-College on Simulation

Publisher

Winter Simulation Conference

Publication History

Published: 03 December 2006

Check for updates

Qualifiers

  • Article

Conference

WSC06
Sponsor:
  • IIE
  • ASA
  • IEICE ESS
  • IEEE-CS\DATC
  • SIGSIM
  • NIST
  • (SCS)
  • INFORMS-CS
WSC06: Winter Simulation Conference 2006
December 3 - 6, 2006
California, Monterey

Acceptance Rates

WSC '06 Paper Acceptance Rate 177 of 252 submissions, 70%;
Overall Acceptance Rate 3,413 of 5,075 submissions, 67%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 07 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2011)Hybrid reliable load balancing with MOSIX as middleware and its formal verification using process algebraFuture Generation Computer Systems10.1016/j.future.2010.12.00727:5(506-526)Online publication date: 1-May-2011

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media