research-article

Cost-aware function migration in heterogeneous systems

Authors:

Mario Kicherer,

Wolfgang KarlAuthors Info & Claims

HiPEAC '11: Proceedings of the 6th International Conference on High Performance and Embedded Architectures and Compilers

Pages 137 - 145

https://doi.org/10.1145/1944862.1944883

Published: 24 January 2011 Publication History

Abstract

Today's approaches towards heterogeneous computing rely on either the programmer or dedicated programming models to efficiently integrate heterogeneous components. In this work, we propose an adaptive cost-aware function-migration mechanism built on top of a light-weight hardware abstraction layer. With this mechanism, the highly dynamic task of choosing the most beneficial processing unit will be hidden from the programmer while causing only minor variation in the work and program flow. The migration mechanism transparently adapts to the current workload and system environment without the necessity of JIT compilation or binary translation.

Evaluation shows that our approach successfully adapts to new circumstances and predicts the most beneficial processing unit (PU). Through fine-grained PU selection, our solution achieves a speedup of up to 2.27 for the average kernel execution time but introduces only a marginal overhead in case its services are not required.

References

[1]

Advanced Micro Devices, Inc. ATI Stream Technology. Online, 2010. http://www.amd.com/stream/.

[2]

C. Augonnet, S. Thibault, R. Namyst, and P.-A. Wacrenier. Starpu: A unified platform for task scheduling on heterogeneous multicore architectures. In Euro-Par '09: Proceedings of the 15th International Euro-Par Conference on Parallel Processing, pages 863--874, Berlin, Heidelberg, 2009. Springer-Verlag.

Digital Library

[3]

E. Ayguade, R. M. Badia, D. Cabrera, A. Duran, M. Gonzalez, F. Igual, D. Jimenez, J. Labarta, X. Martorell, R. Mayo, J. M. Perez, and E. S. Quintana-Ortí. A proposal to extend the openmp tasking model for heterogeneous architectures. In IWOMP '09: Proceedings of the 5th International Workshop on OpenMP, pages 154--167, Berlin, Heidelberg, 2009. Springer-Verlag.

Digital Library

[4]

M. Becchi and P. Crowley. Dynamic thread assignment on heterogeneous multiprocessor architectures. In CF '06: Proceedings of the 3rd conference on Computing frontiers, pages 29--40, New York, NY, USA, 2006. ACM.

Digital Library

[5]

P. Bellens, J. M. Perez, R. M. Badia, and J. Labarta. Cellss: a programming model for the cell be architecture. In SC '06: Proceedings of the 2006 ACM/IEEE conference on Supercomputing, page 86, New York, NY, USA, 2006. ACM.

Digital Library

[6]

R. Buchty, M. Kicherer, D. Kramer, and W. Karl. An embrace-and-extend approach to managing the complexity of future heterogeneous systems. In SAMOS '09: Proceedings of the 9th International Workshop on Embedded Computer Systems: Architectures, Modeling, and Simulation, pages 227--236, Berlin, Heidelberg, 2009. Springer-Verlag.

Digital Library

[7]

R. Buchty, D. Kramer, M. Kicherer, and W. Karl. A light-weight approach to dynamical runtime linking supporting heterogenous, parallel, and reconfigurable architectures. In Architecture of Computing Systems,- ARCS 2009, volume 5455/2009 of Lecture Notes in Computer Science, pages 60--71. Springer Berlin / Heidelberg, February 2009.

[8]

K. Group. OpenCL website. http://khronos.org/opencl/.

[9]

V. J. Jiménez, L. Vilanova, I. Gelado, M. Gil, G. Fursin, and N. Navarro. Predictive runtime code scheduling for heterogeneous architectures. In HiPEAC '09: Proceedings of the 4th International Conference on High Performance Embedded Architectures and Compilers, pages 19--33, Berlin, Heidelberg, 2009. Springer-Verlag.

Digital Library

[10]

M. Kicherer, F. Nowak, R. Buchty, and W. Karl. Extending a light-weight runtime system by dynamic instrumentation for performance evaluation. In M. Beigl and F. J. Cyzorla-Almeida, editors, ARCS 2010 Workshop Proceedings, pages 279--284. VDE, February 2010.

[11]

R. Kumar, D. M. Tullsen, P. Ranganathan, N. P. Jouppi, and K. I. Farkas. Single-isa heterogeneous multi-core architectures for multithreaded workload performance. In ISCA '04: Proceedings of the 31st annual international symposium on Computer architecture, page 64, Washington, DC, USA, 2004. IEEE Computer Society.

Digital Library

[12]

D. M. Kunzman and L. V. Kalé. Towards a framework for abstracting accelerators in parallel applications: experience with cell. In SC '09: Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, pages 1--12, New York, NY, USA, 2009. ACM.

Digital Library

[13]

S. Lee, S.-J. Min, and R. Eigenmann. Openmp to gpgpu: a compiler framework for automatic translation and optimization. In PPoPP '09: Proceedings of the 14th ACM SIGPLAN symposium on Principles and practice of parallel programming, pages 101--110, New York, NY, USA, 2009. ACM.

Digital Library

[14]

M. D. Linderman, J. D. Collins, H. Wang, and T. H. Meng. Merge: a programming model for heterogeneous multi-core systems. In ASPLOS XIII: Proceedings of the 13th international conference on Architectural support for programming languages and operating systems, pages 287--296, New York, NY, USA, 2008. ACM.

Digital Library

[15]

C.-K. Luk, S. Hong, and H. Kim. Qilin: exploiting parallelism on heterogeneous multiprocessors with adaptive mapping. In MICRO 42: Proceedings of the 42nd Annual IEEE/ACM International Symposium on Microarchitecture, pages 45--55, New York, NY, USA, 2009. ACM.

Digital Library

[16]

Nvidia Corp. CUDA Zone. 2010. http://www.nvidia.com/cuda/.

[17]

K. O'Brien, K. O'Brien, Z. Sura, T. Chen, and T. Zhang. Supporting openmp on cell. Int. J. Parallel Program., 36(3):289--311, 2008.

Digital Library

[18]

P. H. Wang, J. D. Collins, G. N. Chinya, H. Jiang, X. Tian, M. Girkar, N. Y. Yang, G.-Y. Lueh, and H. Wang. Exochi: architecture and programming environment for a heterogeneous multi-core multithreaded system. In PLDI '07: Proceedings of the 2007 ACM SIGPLAN conference on Programming language design and implementation, pages 156--166, New York, NY, USA, 2007. ACM.

Digital Library

Cited By

Becker TKarl WSchüle TEbeling WPöschel T(2019)Evaluating Dynamic Task Scheduling in a Task-Based Runtime System for Heterogeneous ArchitecturesLectures on Quantum Statistics10.1007/978-3-030-18656-2_11(142-155)Online publication date: 25-Apr-2019
https://doi.org/10.1007/978-3-030-18656-2_11
Dastgeer UKessler C(2018)Performance-aware composition framework for GPU-based systemsThe Journal of Supercomputing10.1007/s11227-014-1105-171:12(4646-4662)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1007/s11227-014-1105-1
Dastgeer ULi LKessler C(2018)The PEPPHER composition toolComputing10.1007/s00607-013-0371-896:12(1195-1211)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1007/s00607-013-0371-8
Show More Cited By

Index Terms

Cost-aware function migration in heterogeneous systems
1. Computer systems organization
  1. Architectures
    1. Other architectures
      1. Heterogeneous (hybrid) systems
2. Software and its engineering
  1. Software notations and tools
    1. Compilers
      1. Runtime environments

Recommendations

Seamlessly portable applications: Managing the diversity of modern heterogeneous systems
Special Issue on High-Performance Embedded Architectures and Compilers

Nowadays, many possible configurations of heterogeneous systems exist, posing several new challenges to application development: different types of processing units usually require individual programming models with dedicated runtime systems and ...
Affinity and Conflict-Aware Placement of Virtual Machines in Heterogeneous Data Centers
ISADS '15: Proceedings of the 2015 IEEE Twelfth International Symposium on Autonomous Decentralized Systems

Virtual machine placement (VMP) problem has been a key issue in IaaS/PaaS cloud infrastructures. Many recent works on VMP prove that inter-VM relations such as memory share, traffic dependency and resource competition should be seriously considered to ...
Towards cost-aware VM migration to maximize the profit in federated clouds
Abstract
Federated cloud has emerged as a cost-effective and scalable platform for multiple cloud providers to collaborate in serving the growing demand for cloud resources. In a federation, the major concern for each cloud provider is to ...
Highlights
- Model VM cost and the migration performance metrics in a federated cloud.
- ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

HiPEAC '11: Proceedings of the 6th International Conference on High Performance and Embedded Architectures and Compilers

January 2011

226 pages

ISBN:9781450302418

DOI:10.1145/1944862

General Chairs:
Manolis Katevenis
FORTH-ICS and U.Crete, Greece
,
Margaret Martonosi
Princeton University
,
Program Chairs:
Christos Kozyrakis
Stanford University
,
Olivier Temam
INRIA, France

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

HiPEAC: HiPEAC Network of Excellence

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 January 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HIPEAC '11

Sponsor:

HiPEAC

HIPEAC '11: International Conference on High-Performance and Embedded Architectures and Compilers

January 24 - 26, 2011

Heraklion, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
354
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Becker TKarl WSchüle TEbeling WPöschel T(2019)Evaluating Dynamic Task Scheduling in a Task-Based Runtime System for Heterogeneous ArchitecturesLectures on Quantum Statistics10.1007/978-3-030-18656-2_11(142-155)Online publication date: 25-Apr-2019
https://doi.org/10.1007/978-3-030-18656-2_11
Dastgeer UKessler C(2018)Performance-aware composition framework for GPU-based systemsThe Journal of Supercomputing10.1007/s11227-014-1105-171:12(4646-4662)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1007/s11227-014-1105-1
Dastgeer ULi LKessler C(2018)The PEPPHER composition toolComputing10.1007/s00607-013-0371-896:12(1195-1211)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1007/s00607-013-0371-8
Delporte BRigamonti RDassatti A(2016)HPA: An opportunistic approach to embedded energy efficiency2016 International Conference on High Performance Computing & Simulation (HPCS)10.1109/HPCSim.2016.7568415(792-799)Online publication date: Jul-2016
https://doi.org/10.1109/HPCSim.2016.7568415
Dastgeer UKessler C(2016)Smart Containers and Skeleton Programming for GPU-Based SystemsInternational Journal of Parallel Programming10.1007/s10766-015-0357-644:3(506-530)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1007/s10766-015-0357-6
Hansson EKessler C(2014)Global Optimization of Execution Mode Selection for the Reconfigurable PRAM-NUMA Multicore Architecture REPLICAProceedings of the 2014 Second International Symposium on Computing and Networking10.1109/CANDAR.2014.72(322-328)Online publication date: 10-Dec-2014
https://dl.acm.org/doi/10.1109/CANDAR.2014.72
Karnagel THabich DSchlegel BLehner W(2014)Heterogeneity-Aware Operator Placement in Column-Store DBMSDatenbank-Spektrum10.1007/s13222-014-0167-914:3(211-221)Online publication date: 12-Sep-2014
https://doi.org/10.1007/s13222-014-0167-9
Dastgeer UKessler C(2013)A Framework for Performance-Aware Composition of Applications for GPU-Based SystemsProceedings of the 2013 42nd International Conference on Parallel Processing10.1109/ICPP.2013.83(698-707)Online publication date: 1-Oct-2013
https://dl.acm.org/doi/10.1109/ICPP.2013.83
Kicherer MNowak FBuchty RKarl W(2012)Seamlessly portable applicationsACM Transactions on Architecture and Code Optimization10.1145/2086696.20867218:4(1-20)Online publication date: 26-Jan-2012
https://dl.acm.org/doi/10.1145/2086696.2086721
Dastgeer ULi LKessler C(2012)The PEPPHER Composition ToolProceedings of the 2012 SC Companion: High Performance Computing, Networking Storage and Analysis10.1109/SC.Companion.2012.97(711-720)Online publication date: 10-Nov-2012
https://dl.acm.org/doi/10.1109/SC.Companion.2012.97
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten