TY  - CHAP
U1  - Konferenzveröffentlichung
A1  - Kehrer, Stefan
A1  - Blochinger, Wolfgang
ED  - Méndez Muñoz, Victor
T1  - TASKWORK: a cloud-aware runtime system for elastic task-parallel HPC applications
T2  - CLOSER 2019 : proceedings of the 9th International Conference on Cloud Computing and Services Science : Heraklion, Crete, Greece, May 2-4, 2019
N2  - With the capability of employing virtually unlimited compute resources, the cloud evolved into an attractive execution environment for applications from the High Performance Computing (HPC) domain. By means of elastic scaling, compute resources can be provisioned and decommissioned at runtime. This gives rise to a new concept in HPC: Elasticity of parallel computations. However, it is still an open research question to which extent HPC applications can benefit from elastic scaling and how to leverage elasticity of parallel computations. In this paper, we discuss how to address these challenges for HPC applications with dynamic task parallelism and present TASKWORK, a cloud-aware runtime system based on our findings. TASKWORK enables the implementation of elastic HPC applications by means of higher level development frameworks and solves corresponding coordination problems based on Apache ZooKeeper. For evaluation purposes, we discuss a development framework for parallel branch-and-bound based on TASKWORK, show how to implement an elastic HPC application, and report on measurements with respect to parallel efficiency and elastic scaling.
KW  - cloud computing
KW  - high performance computing
KW  - task parallelism
KW  - elasticity of parallel computations
Y1  - 2019
UN  - https://nbn-resolving.org/urn:nbn:de:bsz:rt2-opus4-23000
U6  - https://doi.org/10.5220/0007795501980209
DO  - https://doi.org/10.5220/0007795501980209
SP  - 198
EP  - 209
S1  - 12
PB  - Science and Technology Publications
CY  - Setúbal, Portugal
ER  -