SABO: Dynamic MPI+OpenMP Resource Balancer - CEA - Commissariat à l’énergie atomique et aux énergies alternatives Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

SABO: Dynamic MPI+OpenMP Resource Balancer

Cassandra Rocha Barbosa
  • Fonction : Auteur
Pierre Lemarinier
  • Fonction : Auteur
  • PersonId : 1379994
Guillaume Papauré
  • Fonction : Auteur
  • PersonId : 1379995
Marc Pérache
  • Fonction : Auteur
  • PersonId : 871097

Résumé

Scientific parallel applications often use MPI for inter-node communications and OpenMP for intra-node orches-tration. Parallel applications such as particle transport, seismic wave propagation simulator, or Finite-Element applications often exhibit workload imbalance due to their nature of ongoing data movement. These applications usually develop software balancing strategies triggered when some imbalance thresholds are detected to reduce this imbalance. These developments are complex to implement and impact the entire distributed applications' performance by synchronizing and exchanging the load over the network. This paper proposes a method to dynamically detect load imbalance and balance the computation by redistributing OpenMP threads between MPI processes local to the node. With minimal impact on the applications' codes, we demonstrate how this technique can improve the overall applications' performance up to 28% on MiniFE, 17 % on Quicksilver, and 3 % on Ondes3D. We also present its impact when executing multiple nodes and our proposed approach's limitations.

Mots clés

Fichier principal
Vignette du fichier
ipdrm22.pdf (308.92 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY - Paternité

Dates et versions

cea-04566213 , version 1 (02-05-2024)

Licence

Paternité

Identifiants

Citer

Cassandra Rocha Barbosa, Pierre Lemarinier, Guillaume Papauré, Marc Pérache, Michaël Krajecki. SABO: Dynamic MPI+OpenMP Resource Balancer. 2022 IEEE/ACM Fifth Annual Workshop on Emerging Parallel and Distributed Runtime Systems and Middleware (IPDRM), Nov 2022, Dallas (Texas), United States. pp.1-8, ⟨10.1109/IPDRM56689.2022.00006⟩. ⟨cea-04566213⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More