To Share or Not to Share: a case for MPI in Shared-Memory - Direction des applications militaires
Conference Papers Year : 2024

To Share or Not to Share: a case for MPI in Shared-Memory

Abstract

The evolution of parallel computing architectures presents new challenges for developing efficient parallelized codes. The emergence of heterogeneous systems has given rise to multiple programming models, each requiring careful adaptation to maximize performance. In this context, we propose reevaluating memory layout designs for computational tasks within larger nodes by comparing various architectures. To gain insight into the performance discrepancies between shared memory and shared-address space settings, we systematically measure the bandwidth between cores and sockets using different methodologies. Our findings reveal significant differences in performance, suggesting that MPI running inside UNIX processes may not fully utilize its intranode bandwidth potential. In light of our work in the MPC thread-based MPI runtime, which can leverage shared memory to achieve higher performance due to its optimized layout, we advocate for enabling the use of shared memory within the MPI standard.
Fichier principal
Vignette du fichier
To_Share_or_Not_to_Share__a_case_for_MPI_in_Shared_Memory-2.pdf (558.11 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

cea-04672564 , version 1 (19-08-2024)

Identifiers

  • HAL Id : cea-04672564 , version 1

Cite

Julien Adam, Jean-Baptiste Besnard, Adrien Roussel, Julien Jaeger, Patrick Carribault, et al.. To Share or Not to Share: a case for MPI in Shared-Memory. EuroMPI 2024, Sep 2024, Perth (Australia), Australia. ⟨cea-04672564⟩
47 View
22 Download

Share

More