Simulation of Large-Scale HPC Storage Systems: Challenges and Methodologies - PEPR NumPEx
Communication Dans Un Congrès Année : 2024

Simulation of Large-Scale HPC Storage Systems: Challenges and Methodologies

Julien Monniot
Henri Casanova
  • Fonction : Auteur
  • PersonId : 841811
Gabriel Antoniu

Résumé

As the scale of production HPC platforms increases, so does the computing and I/O performance gap, exacerbating the storage bottleneck. High-performance storage systems have been developed to alleviate this bottleneck, but many questions remain concerning their architecture, implementation, and configuration. Answering these questions via experimental campaigns proves arduous. First, some answers are required before deploying the system. Second, once a system hits production the experimental scope is limited by the system's specific configuration and by constraints of production use. In this work we identify challenges posed by the design and validation of a storage simulator. We then propose solutions implemented in FIVES, a simulator of HPC workloads on platforms that comprise a parallel file system. We show how our simulator can be instantiated and calibrated for the accurate simulation of a production Lustre deployment.
Fichier principal
Vignette du fichier
Simulation_based_Study_of_a_Large_Scale_Storage_System-2.pdf (4.33 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04784808 , version 1 (15-11-2024)

Licence

Identifiants

  • HAL Id : hal-04784808 , version 1

Citer

Julien Monniot, François Tessier, Henri Casanova, Gabriel Antoniu. Simulation of Large-Scale HPC Storage Systems: Challenges and Methodologies. HiPC 2024 - 31st IEEE International Conference on High Performance Computing, Data, and Analytics, Dec 2024, Bangalore, India. pp.1-11. ⟨hal-04784808⟩
31 Consultations
13 Téléchargements

Partager

More