Dedicated hardware accelerators for processing of sparse matrices and vectors: A survey - CEA - Commissariat à l’énergie atomique et aux énergies alternatives Accéder directement au contenu
Article Dans Une Revue ACM Transactions on Architecture and Code Optimization Année : 2024

Dedicated hardware accelerators for processing of sparse matrices and vectors: A survey

Résumé

Performance in scientific and engineering applications such as computational physics, algebraic graph problems or Convolutional Neural Networks (CNN), is dominated by the manipulation of large sparse matrices - matrices with a large number of zero elements. Specialized software using data formats for sparse matrices has been optimized for the main kernels of interest: SpMV and SpMSpM matrix multiplications, but due to the indirect memory accesses, the performance is still limited by the memory hierarchy of conventional computers. Recent work shows that specific hardware accelerators can reduce memory traffic and improve the execution time of sparse matrix multiplication, compared to the best software implementations. The performance of these sparse hardware accelerators depends on the choice of the sparse format, COO, CSR, etc, the algorithm, inner-product, outer-product, Gustavson, and many hardware design choices. In this article, we propose a systematic survey which identifies the design choices of state-of-the-art accelerators for sparse matrix multiplication kernels. We introduce the necessary concepts and then present, compare and classify the main sparse accelerators in the literature, using consistent notations. Finally, we propose a taxonomy for these accelerators to help future designers make the best choices depending of their objectives.
Fichier principal
Vignette du fichier
3640542.pdf (3.46 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

cea-04463323 , version 1 (16-02-2024)

Identifiants

Citer

Valentin Isaac Chassande, Adrian Evans, Yves Durand, Frédéric Rousseau. Dedicated hardware accelerators for processing of sparse matrices and vectors: A survey. ACM Transactions on Architecture and Code Optimization, 2024, 21 (2), pp.27. ⟨10.1145/3640542⟩. ⟨cea-04463323⟩
10 Consultations
17 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More