Algorithmic enablers for compact neural network topology hardware design: review and trends - CEA - Commissariat à l’énergie atomique et aux énergies alternatives Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Algorithmic enablers for compact neural network topology hardware design: review and trends

Résumé

This paper reports the main State-Of-The-Art algorithmic enablers for compact Neural Network topology design, while relying on basic numerical experiments. Embedding insensor intelligence to perform inference tasks generally requires a proper definition of a Neural Network architecture dedicated to specific purposes under Hardware limitations. Hardware design constraints known as power consumption, silicon surface, latency and maximum clock frequency cap available resources related to the topology, i.e., memory capacity and algorithmic complexity. We propose to categorize into 4 types the algorithmic enablers that force the hardware constraints as low as possible while keeping the accuracy as high as possible. First, Dimensionality Reduction (DR) is used to reduce memory needs thanks to predefined, hardware-coded patterns. Secondly, low-precision Quantization with Normalization (QN) can both simplify hardware components as well as limiting overall data storage. Thirdly, Connectivity Pruning (CP) involves an improvement against over-fitting while limiting needless computations. Finally, during the inference at the feed-forward pass, a Dynamical Selective Execution (DSE) of topology parts can be performed to limit the activation of the entire topology, therefore reducing the overall power consumption.
Fichier principal
Vignette du fichier
ML_levers.pdf (374.87 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

cea-04555846 , version 1 (23-04-2024)

Identifiants

Citer

William Guicquero, Arnaud Verdant. Algorithmic enablers for compact neural network topology hardware design: review and trends. ISCAS 2020 - 2020 IEEE International Symposium on Circuits and Systems, Oct 2020, Seville, Spain. ⟨10.1109/ISCAS45731.2020.9181005⟩. ⟨cea-04555846⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More