G2N2: Lightweight event stream classification with GRU graph neural networks - CEA - Commissariat à l’énergie atomique et aux énergies alternatives Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

G2N2: Lightweight event stream classification with GRU graph neural networks

Résumé

Event camera pixels efficiently encode visual information through triggered events, offering advantages in temporal detail, dynamic range, and data reduction. However, the optimal machine learning method for leveraging these characteristics remains unclear. Existing approaches often convert events into 2D frames, losing crucial time-domain information. A promising alternative is event-graph neural networks, but they suffer from computational intensity and limited temporal dependencies. As a solution, we propose to combine the recently proposed lightweight event-graph neural network HUGNet with gated recurrent units to model temporal dependencies between the features extracted by HUGNet. We benchmark our model against other event-graph and convolutional neural network based approaches on the challenging DVS-Lip dataset (spoken word classification). We find that not only does our method outperform state of the art approaches for similar model sizes, but that, relative to the convolutional models, the number of calculation operations per second was reduced by 81%. Furthermore, we introduce a new event-data augmentation technique that boosts by up to 7.4% the performance of both event-graph and convolutional neural networks on this task.
Fichier principal
Vignette du fichier
0660.pdf (843.84 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

cea-04321175 , version 1 (04-12-2023)

Identifiants

  • HAL Id : cea-04321175 , version 1

Citer

Thomas Mesquida, Manon Dampfhoffer, Thomas Dalgaty, Pascal Vivet, Amos Sironi, et al.. G2N2: Lightweight event stream classification with GRU graph neural networks. BMVC 2023 - The 34th British Machine Vision Conference, Nov 2023, Aberdeen, United Kingdom. pp.660. ⟨cea-04321175⟩
68 Consultations
32 Téléchargements

Partager

Gmail Facebook X LinkedIn More