Unsupervised Unknown Unknown Detection in Active Learning - CEA - Commissariat à l’énergie atomique et aux énergies alternatives Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Unsupervised Unknown Unknown Detection in Active Learning

Résumé

Unknown unknowns in machine learning signify data points outside the distribution of known data and constitute blindspots of traditional machine learning models. As these data points typically involve rare and unexpected scenarios, the models may make wrong predictions, potentially leading to catastrophic situations. Detecting “unknown unknowns" is essential to ensure machine learning systems’ reliability and robustness and avoid unexpected failures in real-world safety-critical applications. This paper proposes an Unsupervised Unknown Unknown Detection in Active Learning (U3DAL) to detect “unknown unknowns" in a stream-based data setting using active learning data selection mechanisms that rely on uncertainty and diversity. The effectiveness of the proposed approach is validated on the Imagenet-A dataset and across different metrics, demonstrating that it outperforms existing methods for detecting “unknown unknowns".
Fichier principal
Vignette du fichier
paper_12.pdf (1.14 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Licence : CC BY - Paternité

Dates et versions

cea-04483849 , version 1 (29-02-2024)

Licence

Paternité

Identifiants

  • HAL Id : cea-04483849 , version 1

Citer

Prajit T Rajendran, Huascar Espinoza, Agnes Delaborde, Chokri Mraidha. Unsupervised Unknown Unknown Detection in Active Learning. The IJCAI-2023 AISafety and SafeRL Joint Workshop, Aug 2023, Macao, China. ⟨cea-04483849⟩
18 Consultations
29 Téléchargements

Partager

Gmail Facebook X LinkedIn More