What is hidden behind the Sobolev kernels involved in the HSIC-ANOVA decomposition?
Résumé
In many industrial fields, the numerical simulators that model physical phenomena are very expensive from a computational viewpoint. In this context, only a very limited number of computer experiments can be planned. Statistical learning techniques helps build a surrogate model but this task becomes excessively challenging when the simulation code takes a high number (dozens, if not hundreds) of uncertain parameters as input variables. To escape from this deadlock, global sensitivity analysis (GSA) may be used as a tool for dimension reduction. In particular, the sensitivity measures which are based on the Hilbert-Schmidt independence criterion (HSIC) have been increasingly used over the past few years because they pave the way to several variable selection procedures. However, the so-called HSIC indices still suffer from their lack of interpretability, especially among non-specialists who rather ask for percentage-like indicators. To ease interpretation, HSIC-ANOVA indices have been recently introduced to recover a strict separation of main effects and interactions. This breakthrough was obtained after assuming mutual independence among input variables and provided that ANOVA kernels, such as Sobolev kernels, are used to estimate HSIC-ANOVA indices. In the literature, very little has been said about Sobolev kernels. In this talk, their feature maps are investigated in three different ways. Firstly, a simulation-based approach named kernel feature analysis (KFA) allows to distinguish different behaviors depending on the integer value given to their smoothness parameter. Secondly, the eigenvalue problem that goes with their Mercer decomposition is transformed into a Cauchy problem that can be solved in one specific case. Thirdly, a series expansion of their translation-invariant term discloses a fully analytical characterization of their reproducing kernel Hilbert spaces (RKHS). Based on those theoretical results, it can be proved that all Sobolev kernels are characteristic, which means HSIC-ANOVA indices are well-adapted association measures to detect independence among input-output pairs.
| Origine | Fichiers produits par l'(les) auteur(s) |
|---|---|
| Licence |
