An hybrid method for feature selection based on multiobjective optimization and mutual information - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Journal of Informatics and Mathematical Sciences Année : 2015

An hybrid method for feature selection based on multiobjective optimization and mutual information

Mohamed Abadi
  • Fonction : Auteur
  • PersonId : 916252
SIC
Olivier Alata

Résumé

In this paper we propose a hybrid approach using mutual information and multi-objective optimization for feature subset selection problem. The hybrid aspect is due to the sequence of a filter method and a wrapper method in order to take advantages of both. The filter method reduces the exploration space by keeping subsets having good internal properties and the wrapper method chooses among the remaining subsets with a classification performances criterion. In the filter step, the subsets are evaluated in a multi-objective way to ensure diversity within the subsets. The evaluation is based on the mutual information to estimate the dependency between features and classes and the redundancy between features within the same subset. We kept the non-dominated (Pareto optimal) subsets for the second step. In the wrapper step, the selection is made according to the stability of the subsets regarding classification performances during learning stage on a set of classifiers to avoid the specialization of the selected subsets for a given classifiers. The proposed hybrid approach is experimented on a variety of reference data sets and compared to the classical feature selection methods FSDD and mRMR. The resulting algorithm outperforms these algorithms and the computation complexity remains acceptable even if it increases with regards to these two fast selection methods.
Fichier principal
Vignette du fichier
b_268-691-1-PB.pdf (1.32 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-01313378 , version 1 (04-03-2020)

Licence

Paternité

Identifiants

Citer

Grandchamp Enguerran, Mohamed Abadi, Olivier Alata. An hybrid method for feature selection based on multiobjective optimization and mutual information. Journal of Informatics and Mathematical Sciences, 2015, 7 (1), pp.21-48. ⟨10.26713/jims.v7i1.268⟩. ⟨hal-01313378⟩
168 Consultations
93 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More