Time series modeling with pruned multi-layer perceptron and 2-stage damped least-squares method - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2013

Time series modeling with pruned multi-layer perceptron and 2-stage damped least-squares method

Cyril Voyant
Wani W. Tamas
  • Fonction : Auteur
Christophe Paoli
Marc Muselli
  • Fonction : Auteur
  • PersonId : 841625
Marie Laure Nivet
  • Fonction : Auteur
  • PersonId : 865253
Gilles Notton
  • Fonction : Auteur
  • PersonId : 883974

Résumé

A Multi-Layer Perceptron (MLP) defines a family of artificial neural networks often used in TS modeling and forecasting. Because of its "black box" aspect, many researchers refuse to use it. Moreover, the optimization (often based on the exhaustive approach where "all" configurations are tested) and learning phases of this artificial intelligence tool (often based on the Levenberg-Marquardt algorithm; LMA) are weaknesses of this approach (exhaustively and local minima). These two tasks must be repeated depending on the knowledge of each new problem studied, making the process, long, laborious and not systematically robust. In this paper a pruning process is proposed. This method allows, during the training phase, to carry out an inputs selecting method activating (or not) inter-nodes connections in order to verify if forecasting is improved. We propose to use iteratively the popular damped least-squares method to activate inputs and neurons. A first pass is applied to 10% of the learning sample to determine weights significantly different from 0 and delete other. Then a classical batch process based on LMA is used with the new MLP. The validation is done using 25 measured meteorological TS and cross-comparing the prediction results of the classical LMA and the 2-stage LMA.
Fichier principal
Vignette du fichier
final_paper.pdf (452.73 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00850687 , version 1 (07-08-2013)

Identifiants

Citer

Cyril Voyant, Wani W. Tamas, Christophe Paoli, Aurélia Balu, Marc Muselli, et al.. Time series modeling with pruned multi-layer perceptron and 2-stage damped least-squares method. International Conference on Mathematical Modeling in Physical Sciences, IC-MSQUARE, Sep 2013, Czech Republic. pp.1. ⟨hal-00850687⟩
140 Consultations
107 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More