A Factorial Study of Neural Network Learning from Differences for Regression - Archive ouverte HAL Access content directly
Conference Papers Year : 2022

A Factorial Study of Neural Network Learning from Differences for Regression

Mathieu D’aquin
Emmanuel Nauer
Jean Lieber

Abstract

For regression tasks, using neural networks in a supervised way typically requires to repeatedly (over several iterations called epochs) present a set of items described by a number of features and the expected value to the network, so that it can learn to predict those values from those features. Inspired by case-based reasoning, several previous studies have made the hypothesis that there could be some advantages in training such neural networks on differences between sets of features, to predict differences between values. To test such a hypothesis, we applied a systematic factorial study on seven datasets and variants of datasets. The goal is to understand the impact on the performance of a neural network trained on differences, as compared to one trained in the usual way, of parameters such as the size of the training set, the number of epochs of training or the number of similar cases retrieved. We find that learning from differences achieves similar or better results than the ones of a neural network trained in the usual way. Our most significant finding however is that, in all cases, difference-based networks start obtaining good results from a low number of epochs, compared to the one required by a neural network trained in the usual manner. In other words, they achieve similar results while requiring less training.
Fichier principal
Vignette du fichier
ICCBR_2022 (5).pdf (855.97 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03765220 , version 1 (31-08-2022)

Identifiers

Cite

Mathieu D’aquin, Emmanuel Nauer, Jean Lieber. A Factorial Study of Neural Network Learning from Differences for Regression. International Conference on Case-Based Reasoning, ICCBR 2022, Sep 2022, Nancy, France. pp.289-303, ⟨10.1007/978-3-031-14923-8_19⟩. ⟨hal-03765220⟩
100 View
61 Download

Altmetric

Share

Gmail Facebook X LinkedIn More