Effect of Tuned Parameters on a LSA Multiple Choice Questions Answering Model - Archive ouverte HAL
Article Dans Une Revue Behavior Research Methods Année : 2009

Effect of Tuned Parameters on a LSA Multiple Choice Questions Answering Model

Alain Lifchitz
  • Fonction : Auteur
  • PersonId : 830776
Guy Denhière
  • Fonction : Auteur
  • PersonId : 859252

Résumé

This paper presents the current state of a work in progress, whose objective is to better understand the effects of factors that significantly influence the performance of Latent Semantic Analysis (LSA). A difficult task, which consists in answering (French) biology Multiple Choice Questions, is used to test the semantic properties of the truncated singular space and to study the relative influence of main parameters. A dedicated software has been designed to fine tune the LSA semantic space for the Multiple Choice Questions task. With optimal parameters, the performances of our simple model are quite surprisingly equal or superior to those of 7th and 8th grades students. This indicates that semantic spaces were quite good despite their low dimensions and the small sizes of training data sets. Besides, we present an original entropy global weighting of answers' terms of each question of the Multiple Choice Questions which was necessary to achieve the model's success.
Fichier principal
Vignette du fichier
eLSA1-brm20.pdf (198.33 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00336126 , version 1 (01-11-2008)
hal-00336126 , version 2 (17-11-2008)
hal-00336126 , version 3 (14-05-2009)

Identifiants

Citer

Alain Lifchitz, Sandra Jhean-Larose, Guy Denhière. Effect of Tuned Parameters on a LSA Multiple Choice Questions Answering Model. Behavior Research Methods, 2009, 41 (4), pp.1201--1209. ⟨10.3758/BRM.41.4.1201⟩. ⟨hal-00336126v3⟩
492 Consultations
1847 Téléchargements

Altmetric

Partager

More