Effect of Tuned Parameters on a LSA Multiple Choice Questions Answering Model - Archive ouverte HAL Access content directly
Journal Articles Behavior Research Methods Year : 2009

Effect of Tuned Parameters on a LSA Multiple Choice Questions Answering Model

(1) , (2) , (2)
1
2
Alain Lifchitz
  • Function : Author
  • PersonId : 830776
Guy Denhière
  • Function : Author
  • PersonId : 855178

Abstract

This paper presents the current state of a work in progress, whose objective is to better understand the effects of factors that significantly influence the performance of Latent Semantic Analysis (LSA). A difficult task, which consists in answering (French) biology Multiple Choice Questions, is used to test the semantic properties of the truncated singular space and to study the relative influence of main parameters. A dedicated software has been designed to fine tune the LSA semantic space for the Multiple Choice Questions task. With optimal parameters, the performances of our simple model are quite surprisingly equal or superior to those of 7th and 8th grades students. This indicates that semantic spaces were quite good despite their low dimensions and the small sizes of training data sets. Besides, we present an original entropy global weighting of answers' terms of each question of the Multiple Choice Questions which was necessary to achieve the model's success.
Fichier principal
Vignette du fichier
eLSA1-brm20.pdf (198.33 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00336126 , version 1 (01-11-2008)
hal-00336126 , version 2 (17-11-2008)
hal-00336126 , version 3 (14-05-2009)

Identifiers

Cite

Alain Lifchitz, Sandra Jhean-Larose, Guy Denhière. Effect of Tuned Parameters on a LSA Multiple Choice Questions Answering Model. Behavior Research Methods, 2009, 41 (4), pp.1201--1209. ⟨10.3758/BRM.41.4.1201⟩. ⟨hal-00336126v3⟩
393 View
1653 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More