Communication Dans Un Congrès Année : 2012

A Rough Set Formalization of Quantitative Evaluation with Ambiguity

Résumé

In this paper, we present the founding elements of a formal model of the evaluation paradigm in natural language processing. We propose an abstract model of objective quantitative evaluation based on rough sets, as well as the notion of potential performance space for describing the performance variations corresponding to the ambiguity present in hypothesis data produced by a computer program, when comparing it to the reference data created by humans. A formal model of the evaluation paradigm will be useful for comparing evaluations protocols, investigating evaluation constraint relaxation and getting a better understanding of the evaluation paradigm, provided it is general enough to be able to represent any natural language processing task.

Fichier non déposé

Dates et versions

hal-02493912 , version 1 (28-02-2020)

Identifiants

  • HAL Id : hal-02493912 , version 1

Citer

Patrick Paroubek, Xavier Tannier. A Rough Set Formalization of Quantitative Evaluation with Ambiguity. LREC 2012 - 8th International Conference on Language Resources and Evaluation, 2012, Istanbul, Turkey. ⟨hal-02493912⟩
101 Consultations
0 Téléchargements

Partager

  • More