Evaluation in Discourse: a Corpus-Based Study - Archive ouverte HAL Access content directly
Journal Articles Dialogue & Discourse Year : 2016

Evaluation in Discourse: a Corpus-Based Study


This paper describes the CASOAR corpus, the first manually annotated corpus that explores the impact of discourse structure on sentiment analysis with a study of movie reviews in French and in English as well as letters to the editor in French. While annotating opinions at the expression, the sentence or the document level is a well-established task and relatively straightforward, discourse annotation remains diffcult, especially for non experts. Therefore, combining both annotations poses several methodological problems that we address here. We propose a multi-layered annotation scheme that includes: the complete discourse structure according to the Segmented Discourse Representation Theory, the opinion orientation of elementary discourse units and opinion expressions, and their associated features. We detail each layer, explore the interactions between them and discuss our results. In particular, we examine the correlation between discourse and semantic category of opinion expressions, the impact of discourse relations on both subjectivity and polarity analysis and the impact of discourse on the determination of the overall opinion of a document. Our results demonstrate that discourse is an important cue for sentiment analysis, at least for the corpus genres we have studied.


Fichier principal
Vignette du fichier
benamara_22186.pdf (797.31 Ko) Télécharger le fichier
Origin Publisher files allowed on an open archive

Dates and versions

hal-02354387 , version 1 (07-11-2019)


  • HAL Id : hal-02354387 , version 1
  • OATAO : 22186


Farah Benamara, Nicholas Asher, Yvette Yannick Mathieu, Vladimir Popescu, Baptiste Chardon. Evaluation in Discourse: a Corpus-Based Study. Dialogue & Discourse, 2016, 7 (1), pp.1-49. ⟨hal-02354387⟩
220 View
348 Download


Gmail Mastodon Facebook X LinkedIn More