Reports (Research Report) Year : 2016

Accounting for Chance Agreement in Gesture Elicitation Studies

Theophanis Tsandilas
Pierre Dragicevic

Abstract

The level of agreement among participants is a key aspect of gesture elicitation studies, and it is typically quantified by means of agreement rates (AR). We show that this measure is problematic, as it does not account for chance agreement. The problem of chance agreement has been extensively discussed in a range of scientific fields in the context of inter-rater reliability studies. We review chance-corrected agreement coefficients that are routinely used in inter-reliability studies and show how to apply them to gesture elicitation studies. We also discuss how to compute interval estimates for these coefficients and how to use them for statistical inference.
Fichier principal
Vignette du fichier
main.pdf (185.21 Ko) Télécharger le fichier
Vignette du fichier
Screen Shot 2016-11-29 at 16.08.16.png (10.08 Ko) Télécharger le fichier
Vignette du fichier
Screen Shot 2016-11-29 at 16.08.16.jpg (5.03 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Format Figure, Image
Origin Files produced by the author(s)
Format Figure, Image
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01267288 , version 1 (29-11-2016)

Licence

Identifiers

  • HAL Id : hal-01267288 , version 1

Cite

Theophanis Tsandilas, Pierre Dragicevic. Accounting for Chance Agreement in Gesture Elicitation Studies. [Research Report] 1584, LRI - CNRS, University Paris-Sud. 2016, pp.5. ⟨hal-01267288⟩
1476 View
498 Download

Share

More