Trend Analysis in Polls, Topics, Opinions and Answers - Archive ouverte HAL Accéder directement au contenu
Rapport Année : 2011

Trend Analysis in Polls, Topics, Opinions and Answers

Gary Benattar
  • Fonction : Auteur
  • PersonId : 903981
Philippe Trébuchet
  • Fonction : Auteur
  • PersonId : 833470

Résumé

The goal of this work was to extract polls and opinions trends from a very large corpus. We developed a system that performs single words trend detection and also detects collocation candidates as well as collocation trends. We conducted experiments on a real-life repository, made available to us by Toluna.com, and counts around 23 millions documents. Our contributions were twofold: (1) we characterized the problem and chose the appropriate measures (eg z-score) to identify trends, (2) we designed a fully scalable system, leveraging Hadoop, Zookeeper and Hbase. This system includes a visual interface that displays a timeline highlighting trends in a 2-year window, as well as statistical reports by single words and n-grams.
Fichier principal
Vignette du fichier
TrendAnalysisGaryBenattar.pdf (1.22 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00601261 , version 1 (20-06-2011)

Identifiants

  • HAL Id : hal-00601261 , version 1

Citer

Gary Benattar, Philippe Trébuchet. Trend Analysis in Polls, Topics, Opinions and Answers. [Research Report] ???. 2011. ⟨hal-00601261⟩
184 Consultations
3319 Téléchargements

Partager

Gmail Facebook X LinkedIn More