Everything You Always Wanted to Know About TREC RTS* (*But Were Afraid to Ask) - Archive ouverte HAL Accéder directement au contenu
Autre Publication Scientifique Année : 2017

Everything You Always Wanted to Know About TREC RTS* (*But Were Afraid to Ask)

Résumé

The TREC Real-Time Summarization (RTS) track provides a framework for evaluating systems monitoring the Twitter stream and pushing tweets to users according to given profiles. It includes metrics, files, settings and hypothesis provided by the organizers. In this work, we perform a thorough analysis of each component of the framework used in 2016 and 2017 and found some limitations for the Scenario A of this track. Our main findings point out the weakness of the metrics and give clear recommendations to fairly reuse the collection.

Dates et versions

hal-03131897 , version 1 (04-02-2021)

Licence

Paternité - Pas d'utilisation commerciale - Pas de modification

Identifiants

Citer

Gilles Hubert, Jose G. Moreno, Karen Pinel-Sauvagnat, Yoann Pitarch. Everything You Always Wanted to Know About TREC RTS* (*But Were Afraid to Ask). 2017. ⟨hal-03131897⟩
17 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More