Communication Dans Un Congrès Année : 2025

Overview of the Critical Questions Generation Shared Task

Résumé

The proliferation of AI technologies has reinforced the importance of developing critical thinking skills. We propose leveraging Large Language Models (LLMs) to facilitate the generation of critical questions: inquiries designed to identify fallacious or inadequately constructed arguments. This paper presents an overview of the first shared task on Critical Questions Generation (CQs-Gen). Thirteen teams investigated various methodologies for generating questions that critically assess arguments within the provided texts. The highest accuracy achieved was 67.6, indicating substantial room for improvement in this task. Moreover, three of the four top-performing teams incorporated argumentation scheme annotations to enhance their systems. Finally, while most participants employed open-weight models, the two highest-ranking teams relied on proprietary LLMs.

Fichier principal
Vignette du fichier
2025.argmining-1.23.pdf (321.88 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05449766 , version 1 (09-01-2026)

Licence

Identifiants

Citer

Blanca Calvo Figueras, Jaione Bengoetxea, Maite Heredia, Ekaterina Sviridova, Elena Cabrio, et al.. Overview of the Critical Questions Generation Shared Task. Proceedings of the 12th Argument mining Workshop, Jul 2025, Vienna, Austria. pp.243-257, ⟨10.18653/v1/2025.argmining-1.23⟩. ⟨hal-05449766⟩
79 Consultations
118 Téléchargements

Altmetric

Partager

  • More