Evaluation of Improved Components of AMIS Project for Speech Recognition, Machine Translation and Video/Audio/Text Summarization - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2020

Evaluation of Improved Components of AMIS Project for Speech Recognition, Machine Translation and Video/Audio/Text Summarization

Résumé

To evaluate a system that automatically summarizes video files (image and audio) and text, how the system works, and the quality of the results should be considered. With this objective, the authors have performed two types of evaluation: objective and subjective. The actual assessment is performed mainly automatically, while the individual assessment is based directly on the opinion of people, who evaluate the system by answering a set of questions, which are then processed to obtain the targeted conclusions. One of the purposes of the described research is to try to narrow the space of possible summarization scenarios. Meanwhile, in the light of individual results obtained, the researchers cannot unambiguously indicate one single scenario, recommended as the only one for further development. However, the researchers can state with certainty that the new development of scene 1, which has received many negative evaluations among professionals, should be discontinued. Considering the results of the set of questions about the quality of the complete system, the end-users have evaluated the scenario 3, and they think that the quality is excellent, obtaining results over 70% on a scale of 0 to 100.
Fichier principal
Vignette du fichier
MCSS2020_003_final_v2.pdf (294.9 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03058035 , version 1 (11-12-2020)

Identifiants

Citer

Aritz Badiola, Amaia Méndez Zorrilla, García-Zapirain Begoña, Michał Grega, Mikołaj Leszczuk, et al.. Evaluation of Improved Components of AMIS Project for Speech Recognition, Machine Translation and Video/Audio/Text Summarization. Multimedia Communications, Services and Security, pp.320-331, 2020, 978-3-030-58999-8. ⟨10.1007/978-3-030-59000-0_24⟩. ⟨hal-03058035⟩
42 Consultations
87 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More