Automated Paraphrase Generation with Over-generation and Pruning Services - Archive ouverte HAL
Article Dans Une Revue Lecture Notes in Computer Science Année : 2021

Automated Paraphrase Generation with Over-generation and Pruning Services

Résumé

Conversational services are emerging as a new paradigm for accessing information by simply uttering questions in natural language, posing a whole new set of challenges to the design and engineering of information systems. Training conversational services to deal with the nuances of natural language often requires collecting a high-quality and diverse set of training samples (i.e., paraphrases). Traditional approaches such as hiring an expert or crowdsourcing involve data collection processes that are often costly and time-consuming. Automated paraphrase generation is a promising cost-effective and scalable approach to generating training samples. Current automatic techniques, however, tend to specialise in specific types of lexical or syntactic variations. As a result, generated paraphrases may not perform well in relevant quality aspects such as diversity and semantic relatedness. In this paper, we follow an approach inspired by services integration to address these issues and generate paraphrases in English that are semantically relevant and diverse. We propose an extensible and reusable pipeline that combines automatic paraphrasing techniques in a two-step process that first focus on i) leveraging the strengths of multiple techniques to generate the most diverse (and possibly noisy) set of paraphrases, to then ii) address common quality issues in a separate step. Through empirical evaluations we show the benefits of the two-step process design and of combining techniques for more balancing relevance and diversity.
Fichier principal
Vignette du fichier
ICSOC_2021___Automated_Paraphrase_Generation_Pipeline.pdf (947.84 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03626684 , version 1 (31-03-2022)

Identifiants

Citer

Auday Berro, Marcos Baez, Boualem Benatallah, Khalid Benabdeslem, Mohammad-Ali Yaghub Zade Fard. Automated Paraphrase Generation with Over-generation and Pruning Services. Lecture Notes in Computer Science, 2021, Service-Oriented Computing 19th International Conference, ICSOC 2021, Virtual Event, November 22–25, 2021, Proceedings, 13121, pp.400-414. ⟨10.1007/978-3-030-91431-8_25⟩. ⟨hal-03626684⟩
71 Consultations
304 Téléchargements

Altmetric

Partager

More