Role-Play Zero-Shot Prompting with Large Language Models for Open-Domain Human-Machine Conversation - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Role-Play Zero-Shot Prompting with Large Language Models for Open-Domain Human-Machine Conversation

Résumé

Recently, various methods have been proposed to create open-domain conversational agents with Large Language Models (LLMs). These models are able to answer user queries, but in a one-way Q&A format rather than a true conversation. Fine-tuning on particular datasets is the usual way to modify their style to increase conversational ability, but this is expensive and usually only available in a few languages. In this study, we explore role-play zero-shot prompting as an efficient and cost-effective solution for open-domain conversation, using capable multilingual LLMs (Beeching et al., 2023) trained to obey instructions. We design a prompting system that, when combined with an instruction-following model - here Vicuna (Chiang et al., 2023) - produces conversational agents that match and even surpass fine-tuned models in human evaluation in French in two different tasks.
Fichier principal
Vignette du fichier
sigdial_2023_sub.pdf (466.54 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04630836 , version 1 (01-07-2024)

Identifiants

Citer

Ahmed Njifenjou, Virgile Sucal, Bassam Jabaian, Fabrice Lefèvre. Role-Play Zero-Shot Prompting with Large Language Models for Open-Domain Human-Machine Conversation. 2023. ⟨hal-04630836⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More