Zelda Rose: a tool for hassle-free training of transformer models - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Zelda Rose: a tool for hassle-free training of transformer models

Résumé

Zelda Rose is a command line interface for pretraining transformer-based models. Its purpose is to enable an easy start for users interested in training these ubiquitous models, but unable or unwilling to engage with more comprehensive — but more complex — frameworks and the complex interactions between libraries for managing models, datasets and computations. Training a model requires no code on the user’s part and produce models directly compatible with the HuggingFace ecosystem, allowing quick and easy distribution and reuse. A particular care is given to lowering the cost of maintainability and future-proofing, by making the code as modular as possible and taking advantage of third-party libraries to limit ad-hoc code to the strict minimum.
Fichier principal
Vignette du fichier
Zeldarose_OSS_EMNLP23.pdf (56.23 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04262806 , version 1 (27-10-2023)

Licence

Paternité - Partage selon les Conditions Initiales

Identifiants

  • HAL Id : hal-04262806 , version 1

Citer

Loïc Grobol. Zelda Rose: a tool for hassle-free training of transformer models. 3rd Workshop for Natural Language Processing Open Source Software (NLP-OSS), Dec 2023, Singapore, Indonesia. ⟨hal-04262806⟩
49 Consultations
29 Téléchargements

Partager

Gmail Facebook X LinkedIn More