Communication Dans Un Congrès Année : 2024

Establishing degrees of closeness between audio recordings along different dimensions using large-scale cross-lingual models

Résumé

In the highly constrained context of low-resource language studies, we explore vector representations of speech from a pretrained model to determine their level of abstraction with regard to the audio signal. We propose a new unsupervised method using ABX tests on audio recordings with carefully curated metadata to shed light on the type of information present in the representations. ABX tests determine whether the representations computed by a multilingual speech model encode a given characteristic. Three experiments are devised: one on room acoustics aspects, one on linguistic genre, and one on phonetic aspects. The results confirm that the representations extracted from recordings with different linguistic/extra-linguistic characteristics differ along the same lines. Embedding more audio signal in one vector better discriminates extra-linguistic characteristics, whereas shorter snippets are better to distinguish segmental information. The method is fully unsupervised, potentially opening new research avenues for comparative work on under-documented languages.

Fichier principal
Vignette du fichier
2024.findings-eacl.154.pdf (526.64 Ko) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Licence
DOI

Cite 10.24397/pangloss-0004341 Son Michaud, A. (2012). Sister: The sister’s wedding (version 1) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0004341

DOI

Cite 10.24397/pangloss-0004343 Son Michaud, A. (2012). Sister: The sister’s wedding (version 2) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0004343

DOI

Cite 10.24397/pangloss-0004344 Son Michaud, A. (2012). Sister: The sister’s wedding (version 3) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0004344

DOI

Cite 10.24397/pangloss-0004938 Son Michaud, A. (2018). Sister: The sister’s wedding (version 4) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0004938

DOI

Cite 10.24397/pangloss-0004940 Son Michaud, A. (2018). Sister: The sister’s wedding (version 5) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0004940

DOI

Cite 10.24397/pangloss-0007695 Article Michaud, A. (2022). Sister: The sister’s wedding, version 6. Pangloss. https://doi.org/10.24397/PANGLOSS-0007695

DOI

Cite 10.24397/pangloss-0007698 Article Michaud, A. (2022). Sister: The sister’s wedding, version 7. (With video.). Pangloss. https://doi.org/10.24397/PANGLOSS-0007698

DOI

Cite 10.24397/pangloss-0004694 Son Michaud, A. & 米可. (2013). Ballad about hunting (Romanized Naxi: Kee Keel; IPA: /kʰɯ˧kʰɯ˥/) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0004694

DOI

Cite 10.24397/pangloss-0004697 Son Michaud, A. & 米可. (2013). The Great Prayer to the Wind, sung in the ‘GuQi’ style. [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0004697

DOI

Cite 10.24397/pangloss-0004695 Son Michaud, A. & 米可. (2013). Life Story: Naxi singer Li Xiuxiang’s account of her life course [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0004695

DOI

Cite 10.24397/pangloss-0004698 Son Michaud, A. & 米可. (2013). Xuq Jjil (ɕy˩ ndʑi˥): Blessings (popular Naxi songs). Singing style: wɤ˧-mə˧-ndɑ˩. [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0004698

DOI

Cite 10.24397/pangloss-0004699 Son Michaud, A. & 米可. (2013). A Li Li: A Naxi singing style of Post-1949 Lijiang [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0004699

DOI

Cite 10.24397/pangloss-0008663 Son Fily, M. (2023). A Phonetic corpus on nasal vowels : AS on nov. 30 [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0008663

DOI

Cite 10.24397/pangloss-0008667 Son Fily, M. (2023). A Phonetic corpus on nasal vowels : RS on nov. 29 [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0008667

DOI

Cite 10.24397/pangloss-0008662 Son Fily, M. (2023). A Phonetic corpus on nasal vowels : AS on nov. 29 [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0008662

DOI

Cite 10.24397/pangloss-0008664 Son Fily, M. (2023). A Phonetic corpus on nasal vowels : RS on nov. 28 (part 1) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0008664

DOI

Cite 10.24397/pangloss-0008665 Son Fily, M. (2023). A Phonetic corpus on nasal vowels : RS on nov. 28 (part 2) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0008665

DOI

Cite 10.24397/pangloss-0008666 Son Fily, M. (2023). A Phonetic corpus on nasal vowels : RS on nov. 28 (part 3) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0008666

DOI

Cite 10.24397/pangloss-0008668 Son Fily, M. (2023). A Phonetic corpus on nasal vowels : TLT on nov. 29 [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0008668

DOI

Cite 10.24397/pangloss-0008669 Son Fily, M. (2023). Verbs in carrier sentences (part 1) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0008669

DOI

Cite 10.24397/pangloss-0008670 Son Fily, M. (2023). Verbs in carrier sentences (part 2) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0008670

DOI

Cite 10.24397/pangloss-0008671 Son Fily, M. (2023). Words in carrier sentences (until Yak) [Audio recording]. Pangloss. https://doi.org/10.24397/PANGLOSS-0008671

Dates et versions

hal-04561819 , version 1 (29-04-2024)

Licence

Identifiants

Citer

Maxime Fily, Guillaume Wisniewski, Séverine Guillaume, Gilles Adda, Alexis Michaud. Establishing degrees of closeness between audio recordings along different dimensions using large-scale cross-lingual models. Findings of the Association for Computational Linguistics: EACL 2024, Association for Computational Linguistics, Mar 2024, St. Julian’s, Malta. ⟨hal-04561819⟩
274 Consultations
196 Téléchargements

Altmetric

Partager

  • More