Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio

Résumé

This paper defines Spoof Diarization as a novel task in the Partial Spoof (PS) scenario. It aims to determine what spoofed when, which includes not only locating spoof regions but also clustering them according to different spoofing methods. As a pioneering study in spoof diarization, we focus on defining the task, establishing evaluation metrics, and proposing a benchmark model, namely the Countermeasure-Condition Clustering (3C) model. Utilizing this model, we first explore how to effectively train countermeasures to support spoof diarization using three labeling schemes. We then utilize spoof localization predictions to enhance the diarization performance. This first study reveals the high complexity of the task, even in restricted scenarios where only a single speaker per audio file and an oracle number of spoofing methods are considered. Our code is available at https://github.com/nii-yamagishilab/PartialSpoof.

Dates et versions

hal-04710198 , version 1 (26-09-2024)

Identifiants

Citer

Lin Zhang, Xin Wang, Erica Cooper, Mireia Diez, Federico Landini, et al.. Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio. INTERSPEECH 2024, 25th Conference of the International Speech Communication Association, ISCA, Sep 2024, Kos Island, Greece. ⟨hal-04710198⟩

Collections

EURECOM ANR
0 Consultations
0 Téléchargements

Altmetric

Partager

More