Skip to Main content Skip to Navigation
Conference papers

SPEAKER EMBEDDINGS FOR DIARIZATION OF BROADCAST DATA IN THE ALLIES CHALLENGE

Abstract : Diarization consists in the segmentation of speech signals and the clustering of homogeneous speaker segments. State-of-the-art systems typically operate upon speaker embeddings, such as ivectors or neural x-vectors, extracted from mel cepstral coefficients (MFCCs) or spectrograms. The recent SincNet architecture extracts x-vectors directly from raw speech signals. The work reported in this paper compares the performance of different embeddings extracted from MFCCs or the raw signal for speaker diarization and broadcast media treated with compression and sub-sampling, operations which typically degrade performance. Experiments are performed with the new ALLIES database that was designed to complement existing, publicly available French corpora of broadcast radio and TV shows. Results show that, in adverse conditions, with compression and sampling mismatch, SincNet x-vectors outperform i-vectors and x-vectors by relative DERs of 43% and 73% respectively. Additionally we found that SincNet x-vectors are not the absolute best embeddings but are more robust to data mismatch than others.
Document type :
Conference papers
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03262914
Contributor : Anthony Larcher Connect in order to contact the contributor
Submitted on : Wednesday, June 16, 2021 - 6:05:42 PM
Last modification on : Wednesday, September 22, 2021 - 11:26:06 AM
Long-term archiving on: : Friday, September 17, 2021 - 7:25:18 PM

File

ICASSP_2021_ALLIES_submitted.p...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03262914, version 1

Collections

Citation

Anthony Larcher, Ambuj Mehrish, Marie Tahon, Sylvain Meignier, Jean Carrive, et al.. SPEAKER EMBEDDINGS FOR DIARIZATION OF BROADCAST DATA IN THE ALLIES CHALLENGE. ICASSP, Jun 2021, Toronto, Canada. ⟨hal-03262914⟩

Share

Metrics

Record views

48

Files downloads

82