Voice Cloning: Training Speaker Selection with Limited Multi-Speaker Corpus - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Voice Cloning: Training Speaker Selection with Limited Multi-Speaker Corpus

Résumé

Text-To-Speech synthesis with few data is a challenging task, in particular when choosing the target speaker is not an option. Voice cloning is a popular method to alleviate these issues using only a few minutes of target speech. To do this, the model must first be trained on a large corpus of thousands of hours and hundreds of speakers. In this paper, we tackle the challenge of cloning voices with a much smaller corpus, using both the speaker adaptation and speaker encoding methods.We study the impact of selecting our training speakers based on their similarity to the targets. We train models using only the training speakers closest/farthest to our targets in terms of speaker similarity from a pool of 14 speakers. We show that the selection of speakers in the training set has an impact on the similarity to the target speaker. The effect is more prominent for speaker encoding than adaptation. However, it remains nuanced when it comes to naturalness.
Fichier principal
Vignette du fichier
guennec23_ssw.pdf (256.89 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04223354 , version 1 (29-09-2023)

Licence

Copyright (Tous droits réservés)

Identifiants

Citer

David Guennec, Lily Wadoux, Aghilas Sini, Nelly Barbot, Damien Lolive. Voice Cloning: Training Speaker Selection with Limited Multi-Speaker Corpus. 12th ISCA Speech Synthesis Workshop (SSW2023), Aug 2023, Grenoble, France. pp.170-176, ⟨10.21437/ssw.2023-27⟩. ⟨hal-04223354⟩
69 Consultations
64 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More