Other datasets are supported in the toolbox, see here. Extract the contents as /LibriSpeech/train-clean-100 where is a directory of your choosing. Datasetsįor playing with the toolbox alone, I only recommend downloading LibriSpeech/train-clean-100. Pretrained modelsīefore you download any dataset, you can begin by testing your configuration with: Additionally you will need PyTorch (>=1.0.1).Ī GPU is mandatory, but you don't necessarily need a high tier GPU if you only want to use the toolbox.
#VOICE CLONING SOFTWARE FREE INSTALL#
Run pip install -r requirements.txt to install the necessary packages. Python 3.6 might work too, but I wouldn't go lower because I make extensive use of pathlib. You will need the following whether you plan to use the toolbox only or to retrain the models. It adds a big overhead, so it's not recommended if you have enough VRAM. Pass -low_mem to demo_cli.py or demo_toolbox.py to enable it. You can use your trained encoder models from this repo with it.Ġ6/07/19: Need to run within a docker container on a remote server? See here.Ģ5/06/19: Experimental support for low-memory GPUs (~2gb) added for the synthesizer.
#VOICE CLONING SOFTWARE FREE VERIFICATION#
| URL | Designation | Title | Implementation source || - | - | - | - || 1806.04558 | SV2TTS | Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis | This repo || 1802.08435 | WaveRNN (vocoder) | Efficient Neural Audio Synthesis | fatchord/WaveRNN || 1712.05884 | Tacotron 2 (synthesizer) | Natural TTS Synthesis by Conditioning Wavenet on Mel Spectrogram Predictions | Rayhane-mamah/Tacotron-2| 1710.10467 | GE2E (encoder)| Generalized End-To-End Loss for Speaker Verification | This repo | NewsĢ0/08/19: I'm working on resemblyzer, an independent package for the voice encoder.
SV2TTS is a three-stage deep learning framework that allows to create a numerical representation of a voice from a few seconds of audio, and to use it to condition a text-to-speech model trained to generalize to new voices. Mostly I would recommend giving a quick look to the figures beyond the introduction. Feel free to check my thesis if you're curious or if you're looking for info I haven't documented yet (don't hesitate to make an issue for that too). This repository is an implementation of Transfer Learning from Speaker Verification toMultispeaker Text-To-Speech Synthesis (SV2TTS) with a vocoder that works in real-time. Clone a voice in 5 seconds to generate arbitrary speech in real-time
0 kommentar(er)
