Arbitrary Voice Conversion via Adversarial Learning and Cycle Consistency Loss

AbstractRecently, Non-parallel voice conversion (VC) has attracted the attention of many researchers in the field of speech. However, such model suffers from the limitation that how to improve the generalization of the model to extract the speaker information from unseen speaker. In this paper, we proposed a novel zero-shot VC approach which performs VC only rely on the speaker belong to training set. To achieve this VC method, we disentangle the speaker and content representations with instance normalization, and then use the adversarial learning to encourage model to produce more similar converted result. The experiment results demonstrate that our approach can achieve arbitrary voice conversion without any supervision.KeywordsVoice conversionZero-shot learningAdversarial learningDisentangle representations