Audio samples for the paper: Transferring Source Style in Non-Parallel Voice Conversion.

Authors: Songxiang Liu, Yuewen Cao, Shiyin Kang, Na Hu, Xunying Liu, Dan Su, Dong Yu, Helen Meng

Abstract: Voice conversion (VC) techniques aim to modify speaker identity of an utterance while preserving the underlying linguistic information. Most VC approaches ignore modeling of the speaking style (e.g. emotion and emphasis), which may contain the factors intentionally added by the speaker and should be retained during conversion. This study proposes a sequence-to-sequence based non-parallel VC approach, which has the capability of transferring the speaking style from the source speech to the converted speech by explicitly modeling. Objective evaluation and subjective listening tests show superiority of the proposed VC approach in terms of speech naturalness and speaker similarity of the converted speech. Experiments are also conducted to show the source-style transferability of the proposed approach.

System Description

Baseline-1: PPG-VC

Baseline-2: Seq2seqVC

The Proposed

Part-1: Voice Conversion Performance Comparison

Intra-Gender VC:

Index Source Utterance Reference Utterance PPG-VC Seq2seqVC Proposed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20

Inter-Gender VC:

Index Source Utterance Reference Utterance PPG-VC Seq2seqVC Proposed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20

Part-2: Source Style Tansfer Performance Comparison

Index Source Utterance Target Utterance PPG-VC Seq2seqVC Proposed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20