Invention Grant
- Patent Title: System and method for cross-speaker style transfer in text-to-speech and training data generation
-
Application No.: US17030871Application Date: 2020-09-24
-
Publication No.: US11361753B2Publication Date: 2022-06-14
- Inventor: Shifeng Pan , Lei He , Yulin Li , Sheng Zhao , Chunling Ma
- Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
- Applicant Address: US WA Redmond
- Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
- Current Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
- Current Assignee Address: US WA Redmond
- Agency: Workman Nydegger
- Priority: CN202010885556.9 20200828
- Main IPC: G10L13/10
- IPC: G10L13/10 ; G10L15/06 ; G10L21/013 ; G10L25/18 ; G10L25/63 ; G10L15/18 ; G10L25/30 ; G10L15/187

Abstract:
Systems are configured for generating spectrogram data characterized by a voice timbre of a target speaker and a prosody style of source speaker by converting a waveform of source speaker data to phonetic posterior gram (PPG) data, extracting additional prosody features from the source speaker data, and generating a spectrogram based on the PPG data and the extracted prosody features. The systems are configured to utilize/train a machine learning model for generating spectrogram data and for training a neural text-to-speech model with the generated spectrogram data.
Public/Granted literature
- US20220068259A1 SYSTEM AND METHOD FOR CROSS-SPEAKER STYLE TRANSFER IN TEXT-TO-SPEECH AND TRAINING DATA GENERATION Public/Granted day:2022-03-03
Information query