Invention Grant
- Patent Title: Generating expressive speech audio from text data
-
Application No.: US16840070Application Date: 2020-04-03
-
Publication No.: US11295721B2Publication Date: 2022-04-05
- Inventor: Siddharth Gururani , Kilol Gupta , Dhaval Shah , Zahra Shakeri , Jervis Pinto , Mohsen Sardari , Navid Aghdaie , Kazi Zaman
- Applicant: Electronic Arts Inc.
- Applicant Address: US CA Redwood City
- Assignee: Electronic Arts Inc.
- Current Assignee: Electronic Arts Inc.
- Current Assignee Address: US CA Redwood City
- Agency: Middleton Reutlinger
- Main IPC: G10L13/00
- IPC: G10L13/00 ; G06N3/08 ; A63F13/60 ; G06N3/04 ; A63F13/63

Abstract:
A system for use in video game development to generate expressive speech audio comprises a user interface configured to receive user-input text data and a user selection of a speech style. The system includes a machine-learned synthesizer comprising a text encoder, a speech style encoder and a decoder. The machine-learned synthesizer is configured to generate one or more text encodings derived from the user-input text data, using the text encoder of the machine-learned synthesizer; generate a speech style encoding by processing a set of speech style features associated with the selected speech style using the speech style encoder of the machine-learned synthesizer; combine the one or more text encodings and the speech style encoding to generate one or more combined encodings; and decode the one or more combined encodings with the decoder of the machine-learned synthesizer to generate predicted acoustic features. The system includes one or more modules configured to process the predicted acoustic features, the one or more modules comprising a machine-learned vocoder configured to generate a waveform of the expressive speech audio.
Public/Granted literature
- US20210151029A1 Generating Expressive Speech Audio From Text Data Public/Granted day:2021-05-20
Information query