Invention Grant
- Patent Title: Computer generated emulation of a subject
-
Application No.: US14458556Application Date: 2014-08-13
-
Publication No.: US09959368B2Publication Date: 2018-05-01
- Inventor: Balakrishna Venkata Jagannadha Kolluru , Vincent Ping Leung Wan , Bjorn Dietmar Rafael Stenger , Roberto Cipolla , Javier Latorre-Martinez , Langzhou Chen , Ranniery Da Silva Maia , Kayoko Yanagisawa , Norbert Braunschweiler , Ioannis Stylianou , Robert Arthur Blokland
- Applicant: Kabushiki Kaisha Toshiba
- Applicant Address: JP Minato-ku
- Assignee: Kabushiki Kaisha Toshiba
- Current Assignee: Kabushiki Kaisha Toshiba
- Current Assignee Address: JP Minato-ku
- Agency: Oblon, McClelland, Maier & Neustadt, L.L.P.
- Priority: GB1314711.1 20130816
- Main IPC: G06F17/30
- IPC: G06F17/30 ; G06N3/00 ; G06T13/40 ; G10L13/027 ; G10L13/08 ; G06N99/00

Abstract:
A system for emulating a subject, to allow a user to interact with a computer generated talking head with the subject's face and voice; said system comprising a processor, a user interface and a personality storage section, the user interface being configured to emulate the subject, by displaying a talking head which comprises the subject's face and output speech from the mouth of the face with the subject's voice, the user interface further comprising a receiver for receiving a query from the user, the emulated subject being configured to respond to the query received from the user, the processor comprising a dialogue section and a talking head generation section, wherein said dialogue section is configured to generate a response to a query inputted by a user from the user interface and generate a response to be outputted by the talking head, the response being generated by retrieving information from said personality storage section, said personality storage section comprising content created by or about the subject, and said talking head generation section is configured to: convert said response into a sequence of acoustic units, the talking head generation section further comprising a statistical model, said statistical model comprising a plurality of model parameters, said model parameters being derived from said personality storage section, the model parameters describing probability distributions which relate an acoustic unit to an image vector and speech vector, said image vector comprising a plurality of parameters which define the subject's face and said speech vector comprising a plurality of parameters which define the subject's voice, the talking head generation section being further configured to output a sequence of speech vectors and image vectors which are synchronised such that the head appears to talk.
Public/Granted literature
- US20150052084A1 COMPUTER GENERATED EMULATION OF A SUBJECT Public/Granted day:2015-02-19
Information query