Invention Grant
- Patent Title: Method, system, and computer-readable medium for purifying voice using depth information
-
Application No.: US17176802Application Date: 2021-02-16
-
Publication No.: US11842745B2Publication Date: 2023-12-12
- Inventor: Yuan Lin , Jenhao Hsiao , Chiuman Ho
- Applicant: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
- Applicant Address: CN Guangdong
- Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
- Current Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
- Current Assignee Address: CN Dongguan
- Agency: Young Basile Hanlon & MacFarlane, P.C
- Main IPC: G10L21/02
- IPC: G10L21/02 ; G10L21/0216 ; G06T7/586 ; G06N3/04 ; G10L15/22 ; G10L15/24 ; G06V10/764 ; G06V10/80 ; G06V10/82 ; G06V20/64 ; G06V40/20

Abstract:
In an embodiment, a method includes receiving a plurality of first images including at least a mouth-related portion of a human uttering a voice, wherein each first image has depth information; obtaining a noisy spectrogram including a first representation of the voice of the human; extracting a plurality of visual features using the first images, wherein one of the visual features is obtained using the depth information of a second image of the first images; extracting a plurality of audio features using the noisy spectrogram; determining a first spectrogram using the visual features and the audio features; subtracting the first spectrogram from the noisy spectrogram, to obtain a purified representation of the voice of the human; and outputting, by an I/O-related outputting device, a response using the purified representation of the voice of the human.
Public/Granted literature
- US20210166696A1 Method, System, and Computer-Readable Medium for Purifying Voice Using Depth Information Public/Granted day:2021-06-03
Information query