Invention Grant
- Patent Title: Speech separation method, electronic device, chip, and computer- readable storage medium
-
Application No.: US18026960Application Date: 2021-08-24
-
Publication No.: US12334092B2Publication Date: 2025-06-17
- Inventor: Henghui Lu , Lei Qin , Peng Zhang , Jiaming Xu , Bo Xu
- Applicant: Huawei Technologies Co., Ltd. , INSTITUTE OF AUTOMATION, CHINESE ACADEMY OF SCIENCES
- Applicant Address: CN Shenzhen; CN Beijing
- Assignee: Huawei Technologies Co., Ltd.,INSTITUTE OF AUTOMATION, CHINESE ACADEMY OF SCIENCES
- Current Assignee: Huawei Technologies Co., Ltd.,INSTITUTE OF AUTOMATION, CHINESE ACADEMY OF SCIENCES
- Current Assignee Address: CN Shenzhen; CN Beijing
- Agency: Leydig, Voit & Mayer, Ltd.
- Priority: CN202011027680.8 20200925
- International Application: PCT/CN2021/114204 WO 20210824
- International Announcement: WO2022/062800 WO 20220331
- Main IPC: G10L21/0208
- IPC: G10L21/0208 ; G06V20/40 ; G10L21/055

Abstract:
A speech separation method is provided, and relates to the field of speech. The method includes: obtaining, in a speaking process of a user, audio information including a user speech and video information including a user face; coding the audio information to obtain a mixed acoustic feature; extracting a visual semantic feature of the user from the video information; inputting the mixed acoustic feature and the visual semantic feature into a preset visual speech separation network to obtain an acoustic feature of the user; and decoding the acoustic feature of the user to obtain a speech signal of the user. An electronic device, a chip, and a computer-readable storage medium are provided.
Public/Granted literature
- US20230335148A1 Speech Separation Method, Electronic Device, Chip, and Computer-Readable Storage Medium Public/Granted day:2023-10-19
Information query