Invention Grant
- Patent Title: Facial expression recognition method and system combined with attention mechanism
-
Application No.: US18322517Application Date: 2023-05-23
-
Publication No.: US11967175B2Publication Date: 2024-04-23
- Inventor: Sannyuya Liu , Zongkai Yang , Xiaoliang Zhu , Zhicheng Dai , Liang Zhao
- Applicant: CENTRAL CHINA NORMAL UNIVERSITY
- Applicant Address: CN Hubei
- Assignee: CENTRAL CHINA NORMAL UNIVERSITY
- Current Assignee: CENTRAL CHINA NORMAL UNIVERSITY
- Current Assignee Address: CN Hubei
- Agency: JCIPRNET
- Priority: CN 2011325980.4 2020.11.24
- Main IPC: G06K9/00
- IPC: G06K9/00 ; G06V10/24 ; G06V10/62 ; G06V10/77 ; G06V10/80 ; G06V10/82 ; G06V20/40 ; G06V40/16 ; G06V10/774

Abstract:
Provided are a facial expression recognition method and system combined with an attention mechanism. The method comprises: detecting faces comprised in each video frame in a video sequence, and extracting corresponding facial ROIs, so as to obtain facial pictures in each video frame; aligning the facial pictures in each video frame on the basis of location information of facial feature points of the facial pictures; inputting the aligned facial pictures into a residual neural network, and extracting spatial features of facial expressions corresponding to the facial pictures; inputting the spatial features of the facial expressions into a hybrid attention module to acquire fused features of the facial expressions; inputting the fused features of the facial expressions into a gated recurrent unit, and extracting temporal features of the facial expressions; and inputting the temporal features of the facial expressions into a fully connected layer, and classifying and recognizing the facial expressions.
Public/Granted literature
- US20230298382A1 FACIAL EXPRESSION RECOGNITION METHOD AND SYSTEM COMBINED WITH ATTENTION MECHANISM Public/Granted day:2023-09-21
Information query