Invention Grant
- Patent Title: Method, apparatus, and device for video frame interpolation
-
Application No.: US16626409Application Date: 2019-03-07
-
Publication No.: US11354541B2Publication Date: 2022-06-07
- Inventor: Ronggang Wang , Haoxian Zhang , Zhenyu Wang , Wen Gao
- Applicant: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
- Applicant Address: CN Shenzhen
- Assignee: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
- Current Assignee: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
- Current Assignee Address: CN Shenzhen
- Agency: Miles & Stockbridge P.C.
- Priority: CN201910156565.1 20190301
- International Application: PCT/CN2019/077245 WO 20190307
- International Announcement: WO2020/177108 WO 20200910
- Main IPC: G06K9/00
- IPC: G06K9/00 ; G06K9/62 ; G06T7/207 ; G06N20/00 ; G06T3/00 ; G06T3/40 ; G06V20/40

Abstract:
The present specification discloses a method, apparatus, and device for video frame interpolation. The method of embodiment of the present specification comprises: acquiring a video frame training sample, wherein the video frame training sample includes an even number of consecutive video frames and a first key frame, and the first key frame is an intermediate frame of the even number of consecutive video frames; constructing a pyramid deep learning model, wherein each level of the pyramid deep learning model being used to generate intermediate frames of different resolutions has a plurality of convolutional neural network layers; inputting the even number of consecutive video frames to the pyramid deep learning model to generate a second key frame; modifying the pyramid deep learning model according to the second key frame and the first key frame to generate a modified pyramid deep learning model; inputting a plurality of video frames to be processed into the modified pyramid deep learning model to generate an intermediate frame of the plurality of video frames. The invention fully exploits the spatio-temporal domain information between multi-frame video frames, and adopts a pyramid refinement strategy to effectively estimate the motion information and the occlusion region, thereby greatly improving the quality of the intermediate frame.
Public/Granted literature
- US20210383169A1 METHOD, APPARATUS, AND DEVICE FOR VIDEO FRAME INTERPOLATION Public/Granted day:2021-12-09
Information query