Invention Grant
- Patent Title: Machine learning-based selection of a representative video frame within a messaging application
-
Application No.: US17550852Application Date: 2021-12-14
-
Publication No.: US12008811B2Publication Date: 2024-06-11
- Inventor: Kavya Venkata Kota Kopparapu , Benjamin Dodson , Francesc Xavier Drudis Rius , Angus Kong , Richard Leider , Jian Ren , Sergey Tulyakov , Jiayao Yu
- Applicant: Snap Inc.
- Applicant Address: US CA Santa Monica
- Assignee: SNAP INC.
- Current Assignee: SNAP INC.
- Current Assignee Address: US CA Santa Monica
- Agency: SCHWEGMANLUNDBERG & WOESSNER, P.A.
- Main IPC: G06K9/00
- IPC: G06K9/00 ; G06F16/783 ; G06N20/00 ; G06T5/70 ; G06V10/70 ; G06V20/40 ; G06V20/70

Abstract:
Aspects of the present disclosure involve a system comprising a medium storing a program and method for machine-learning based selection of a representative video frame. The program and method provide for receiving a set of video frames; determining a first subset of frames by removing frames outside of an image quality threshold; determining a second subset by removing frames outside of an image stillness threshold; computing feature data for each frame in the second subset; providing, for each frame in the second subset, the feature data to a machine learning model (MLM), the MLM being configured to output a score for each frame in the second subset of frames based on the feature data, the MLM having been trained with a first set of images labeled based on aesthetics, and with a second set of images labeled based on image quality; and selecting a frame based on output scores.
Public/Granted literature
- US20220207875A1 MACHINE LEARNING-BASED SELECTION OF A REPRESENTATIVE VIDEO FRAME WITHIN A MESSAGING APPLICATION Public/Granted day:2022-06-30
Information query