Invention Grant
- Patent Title: Coarse-to-fine multimodal gallery search system with attention-based neural network models
-
Application No.: US17072905Application Date: 2020-10-16
-
Publication No.: US11645323B2Publication Date: 2023-05-09
- Inventor: Mete Kemertas
- Applicant: SAMSUNG ELECTRONICS CO., LTD.
- Applicant Address: KR Suwon-si
- Assignee: SAMSUNG ELECTRONICS CO.. LTD.
- Current Assignee: SAMSUNG ELECTRONICS CO.. LTD.
- Current Assignee Address: KR Suwon-si
- Agency: Sughrue Mion, PLLC
- Main IPC: G06F16/903
- IPC: G06F16/903 ; G06F16/435 ; G06F17/18 ; G06F17/16

Abstract:
A method, computer program, and computer system is provided for multimodal content retrieval. A search query corresponding to a request for content is received. Content features corresponding to a subset of content items from among a plurality of content items are retrieved based on receiving the search query. Similarity values are calculated between the search query and the retrieved content features. Attention scores are determined for the calculated similarity values. A content item is selected from among the subset of content items of the plurality of content items. The selected content item contains a content feature corresponding to a highest attention score of the attention scores.
Public/Granted literature
- US20210263961A1 COARSE-TO-FINE MULTIMODAL GALLERY SEARCH SYSTEM WITH ATTENTION-BASED NEURAL NETWORK MODELS Public/Granted day:2021-08-26
Information query