Invention Grant
- Patent Title: Training image-recognition systems using a joint embedding model on online social networks
-
Application No.: US15997482Application Date: 2018-06-04
-
Publication No.: US10402703B2Publication Date: 2019-09-03
- Inventor: Dirk John Stoop , Balmanohar Paluri
- Applicant: Facebook, Inc.
- Applicant Address: US CA Menlo Park
- Assignee: Facebook, Inc.
- Current Assignee: Facebook, Inc.
- Current Assignee Address: US CA Menlo Park
- Agency: Baker Botts L.L.P.
- Main IPC: G06K9/66
- IPC: G06K9/66 ; G06K9/62 ; G06K9/42 ; G06Q50/00 ; G06K9/72 ; G06N20/00 ; G06F16/435 ; G06F16/583 ; G06F16/58 ; G06F16/9535 ; G06F16/2457 ; G06K9/00 ; G06K9/46 ; G06K9/68

Abstract:
In one embodiment, a method includes identifying a shared visual concept in visual-media items based on shared visual features in images of the visual-media items; extracting, for each of the visual-media items, n-grams from communications associated with the visual-media item; generating, in a d-dimensional space, an embedding for each of the visual-media items at a location based on the visual concepts included in the visual-media item; generating, in the d-dimensional space, an embedding for each of the extracted n-grams at a location based on a frequency of occurrence of the n-gram in the communications associated with the visual-media items; and associating, with the shared visual concept, the extracted n-grams that have embeddings within a threshold area of the embeddings for the identified visual-media items.
Public/Granted literature
- US20180285700A1 Training Image-Recognition Systems Using a Joint Embedding Model on Online Social Networks Public/Granted day:2018-10-04
Information query