Invention Grant
- Patent Title: Visual relationship detection method and system based on adaptive clustering learning
-
Application No.: US17007213Application Date: 2020-08-31
-
Publication No.: US11361186B2Publication Date: 2022-06-14
- Inventor: Anan Liu , Yanhui Wang , Ning Xu , Weizhi Nie
- Applicant: TIANJIN UNIVERSITY
- Applicant Address: CN Tianjin
- Assignee: TIANJIN UNIVERSITY
- Current Assignee: TIANJIN UNIVERSITY
- Current Assignee Address: CN Tianjin
- Agency: Dragon Sun Law Firm, PC
- Agent Jinggao Li, Esq.; Nathaniel Perkins
- Priority: CN201911341230.3 20191223
- Main IPC: G06K9/62
- IPC: G06K9/62

Abstract:
The present disclosure discloses a visual relationship detection method based on adaptive clustering learning, including: detecting visual objects from an input image and recognizing the visual objects to obtain context representation; embedding the context representation of pair-wise visual objects into a low-dimensional joint subspace to obtain a visual relationship sharing representation; embedding the context representation into a plurality of low-dimensional clustering subspaces, respectively, to obtain a plurality of preliminary visual relationship enhancing representation; and then performing regularization by clustering-driven attention mechanism; fusing the visual relationship sharing representations and regularized visual relationship enhancing representations with a prior distribution over the category label of visual relationship predicate, to predict visual relationship predicates by synthetic relational reasoning. The method is capable of fine-grained recognizing visual relationships of different subclasses by mining latent relationships in-between, which improves the accuracy of visual relationship detection.
Public/Granted literature
- US20210192274A1 VISUAL RELATIONSHIP DETECTION METHOD AND SYSTEM BASED ON ADAPTIVE CLUSTERING LEARNING Public/Granted day:2021-06-24
Information query