- Patent Title: Deep reinforcement learning-based captioning with embedding reward
-
Application No.: US16448900Application Date: 2019-06-21
-
Publication No.: US10726059B1Publication Date: 2020-07-28
- Inventor: Zhou Ren , Xiaoyu Wang , Ning Zhang , Xutao Lv , Jia Li
- Applicant: Snap Inc.
- Applicant Address: US CA Santa Monica
- Assignee: Snap Inc.
- Current Assignee: Snap Inc.
- Current Assignee Address: US CA Santa Monica
- Agency: Schwegman Lundberg & Woessner, P.A.
- Main IPC: G06K9/00
- IPC: G06K9/00 ; G06F16/338 ; G06F16/33 ; G06K9/72 ; G06K9/46 ; G06K9/66 ; G06N5/02
Abstract:
An image captioning system and method is provided for generating a caption for an image. The image captioning system utilizes a policy network and a value network to generate the caption. The policy network serves as a local guidance and the value network serves as a global and lookahead guidance.
Information query
