Invention Grant
- Patent Title: Methods, apparatuses, and computer program products using a repeated convolution-based attention module for improved neural network implementations
-
Application No.: US16559032Application Date: 2019-09-03
-
Publication No.: US11651191B2Publication Date: 2023-05-16
- Inventor: Amritpal Singh Gill , Nicholas Dronen , Shubhabrata Roy , Raghavendran Balu
- Applicant: HERE Global B.V.
- Applicant Address: NL Eindhoven
- Assignee: Here Global B.V.
- Current Assignee: Here Global B.V.
- Current Assignee Address: NL Eindhoven
- Agency: Alston & Bird LLP
- Main IPC: G06N3/00
- IPC: G06N3/00 ; G06N3/04 ; G06N3/08 ; G06V10/82

Abstract:
A method, apparatus, and computer program product are provided for providing improved neural network implementations using a repeated convolution-based attention module. Example embodiments implement a repeated convolution-based attention module that utilizes multiple iterations of a repeated convolutional application layer and subsequent augmentations to generate an attention module output. Example methods may include augmenting an attention input data object based on a previous iteration convolutional output to produce a current iteration input parameter, inputting the input parameter to a repeated convolutional application layer to generate a current iteration input parameter, repeating for multiple iterations, and augmenting the attention input data object based on the final convolutional output to produce an attention module output. Other methods may include an initial convolutional application layer, and/or apply and augment the output of the initial convolutional application layer, and include convolutional application layer(s) having at least two sub-layers.
Public/Granted literature
Information query
IPC分类:
G | 物理 |
G06 | 计算;推算或计数 |
G06N | 基于特定计算模型的计算机系统 |
G06N3/00 | 基于生物学模型的计算机系统 |