Invention Grant
- Patent Title: System and method for sensor fusion system having distributed convolutional neural network
-
Application No.: US16913930Application Date: 2020-06-26
-
Publication No.: US11605228B2Publication Date: 2023-03-14
- Inventor: Ryan Haoyun Wu , Satish Ravindran , Adam Fuks
- Applicant: NXP USA, Inc.
- Applicant Address: US TX Austin
- Assignee: NXP USA, Inc.
- Current Assignee: NXP USA, Inc.
- Current Assignee Address: US TX Austin
- Main IPC: G06V20/50
- IPC: G06V20/50 ; G06N3/04 ; G06N3/08 ; G06V10/82 ; G05D1/02

Abstract:
An early fusion network is provided that reduces network load and enables easier design of specialized ASIC edge processors through performing a portion of convolutional neural network layers at distributed edge and data-network processors prior to transmitting data to a centralized processor for fully-connected/deconvolutional neural networking processing. Embodiments can provide convolution and downsampling layer processing in association with the digital signal processors associated with edge sensors. Once the raw data is reduced to smaller feature maps through the convolution-downsampling process, this reduced data is transmitted to a central processor for further processing such as regression, classification, and segmentation, along with feature combination of the data from the sensors. In some embodiments, feature combination can be distributed to gateway or switch nodes closer to the edge sensors, thereby further reducing the data transferred to the central node and reducing the amount of computation performed there.
Public/Granted literature
- US20210406674A1 System and Method for Sensor Fusion System Having Distributed Convolutional Neural Network Public/Granted day:2021-12-30
Information query