公开(公告)号：WO2018052714A2

公开(公告)日：2018-03-22

申请号：PCT/US2017/049327

申请日：2017-08-30

Applicant: NEC LABORATORIES AMERICA, INC.

Inventor： MALVIN, Iain ,  COSATTO, Eric ,  DURDANOVIC, Igor ,  GRAF, Hans, Peter

CPC classification number: G06K9/4628 ,  G06K9/00664 ,  G06K9/00791 ,  G06K9/6274 ,  G06K9/6289

Abstract: A computer-implemented method and system are provided. The system includes an image capture device (510) configured to capture image data relative to an ambient environment of a user. The system further includes a processor (511) configured to detect and localize objects, in a real-world map space, from the image data using a trainable object localization Convolutional Neural Network (CNN). The CNN is trained to detect and localize the objects from image and radar pairs that include the image data and radar data for different scenes of a natural environment. The processor (511) is further configured to perform a user-perceptible action responsive to a detection and a localization of an object in an intended path of the user.

Abstract translation: 提供了一种计算机实现的方法和系统。 该系统包括图像捕获设备（510），其被配置成捕获与用户的周围环境相关的图像数据。 该系统还包括处理器（511），其被配置为使用可训练对象定位卷积神经网络（CNN）从图像数据检测和定位真实世界地图空间中的对象。 美国有线电视新闻网的训练是检测和定位来自图像和雷达对的物体，其中包括自然环境不同场景的图像数据和雷达数据。 处理器（511）还被配置为响应于用户的预期路径中的对象的检测和定位来执行用户可感知的动作。

公开(公告)号：WO2018052714A3

公开(公告)日：2018-03-22

申请号：PCT/US2017/049327

申请日：2017-08-30

Applicant: NEC LABORATORIES AMERICA, INC.

Inventor： MALVIN, Iain ,  COSATTO, Eric ,  DURDANOVIC, Igor ,  GRAF, Hans, Peter

IPC: G06K9/00 ,  G06K9/62 ,  G06N3/08 ,  B60W30/09 ,  B60R1/00

Abstract: A computer-implemented method and system are provided. The system includes an image capture device (510) configured to capture image data relative to an ambient environment of a user. The system further includes a processor (511) configured to detect and localize objects, in a real-world map space, from the image data using a trainable object localization Convolutional Neural Network (CNN). The CNN is trained to detect and localize the objects from image and radar pairs that include the image data and radar data for different scenes of a natural environment. The processor (511) is further configured to perform a user-perceptible action responsive to a detection and a localization of an object in an intended path of the user.