Invention Grant
- Patent Title: Method, apparatus, and computer program product for generating an overhead view of an environment from a perspective image
-
Application No.: US17302114Application Date: 2021-04-23
-
Publication No.: US11720992B2Publication Date: 2023-08-08
- Inventor: Anirudh Viswanathan
- Applicant: HERE GLOBAL B.V.
- Applicant Address: NL Eindhoven
- Assignee: HERE GLOBAL B.V.
- Current Assignee: HERE GLOBAL B.V.
- Current Assignee Address: NL Eindhoven
- Agency: Alston & Bird LLP
- Main IPC: G06T1/20
- IPC: G06T1/20 ; G06T7/00 ; G01C21/36 ; G06T3/00 ; G01C21/00

Abstract:
A method, apparatus and computer program product are provided for warping a perspective image into the ground plane using a homography transformation to estimate a bird's eye view in real time. Methods may include: receiving first sensor data from a first vehicle traveling along a road segment in an environment, where the first sensor data includes perspective image data of the environment, and where the first sensor data includes a location and a heading; retrieving a satellite image associated with the location and heading; applying a deep neural network to regress a bird's eye view image from the perspective image data; applying a Generative Adversarial Network (GAN) to the regressed bird's eye view image using the satellite image as a target of the GAN to obtain a stabilized bird's eye view image; and deriving values of a homography matrix between the sensor data and the established bird's eye view image.
Public/Granted literature
Information query