Invention Grant
- Patent Title: System and method for lifting 3D representations from monocular images
-
Application No.: US16269172Application Date: 2019-02-06
-
Publication No.: US11010592B2Publication Date: 2021-05-18
- Inventor: Wadim Kehl , Fabian Manhardt
- Applicant: Toyota Research Institute, Inc.
- Applicant Address: US CA Los Altos
- Assignee: Toyota Research Institute, Inc.
- Current Assignee: Toyota Research Institute, Inc.
- Current Assignee Address: US CA Los Altos
- Agency: Darrow Mustafa PC
- Agent Christopher G. Darrow
- Main IPC: G06K9/00
- IPC: G06K9/00 ; G06T7/73 ; G06T7/174 ; G06T7/55 ; G06T7/11

Abstract:
In one embodiment, example systems and methods relate to a manner of generating 3D representations from monocular 2D images. A monocular 2D image is captured by a camera. The 2D image is processed to create one or more feature maps. The features may include depth features, or object labels, for example. Based on the image and the feature map, regions-of-interest corresponding to vehicles in the image are determined. For each region-of-interest a lifting function is applied to the region-of-interest to determine values such as height and width, camera distance, and rotation. The determined values are used to create an eight-point box that is a 3D representation of the vehicle depicted by the region-of-interest. The 3D representation can be used for a variety of purposes such as route planning, object avoidance, or as training data, for example.
Public/Granted literature
- US20200160033A1 SYSTEM AND METHOD FOR LIFTING 3D REPRESENTATIONS FROM MONOCULAR IMAGES Public/Granted day:2020-05-21
Information query