Invention Grant
- Patent Title: Systems and methods for multi-camera modeling with neural camera networks
-
Application No.: US17021940Application Date: 2020-09-15
-
Publication No.: US11321862B2Publication Date: 2022-05-03
- Inventor: Vitor Guizilini , Igor Vasiljevic , Rares A. Ambrus , Adrien Gaidon
- Applicant: TOYOTA RESEARCH INSTITUTE, INC.
- Applicant Address: US CA Los Altos
- Assignee: TOYOTA RESEARCH INSTITUTE, INC.
- Current Assignee: TOYOTA RESEARCH INSTITUTE, INC.
- Current Assignee Address: US CA Los Altos
- Agency: Sheppard, Mullin, Richter & Hampton LLP
- Agent Daniel N. Yannuzzi; Hector A. Agdeppa
- Main IPC: G06T7/55
- IPC: G06T7/55 ; G06T7/30 ; G06T3/00 ; G05D1/02

Abstract:
Systems and methods for self-supervised depth estimation using image frames captured from a plurality of cameras mounted on a vehicle, may include: receiving a first image from a camera mounted at a first location on the vehicle, the source image comprising pixels representing a scene of the environment of the vehicle; receiving a reference image from a camera mounted at a second location on the vehicle, the reference image comprising pixels representing a scene of the environment; predicting a depth map for the first image, the depth map comprising predicted depth values for pixels of the first image; warping the first image to a perspective of the camera mounted at the second location on the vehicle to arrive at a warped first image; projecting the warped first image onto the source image; determining a loss based on the projection; and updating the predicted depth values for the first image.
Public/Granted literature
- US20220084229A1 SYSTEMS AND METHODS FOR MULTI-CAMERA MODELING WITH NEURAL CAMERA NETWORKS Public/Granted day:2022-03-17
Information query