Invention Grant
- Patent Title: Training of joint depth prediction and completion
-
Application No.: US17154223Application Date: 2021-01-21
-
Publication No.: US11557051B2Publication Date: 2023-01-17
- Inventor: Vitor Guizilini , Rares A. Ambrus , Adrien David Gaidon
- Applicant: Toyota Research Institute, Inc.
- Applicant Address: US CA Los Altos
- Assignee: Toyota Research Institute, Inc.
- Current Assignee: Toyota Research Institute, Inc.
- Current Assignee Address: US CA Los Altos
- Agency: Darrow Mustafa PC
- Agent Christopher G. Darrow
- Main IPC: G06T7/50
- IPC: G06T7/50 ; B60W60/00 ; G01C21/00 ; B60W30/095 ; G06V10/40 ; G06V20/56 ; G01B11/22 ; G01S17/08 ; G01S17/89 ; G06T9/00

Abstract:
System, methods, and other embodiments described herein relate to training a depth model for joint depth completion and prediction. In one arrangement, a method includes generating depth features from sparse depth data according to a sparse auxiliary network (SAN) of a depth model. The method includes generating a first depth map from a monocular image and a second depth map from the monocular image and the depth features using the depth model. The method includes generating a depth loss from the second depth map and the sparse depth data and an image loss from the first depth map and the sparse depth data. The method includes updating the depth model including the SAN using the depth loss and the image loss.
Public/Granted literature
- US20220148203A1 TRAINING OF JOINT DEPTH PREDICTION AND COMPLETION Public/Granted day:2022-05-12
Information query