Invention Grant
- Patent Title: Self-supervised multi-frame monocular depth estimation model
-
Application No.: US17545201Application Date: 2021-12-08
-
Publication No.: US12080010B2Publication Date: 2024-09-03
- Inventor: James Watson , Oisin MacAodha , Victor Adrian Prisacariu , Gabriel J. Brostow , Michael David Firman
- Applicant: Niantic, Inc.
- Applicant Address: US CA San Francisco
- Assignee: NIANTIC, INC.
- Current Assignee: NIANTIC, INC.
- Current Assignee Address: US CA San Francisco
- Agency: FENWICK & WEST LLP
- Main IPC: G06T7/55
- IPC: G06T7/55 ; G01B11/22 ; G06T3/18 ; G06T7/73 ; G06T11/00

Abstract:
A multi-frame depth estimation model is disclosed. The model is trained and configured to receive an input image and an additional image. The model outputs a depth map for the input image based on the input image and the additional image. The model may extract a feature map for the input image and an additional feature map for the additional image. For each of a plurality of depth planes, the model warps the feature map to the depth plane based on relative pose between the input image and the additional image, the depth plane, and camera intrinsics. The model builds a cost volume from the warped feature maps for the plurality of depth planes. A decoder of the model inputs the cost volume and the input image to output the depth map.
Public/Granted literature
- US20220189049A1 Self-Supervised Multi-Frame Monocular Depth Estimation Model Public/Granted day:2022-06-16
Information query