公开(公告)号：US11949213B2

公开(公告)日：2024-04-02

申请号：US17069731

申请日：2020-10-13

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Nadav Grossinger ,  Michael Hall ,  Robert Hasbun ,  Jonatan Ginzburg ,  Zihe Gao

IPC: H01S5/42 ,  G01S17/89 ,  G02B27/01 ,  G06T7/521 ,  H04N13/271

CPC classification number: H01S5/423 ,  G01S17/89 ,  G02B27/0172 ,  G06T7/521 ,  H04N13/271

Abstract: A depth camera assembly (DCA) determines depth information for a local area. The DCA includes a camera assembly and at least one illuminator. The DCA may select a subset of the VCSELs to provide illumination at any given time. The illuminator may comprise near-field VCSELs configured to generate a structured light (SL) pattern for depth sensing in the near-field and far-field VCSELs configured to generate a SL pattern for depth sensing in the far-field. The near-field VCSELs may comprise a linear emission region which is shorter than a linear emission region of the far-field VCSELs. The DCA may generate and phase shift a quasi-sinusoidal SL pattern. The DCA may phase shift the quasi-sinusoidal SL pattern by alternating which traces on the illuminator are active.

公开(公告)号：US11754720B2

公开(公告)日：2023-09-12

申请号：US17536985

申请日：2021-11-29

Applicant: Meta Platforms Technologies, LLC

Inventor： Augusto Ronchini Ximenes ,  Michael Hall

IPC: G01S17/00 ,  G01S17/894 ,  G01S7/4865 ,  G06T7/80 ,  G06T7/521

CPC classification number: G01S17/894 ,  G01S7/4865 ,  G06T7/521 ,  G06T7/80

Abstract: A depth camera assembly is used to obtain depth information describing a local area. The depth camera assembly includes a sensor having a plurality of pixels. Some or all of the pixels are divided into groups that are coupled to respective multi-purpose time-to-digital converters. Each multi-purpose time-to-digital converter comprises an oscillator and a counter. Each pixel in a group is associated with a multiplexer that is configured to select between inputs coupled to the pixel, the oscillator, or a counter associated with a different pixel. The multiplexer outputs the signal to the counter for the time-to-digital converter associated with the pixel. A time-of-flight measurement is taken during a first portion of an image frame. During a second portion of the image frame, the sensor may be used as an intensity counter. During a third portion of the image frame, the depth sensor may be calibrated.

公开(公告)号：US11703323B2

公开(公告)日：2023-07-18

申请号：US17230109

申请日：2021-04-14

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Michael Hall ,  Xinqiao Liu ,  Zhaoming Zhu ,  Rajesh Lachhmandas Chhabria ,  Huixuan Tang ,  Shuochen Su

IPC: G06T7/00 ,  G01B11/25 ,  G06T7/521 ,  G06T7/529 ,  G02B27/01 ,  G06T7/11 ,  G06T7/174 ,  G01B11/22 ,  G06T7/55 ,  G06T7/90 ,  H04N13/106 ,  H04N13/204 ,  G06T7/593 ,  H04N13/128 ,  H04N13/271 ,  H04N13/239 ,  H04N23/56 ,  G06V10/22 ,  G06V10/145 ,  H04N13/00

CPC classification number: G01B11/2513 ,  G01B11/22 ,  G02B27/0172 ,  G06T7/11 ,  G06T7/174 ,  G06T7/521 ,  G06T7/529 ,  G06T7/55 ,  G06T7/593 ,  G06T7/90 ,  G06T7/97 ,  G06V10/145 ,  G06V10/22 ,  H04N13/106 ,  H04N13/128 ,  H04N13/204 ,  H04N13/239 ,  H04N13/271 ,  H04N23/56 ,  G02B2027/014 ,  G02B2027/0138 ,  G02B2027/0178 ,  G06T2207/10028 ,  H04N2013/0081

Abstract: A depth estimation system is described capable of determining depth information using two images from two cameras. A first camera captures a first image and a second camera captures a second image, both images including a plurality of light channels. A scan direction is selected from a plurality of scan directions. For the selected scan direction, along each of a plurality of scanlines, the system compares pixels from the first image to pixels from the second image. The comparison is based on calculating a census transform for each pixel in the first image and a census transform for each pixel in the second image. This comparison is used to determine a stereo correspondence between the pixels in the first image and the pixels in the second image. The system generates a depth map based on the stereo correspondence.

公开(公告)号：US11585937B2

公开(公告)日：2023-02-21

申请号：US16826209

申请日：2020-03-21

Applicant: Meta Platforms Technologies, LLC

Inventor： Augusto Ronchini Ximenes ,  Michael Hall

IPC: G01S17/00 ,  G01S17/894 ,  G01S7/4863 ,  G06T19/20 ,  G06F3/01 ,  H04N13/254 ,  G01S7/483 ,  G06T7/50 ,  G02B27/01 ,  G01S17/08 ,  H04N13/00 ,  H04S7/00 ,  G04F10/00 ,  G01S17/88 ,  G01S7/4865

Abstract: A depth camera assembly (DCA) includes a direct time of flight system for determining depth information for a local area. The DCA includes an illumination source, a camera, and a controller. The illumination source projects light (e.g., pulse of light) into the local area. The camera detects reflections of the projected light from objects in the local area. Using an internal gating selection procedure, the controller selects a gate window that is likely to be associated with reflection of a pulse of light from an object. The selected gate may be used for depth determination. The internal gating selection procedures may be achieved through external target location and selection or through internal self-selection.

公开(公告)号：US11516457B2

公开(公告)日：2022-11-29

申请号：US17348469

申请日：2021-06-15

Applicant: Meta Platforms Technologies, LLC

Inventor： Zihe Gao ,  Michael Hall ,  Qing Chao ,  Zhaoming Zhu ,  Tin Komljenovic

IPC: G01B11/25 ,  H04N13/254 ,  G02B27/01 ,  G02F1/225

Abstract: A switchable fringe pattern illuminator includes an optical path switch configured to receive light and dynamically control an amount of light that is provided to a first waveguide and an amount of light that is provided to a second waveguide. A first projector configured to generate a first fringe pattern using light from the first waveguide. The first fringe pattern illuminates a first portion of a target area. A second projector configured to generate a second fringe pattern using light from the second waveguide. The second fringe pattern illuminates a second portion of a target area. The illuminator may be part of a depth camera assembly (DCA). The DCA is configured to capture images of a portion of the target area. The DCA is further configured to determine depth information for an object in the target area based in part on the captured images.

公开(公告)号：US11435528B1

公开(公告)日：2022-09-06

申请号：US16924676

申请日：2020-07-09

Applicant: Meta Platforms Technologies, LLC

Inventor： Zihe Gao ,  Zhaoming Zhu ,  Michael Hall ,  Guohua Wei

IPC: G02B6/34 ,  G01B11/22 ,  G02B27/01 ,  G02B27/09 ,  G02B6/42

Abstract: A photonic integrated circuit assembly generates light for use in a display system or a depth sensing system. The photonic integrated circuit assembly includes optical conditioning elements integrated into a photonic integrated circuit. The photonic integrated circuit includes one or more light sources on the photonic integrated circuit. The photonic integrated circuit includes a waveguide and one or more gratings located in a core of the photonic integrated circuit. The gratings may collimate and/or collocate light emitted by the light source. The photonic integrated circuit may include a beam shaping element integrated into the photonic integrated circuit. A MEMS scanner may use the collocated and/or collimated light emitted by the photonic integrated circuit to generate a display for a user or to generate a structured light pattern for use in a depth sensing system.