公开(公告)号：US20230037261A1

公开(公告)日：2023-02-02

申请号：US17865223

申请日：2022-07-14

Applicant: Meta Platforms Technologies, LLC

Inventor： Qing Chao ,  Lu Lu ,  Xinqiao Liu ,  Hao Yu ,  Junren Wang

IPC: H04N5/33 ,  G02B5/32 ,  G02B3/00 ,  G02B5/20

Abstract: Imaging systems, cameras, and image sensors of this disclosure include imaging pixels that include subpixels. Diffractive optical elements such as a metasurface lens layers or a liquid crystal polarization hologram (LCPH) are configured to focus image light to the subpixels of the imaging pixels.

公开(公告)号：US11568609B1

公开(公告)日：2023-01-31

申请号：US17315056

申请日：2021-05-07

Applicant: Meta Platforms Technologies, LLC

Inventor： Xinqiao Liu ,  Barbara De Salvo ,  Hans Reyserhove ,  Ziyun Li ,  Asif Imtiaz Khan ,  Syed Shakib Sarwar

IPC: G06T19/00 ,  G06F3/01 ,  G06T7/73 ,  G02B27/01 ,  G06V20/20 ,  G06K9/62 ,  G06V10/44 ,  G06V10/94 ,  G06V20/64 ,  G06V30/192 ,  H04N5/378 ,  H01L27/146 ,  H01L31/0352 ,  H01L31/0384 ,  H01L27/28 ,  H01L27/30

Abstract: In one example, an apparatus comprises: a first sensor layer, including an array of pixel cells configured to generate pixel data; and one or more semiconductor layers located beneath the first sensor layer with the one or more semiconductor layers being electrically connected to the first sensor layer via interconnects. The one or more semiconductor layers comprises on-chip compute circuits configured to receive the pixel data via the interconnects and process the pixel data, the on-chip compute circuits comprising: a machine learning (ML) model accelerator configured to implement a convolutional neural network (CNN) model to process the pixel data; a first memory to store coefficients of the CNN model and instruction codes; a second memory to store the pixel data of a frame; and a controller configured to execute the codes to control operations of the ML model accelerator, the first memory, and the second memory.

公开(公告)号：US11567318B1

公开(公告)日：2023-01-31

申请号：US16135452

申请日：2018-09-19

Applicant: Meta Platforms Technologies, LLC

Inventor： Michael Hall ,  Xinqiao Liu

IPC: G02B27/01 ,  G06F3/01 ,  G01B11/22 ,  G06T19/00 ,  G06V40/18

Abstract: An eye monitoring system is included in a headset of a virtual reality system or of an augmented reality system. The eye monitoring system determines distances between the eye monitoring system and portions of a user's eye enclosed by the headset. The eye monitoring system projects a temporally periodic pattern of light onto the user's eye via a sensor. The eye monitoring system determines a distance between the eye monitoring system and locations of the user's eye based on a phase shift of the periodic pattern of light captured by each pixel of the sensor. From the determined distances, the eye monitoring system determines features of the user's eye.

公开(公告)号：US20220408049A1

公开(公告)日：2022-12-22

申请号：US17728880

申请日：2022-04-25

Applicant: Meta Platforms Technologies, LLC

Inventor： Ziyun Li ,  Barbara De Salvo ,  Xinqiao Liu ,  Lyle David Bainbridge ,  Andrew Samuel Berkovich ,  Syed Shakib Sarwar ,  Song Chen ,  Tsung-Hsun Tsai

IPC: H04N5/369 ,  H01L27/146

Abstract: A stacked camera-image-sensor circuit may include (i) a first layer that includes a plurality of image sensing elements, (ii) a second layer that includes components that interface with the image sensing elements, and (iii) at least one additional layer that includes image-processing components. Various other methods, systems, and computer-readable media are also disclosed.

公开(公告)号：US20250159316A1

公开(公告)日：2025-05-15

申请号：US19019305

申请日：2025-01-13

Applicant: Meta Platforms Technologies, LLC

Inventor： Qing Chao ,  Lu Lu ,  Xinqiao Liu ,  Hao Yu ,  Junren Wang

IPC: H04N23/11 ,  G02B1/00 ,  G02B3/00 ,  G02B5/20 ,  G02B5/30 ,  G02B5/32 ,  H04N23/00

Abstract: Imaging systems, cameras, and image sensors of this disclosure include imaging pixels that include subpixels. Diffractive optical elements such as a metasurface lens layers or a liquid crystal polarization hologram (LCPH) are configured to focus image light to the subpixels of the imaging pixels. Microlens regions of the diffractive optical elements may focus the image light to the subpixels of the imaging pixels.

公开(公告)号：US20250028389A1

公开(公告)日：2025-01-23

申请号：US18909167

申请日：2024-10-08

Applicant: Meta Platforms Technologies, LLC

Inventor： Qing Chao ,  Robert Dale Cavin ,  Guillaume Lestoquoy ,  Mohammadhossein Daraeihajitooei ,  Xinqiao Liu ,  Raffaele Capoccia ,  Sascha Hallstein ,  Ziyun Li

IPC: G06F3/01 ,  G06T7/73 ,  G06V10/25 ,  G06V10/60 ,  G06V40/18 ,  H04N5/33

Abstract: Imaging signals are generated in response to image light. Event signals are generated in response to receive the imaging signals from imaging pixels. A Region of Interest (ROI) of the imaging pixels is identified from a spatial concentration of event signals in the ROI of imaging pixels within a time period. An ROI portion of the imaging pixels in the ROI are driven to capture an ROI image frame.

公开(公告)号：US11962928B2

公开(公告)日：2024-04-16

申请号：US16715792

申请日：2019-12-16

Applicant: Meta Platforms Technologies, LLC

Inventor： Hans Reyserhove ,  Andrew Samuel Berkovich ,  Xinqiao Liu

IPC: H04N23/73

CPC classification number: H04N23/73

Abstract: In one example, an apparatus includes an array of pixel cells and a peripheral circuit. Each pixel cell of the array of pixel cells includes: a memory to store pixel-level programming data and measurement data, and light measurement circuits configured to, based on the pixel-level programming data from the control memory, perform a light measurement operation to generate the measurement data, and to store the measurement data at the data memory. The peripheral circuit is configured to: receive a pixel array programming map including pixel-level programming data targeted at each pixel cell; extract the pixel-level programming data from the pixel array programming map; and transmit the pixel-level programming data to each pixel cell of the array of pixel cells for storage at the memory of the each pixel cell and to individually control the light measurement operation and a generation of the measurement data at the each pixel cell.

公开(公告)号：US11960638B2

公开(公告)日：2024-04-16

申请号：US17992648

申请日：2022-11-22

Applicant: Meta Platforms Technologies, LLC

Inventor： Andrew Samuel Berkovich ,  Xinqiao Liu ,  Hans Reyserhove

IPC: G02B27/01 ,  G06F3/01 ,  G06F18/25 ,  G06V10/94 ,  G06V20/20 ,  G06V40/19 ,  H04N7/22 ,  H04N23/45 ,  H04N23/698

CPC classification number: G06F3/011 ,  G06F18/251 ,  G06V10/95 ,  G06V20/20 ,  G06V40/19 ,  H04N7/22 ,  H04N23/45 ,  H04N23/698

Abstract: In one example, a mobile device comprises: a physical link; a plurality of image sensors, each image sensor being configured to transmit image data via the physical link; and a controller coupled to the physical link, whereby the physical link, the plurality of image sensors, and the controller form a multi-drop network. The controller is configured to: transmit a control signal to configure image sensing operations at the plurality of image sensors; receive, via the physical link, image data from at least a subset of the plurality of image sensors; combine the image data from the at least a subset of the plurality of image sensors to obtain an extended field of view (FOV); determine information of a surrounding environment of the mobile device captured within the extended FOV; and provide the information to an application to generate content based on the information.

公开(公告)号：US11936998B1

公开(公告)日：2024-03-19

申请号：US17072840

申请日：2020-10-16

Applicant: Meta Platforms Technologies, LLC

Inventor： Tsung-Hsun Tsai ,  Lu Jie ,  Xinqiao Liu

IPC: H04N25/59 ,  H04N25/60

CPC classification number: H04N25/59 ,  H04N25/60

Abstract: In one example, an apparatus comprises: a photodiode configured to generate a charge in response to light within an exposure period, a charge sensing unit configured to accumulate at least a part of the charge as an overflow charge, a quantizer, and a controller configured to: within a first time within the exposure period, control the quantizer to perform a first quantization operation to quantize the overflow charge accumulated at the charge sensing unit to generate a first measurement output; within a second time after the first time, and within the exposure period, control the quantizer to perform a second quantization operation to quantize the overflow charge accumulated at the charge sensing unit to generate a second measurement output; and generate a digital output to represent an intensity of the light based on at least one of the first measurement output or the second measurement output.

公开(公告)号：US11906353B2

公开(公告)日：2024-02-20

申请号：US16435451

申请日：2019-06-07

Applicant: Meta Platforms Technologies, LLC

Inventor： Xinqiao Liu ,  Song Chen ,  Andrew Samuel Berkovich ,  Wei Gao

IPC: G01J1/44

CPC classification number: G01J1/44 ,  G01J2001/446

Abstract: In one example, an apparatus comprises a photodiode, a charge storage unit, and a processing circuits configured to: transfer overflow charge from the photodiode to the charge storage unit to develop a first voltage; compare the first voltage against a first ramping threshold voltage to generate a first decision; generate, based on the first decision, a first digital value; transfer residual charge from the photodiode to the charge storage unit to develop a second voltage; compare the second voltage against a static threshold voltage to determine whether the photodiode saturates to generate a second decision; compare the second voltage against a second ramping threshold voltage to generate a third decision; generate, based on the third decision, a second digital value; and output, based on the second decision, one of the first digital value or the second digital value to represent an intensity of light received by the photodiode.