公开(公告)号：US11526209B2

公开(公告)日：2022-12-13

申请号：US17421163

申请日：2020-01-21

Applicant: Sony Advanced Visual Sensing AG

Inventor： Christian Brändli ,  Raphael Berner ,  Michael Gassner

IPC: G06F3/01 ,  G06V20/20 ,  G06T15/20 ,  G06T19/00

Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.

公开(公告)号：US20220239851A1

公开(公告)日：2022-07-28

申请号：US17609437

申请日：2020-05-08

Applicant: Sony Advanced Visual Sensing AG

Inventor： Christian Brändli ,  Raphael Berner

IPC: H04N5/351 ,  H04N5/3745

Abstract: A dynamic vision sensor such as an event based vision sensor employs analog to digital converters (ADC), such as ramp ADCs, that analog to digital converts the signals from photoreceptors. Current and previous light values are then stored and compared digitally. In addition, log compression can be implemented by increasing the count linearly while increasing the reference voltage exponentially, or increasing the count logarithmically while increasing the reference voltage linearly.

公开(公告)号：US10904462B2

公开(公告)日：2021-01-26

申请号：US16682505

申请日：2019-11-13

Applicant: Sony Advanced Visual Sensing AG

Inventor： Raphael Berner

IPC: H04N5/351 ,  H04N5/345 ,  H04N5/3745 ,  H04N5/378

Abstract: According to the present invention there is provided a vision sensor comprising, an array of pixels (101) comprising rows and columns of pixels, wherein each pixel has an address assigned thereto which represents the position of the pixel in the array, wherein each pixel in the array of pixels comprises a photodiode (103) which can receive light, and which can output current having an amplitude proportional to the intensity of the received light; a photoreceptor circuit (104) which is electronically connected to the photodiode, and which is configured to convert current which it receives from the photodiode into a voltage; a first storage capacitor (105), and at least a first switch which (106) is positioned between the first storage capacitor and an output of the photoreceptor circuit, wherein the first switch can be selectively closed to electronically connect the output of the photoreceptor circuit to the first storage capacitor, or selectively opened to electronically disconnect the output of the photoreceptor circuit from the first storage capacitor; and a circuit (102, 201) which is configured so that it can be selectively electronically connected to a pixel in the array, and to determine if the difference between the voltage output from the photoreceptor circuit and the voltage across the first storage capacitor is greater than a predefined threshold voltage, and to output the address of the pixel to a receiver only if the difference between the voltage output from the photoreceptor circuit and the voltage across the first storage capacitor is greater than a predefined threshold voltage. There is further provided a corresponding method of vision sensing using the vision sensor.