-
公开(公告)号:US20220066552A1
公开(公告)日:2022-03-03
申请号:US17421163
申请日:2020-01-21
Applicant: Sony Advanced Visual Sensing AG
Inventor: Christian Brändli , Raphael Berner , Michael Gassner
Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.
-
公开(公告)号:US20210151492A1
公开(公告)日:2021-05-20
申请号:US17161961
申请日:2021-01-29
Applicant: SONY ADVANCED VISUAL SENSING AG
Inventor: Raphael Berner , Christian Brändli , Massimo Zannoni
IPC: H01L27/146 , H04N5/351 , H04N5/369 , H01L29/423 , H04N5/3745
Abstract: An event-based vision sensor is fabricated using an advanced stacking technique, known as Three-Dimensional Integrated Circuit, which stacks more wafers (or dies) and interconnects them vertically. The electronic integrated circuits of the sensor are then distributed between the two or more electrically connected dies.
-
公开(公告)号:US11825229B2
公开(公告)日:2023-11-21
申请号:US17609439
申请日:2020-05-08
Applicant: SONY ADVANCED VISUAL SENSING AG
Inventor: Christian Brändli , Raphael Berner
IPC: H04N25/772 , H04N25/40 , H04N25/75 , H04N25/766
CPC classification number: H04N25/772 , H04N25/40 , H04N25/75 , H04N25/766
Abstract: A dynamic vision sensor such as an event based vision sensor employs analog to digital converters (ADC), such as ramp ADCs, that analog to digital converts the signals from photoreceptors. Only previous light values need to be stored in the pixels. This is accomplished by generating three ramps. In addition, log compression can be implemented by increasing the count linearly while increasing the reference voltage exponentially, or increasing the count logarithmically while increasing the reference voltage linearly.
-
公开(公告)号:US11812169B2
公开(公告)日:2023-11-07
申请号:US17609437
申请日:2020-05-08
Applicant: Sony Advanced Visual Sensing AG
Inventor: Christian Brändli , Raphael Berner
IPC: H04N25/50 , H04N25/771 , H04N25/772
CPC classification number: H04N25/50 , H04N25/771 , H04N25/772
Abstract: A dynamic vision sensor such as an event based vision sensor employs analog to digital converters (ADC), such as ramp ADCs, that analog to digital converts the signals from photoreceptors. Current and previous light values are then stored and compared digitally. In addition, log compression can be implemented by increasing the count linearly while increasing the reference voltage exponentially, or increasing the count logarithmically while increasing the reference voltage linearly.
-
公开(公告)号:US20220224853A1
公开(公告)日:2022-07-14
申请号:US17609438
申请日:2020-05-08
Applicant: SONY ADVANCED VISUAL SENSING AG
Inventor: Raphael Berner , Chistian Brändli
IPC: H04N5/378 , H04N5/3745 , H04N5/369 , H04N5/376
Abstract: An NMOS-only operational transconductance amplifier (OTA) replaces the PMOS transistors with switched capacitor pseudo-resistors in the pixels of an optical sensor such as a dynamic vision sensor or event-based vision sensor. Thus, if a stacked CMOS image sensor (CIS) process is employed, then the upper wafer can be kept free from N-wells, while still having the complete OTA on the upper wafer. Thus, it is possible to have only one wafer-to-wafer connection per pixel. Moreover, by operating the switched capacitor pseudo-resistors as three terminal devices, the gain can further be increased.
-
公开(公告)号:US20210337151A1
公开(公告)日:2021-10-28
申请号:US17366392
申请日:2021-07-02
Applicant: SONY ADVANCED VISUAL SENSING AG
Inventor: Raphael Berner , Christian Brändli
IPC: H04N5/378 , H04N5/3745 , H04N5/374 , H04N5/335 , H04N5/341 , G01J1/46 , G06F11/00 , G06T7/20 , H04N5/355
Abstract: A dynamic vision sensor (DVS) or change detection sensor reacts to changes in light intensity and in this way monitors how a scene changes. This disclosure covers both single pixel and array architectures. The DVS may contain one pixel or 2-dimensional or 1-dimensional array of pixels. The change of intensities registered by pixels are compared, and pixel addresses where the change is positive or negative are recorded and processed. Analyzing frames based on just three values for pixels, increase, decrease or unchanged, the proposed DVS can process visual information much faster than traditional computer vision systems, which correlate multi-bit color or gray level pixel values between successive frames.
-
公开(公告)号:US11991466B2
公开(公告)日:2024-05-21
申请号:US17888556
申请日:2022-08-16
Applicant: Sony Advanced Visual Sensing AG
Inventor: Raphael Berner , Christian Brändli , Massimo Zannoni
IPC: H04N25/75 , G01J1/46 , G06F11/00 , G06T7/20 , H04N25/40 , H04N25/47 , H04N25/571 , H04N25/766 , H04N25/77 , H04N25/772
CPC classification number: H04N25/75 , G01J1/46 , G06F11/004 , G06T7/20 , H04N25/40 , H04N25/47 , H04N25/573 , H04N25/766 , H04N25/77 , H04N25/772 , G06F2201/86 , G06F2201/88
Abstract: In dynamic vision sensor (DVS) or change detection sensors, the chip or sensor is configured to control or modulate the event rate. For example, this control can be used to keep the event rate close to a desired rate or within desired bounds. Adapting the configuration of the sensor to the scene by changing the ON-event and/or the OFF-event thresholds, allows having necessary amount of data, but not much more than necessary, such that the overall system gets as much information about its state as possible.
-
公开(公告)号:US20240107194A1
公开(公告)日:2024-03-28
申请号:US18528158
申请日:2023-12-04
Applicant: Sony Advanced Visual Sensing AG
Inventor: Raphael Berner
Abstract: An event based pixel sensor system employing delay equalization between differently illuminated pixels.
-
公开(公告)号:US11886637B2
公开(公告)日:2024-01-30
申请号:US18080148
申请日:2022-12-13
Applicant: Sony Advanced Visual Sensing AG
Inventor: Christian Brandli , Raphael Berner , Michael Gassner
CPC classification number: G06F3/013 , G06T15/205 , G06T19/006 , G06V20/20 , G06T2215/06
Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.
-
公开(公告)号:US20220272296A1
公开(公告)日:2022-08-25
申请号:US17629488
申请日:2020-09-01
Applicant: Sony Advanced Visual Sensing AG
Inventor: Raphael Berner
IPC: H04N5/3745 , H04N5/351 , H04N5/378
Abstract: An event based pixel sensor system employing delay equalization between differently illuminated pixels.
-
-
-
-
-
-
-
-
-