公开(公告)号：US20220066552A1

公开(公告)日：2022-03-03

申请号：US17421163

申请日：2020-01-21

Applicant: Sony Advanced Visual Sensing AG

Inventor： Christian Brändli ,  Raphael Berner ,  Michael Gassner

IPC: G06F3/01 ,  G06K9/00 ,  G06T15/20 ,  G06T19/00

Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.

公开(公告)号：US11886637B2

公开(公告)日：2024-01-30

申请号：US18080148

申请日：2022-12-13

Applicant: Sony Advanced Visual Sensing AG

Inventor： Christian Brandli ,  Raphael Berner ,  Michael Gassner

IPC: G06F3/01 ,  G06V20/20 ,  G06T15/20 ,  G06T19/00

CPC classification number: G06F3/013 ,  G06T15/205 ,  G06T19/006 ,  G06V20/20 ,  G06T2215/06

Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.

公开(公告)号：US20230185372A1

公开(公告)日：2023-06-15

申请号：US18080148

申请日：2022-12-13

Applicant: Sony Advanced Visual Sensing AG

Inventor： Christian Brandli ,  Raphael Berner ,  Michael Gassner

IPC: G06F3/01 ,  G06V20/20 ,  G06T15/20 ,  G06T19/00

CPC classification number: G06F3/013 ,  G06V20/20 ,  G06T15/205 ,  G06T19/006 ,  G06T2215/16

Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.

公开(公告)号：US11526209B2

公开(公告)日：2022-12-13

申请号：US17421163

申请日：2020-01-21

Applicant: Sony Advanced Visual Sensing AG

Inventor： Christian Brändli ,  Raphael Berner ,  Michael Gassner

IPC: G06F3/01 ,  G06V20/20 ,  G06T15/20 ,  G06T19/00

Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.