公开(公告)号：US12148128B2

公开(公告)日：2024-11-19

申请号：US17521081

申请日：2021-11-08

Applicant: Snap Inc.

Inventor： Olha Borys ,  Matthias Kalkgruber ,  Daniel Wolf

IPC: G06K9/40 ,  G06T5/73 ,  G06T7/70 ,  G06T19/00

Abstract: A method for mitigating motion blur in a visual tracking system is described. In one aspect, a method for selective motion blur mitigation in a visual tracking system includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor during the optical sensor generating the first image, determining a motion of the optical sensor during the optical sensor generating the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and determining whether to downscale the first image using a pyramid computation algorithm based on the motion blur level.

公开(公告)号：US12126783B2

公开(公告)日：2024-10-22

申请号：US17747564

申请日：2022-05-18

Applicant: Snap Inc.

Inventor： Olha Borys ,  Georg Halmetschlager-Funek ,  Matthias Kalkgruber ,  Daniel Wolf ,  Jakob Zillner

IPC: H04N13/128 ,  G06T7/73 ,  H04N13/239 ,  H04N13/00

CPC classification number: H04N13/128 ,  G06T7/73 ,  H04N13/239 ,  G06T2207/10012 ,  G06T2207/20228 ,  H04N2013/0081

Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for misaligned vantage point mitigation for computer stereo vision. A misaligned vantage point mitigation system determines whether vantage points of the optical sensors are misaligned from an expected vantage point and, if so, determines an adjustment variable to mitigate the misalignment based on the location of matching features identified in images captured by both optical sensors.

公开(公告)号：US12099195B2

公开(公告)日：2024-09-24

申请号：US18218905

申请日：2023-07-06

Applicant: Snap Inc.

Inventor： Sumant Hanumante ,  Bernhard Jung ,  Matthias Kalkgruber ,  Anton Kondratenko ,  Edward Lee Kim-Koon ,  Gerald Nilles ,  John James Robertson ,  Dmitry Ryuma ,  Alexander Sourov ,  Daniel Wolf

IPC: G02B27/01 ,  G01K7/00 ,  G06F1/26 ,  G06F3/01 ,  G06T19/00 ,  G02B27/00

CPC classification number: G02B27/0172 ,  G01K7/00 ,  G06F1/26 ,  G06F3/011 ,  G06T19/006 ,  G01K2215/00 ,  G02B27/0093 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178

Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services it provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.

公开(公告)号：US11662805B2

公开(公告)日：2023-05-30

申请号：US17301655

申请日：2021-04-09

Applicant: Snap Inc.

Inventor： Georg Halmetschlager-Funek ,  Matthias Kalkgruber ,  Daniel Wolf ,  Jakob Zillner

IPC: G06F3/01 ,  G06F3/038 ,  H04L67/131

CPC classification number: G06F3/012 ,  G06F3/038 ,  H04L67/131 ,  G06F2203/0383

Abstract: A method for calibrating a visual-inertial tracking system is described. A device operates the visual-inertial tracking system without receiving a tracking request from a virtual object display application. In response to operating the visual-inertial tracking system, the device accesses sensor data from sensors at the device. The device identifies, based on the sensor data, a first calibration parameter value of the visual-inertial tracking system and stores the first calibration parameter value. The system detects a tracking request from the virtual object display application. In response to the tracking request, the system accesses the first calibration parameter value and determines a second calibration parameter value from the first calibration parameter value.

公开(公告)号：US20220377238A1

公开(公告)日：2022-11-24

申请号：US17521109

申请日：2021-11-08

Applicant: Snap Inc.

Inventor： Matthias Kalkgruber ,  Daniel Wolf

IPC: H04N5/232 ,  G06T5/00 ,  G06K9/46 ,  G06T7/20 ,  G06T3/40

Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.