-
公开(公告)号:US11662805B2
公开(公告)日:2023-05-30
申请号:US17301655
申请日:2021-04-09
Applicant: Snap Inc.
Inventor: Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: G06F3/01 , G06F3/038 , H04L67/131
CPC classification number: G06F3/012 , G06F3/038 , H04L67/131 , G06F2203/0383
Abstract: A method for calibrating a visual-inertial tracking system is described. A device operates the visual-inertial tracking system without receiving a tracking request from a virtual object display application. In response to operating the visual-inertial tracking system, the device accesses sensor data from sensors at the device. The device identifies, based on the sensor data, a first calibration parameter value of the visual-inertial tracking system and stores the first calibration parameter value. The system detects a tracking request from the virtual object display application. In response to the tracking request, the system accesses the first calibration parameter value and determines a second calibration parameter value from the first calibration parameter value.
-
公开(公告)号:US20220377238A1
公开(公告)日:2022-11-24
申请号:US17521109
申请日:2021-11-08
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Daniel Wolf
Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.
-
公开(公告)号:US20220374091A1
公开(公告)日:2022-11-24
申请号:US17524423
申请日:2021-11-11
Applicant: Snap Inc.
Inventor: Jeroen Diederik Hol , Matthias Kalkgruber
IPC: G06F3/0346 , G06F3/038
Abstract: A method for dynamically initializing a 3 degrees of freedom (3DOF) tracking device is described. In one aspect, the method includes accessing a gyroscope signal from a gyroscope of the 3DOF tracking device, accessing an accelerometer signal from an accelerometer of the 3DOF tracking device, determining an initial state includes a combination of an initial orientation, an initial position, and an initial velocity of the 3DOF tracking device, the initial state indicating a starting condition of the 3DOF tracking device, integrating the gyroscope signal and the accelerometer signal to obtain orientation and position signals using the initial state, and refining an inclination signal of the orientation signal using the position signal.
-
公开(公告)号:US20250093948A1
公开(公告)日:2025-03-20
申请号:US18970124
申请日:2024-12-05
Applicant: Snap Inc.
Inventor: Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: G06F3/01 , G06F3/038 , H04L67/131
Abstract: A method for calibrating a visual-inertial tracking system is described. A device operates the visual-inertial tracking system without receiving a tracking request from a virtual object display application. In response to operating the visual-inertial tracking system, the device accesses sensor data from sensors at the device. The device identifies, based on the sensor data, a first calibration parameter value of the visual-inertial tracking system and stores the first calibration parameter value. The system detects a tracking request from the virtual object display application. In response to the tracking request, the system accesses the first calibration parameter value and determines a second calibration parameter value from the first calibration parameter value.
-
公开(公告)号:US20250071422A1
公开(公告)日:2025-02-27
申请号:US18947329
申请日:2024-11-14
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Daniel Wolf
Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.
-
公开(公告)号:US20240314461A1
公开(公告)日:2024-09-19
申请号:US18677296
申请日:2024-05-29
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Erick Mendez Mendez , Daniel Wagner , Daniel Wolf , Kai Zhou
IPC: H04N25/531 , G02B27/01 , H04N23/51
CPC classification number: H04N25/531 , G02B27/0172 , H04N23/51 , G02B2027/0138 , G02B2027/014 , G02B2027/0178
Abstract: Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.
-
公开(公告)号:US20240312145A1
公开(公告)日:2024-09-19
申请号:US18184333
申请日:2023-03-15
Applicant: Snap Inc.
CPC classification number: G06T19/006 , G01C21/1652 , G01C21/1656 , G02B27/0172 , G06V10/761 , G02B2027/0178
Abstract: A method for correcting bending of a flexible display device is described. The method includes forming a plurality of sensor groups of an augmented reality (AR) display device, where one of the plurality of sensor groups includes a combination of a camera, an IMU (inertial measurement unit), and a component, each being tightly coupled to each other, a spatial relationship between the camera, the IMU sensor, or the component being predefined, accessing sensor groups data from the plurality of sensor groups, estimating a spatial relationship between the plurality of sensor groups based on the sensor groups data, and displaying virtual content in a display of the AR display device based on the spatial relationship between the plurality of sensor groups.
-
公开(公告)号:US20240192024A1
公开(公告)日:2024-06-13
申请号:US18063450
申请日:2022-12-08
Applicant: Snap Inc.
Inventor: Georg Halmetschlager-Funek , Jeroen Diederik Hol , Matthias Kalkgruber , Tiago Miguel Pereira Torres
CPC classification number: G01C25/005 , G01C21/1656 , G06F3/012
Abstract: A method for calibrating a visual-inertial tracking system is described. In one aspect, a method includes measuring a temperature of an inertial measurement unit (IMU) of a visual-inertial tracking system, identifying, from an IMU parametric model of an IMU calibration module, an IMU intrinsic parameter estimate corresponding to the temperature, determining an online IMU intrinsic parameter estimate by operating the visual-inertial tracking system with the IMU intrinsic parameter estimate, providing the online IMU intrinsic parameter estimate to the IMU calibration module, and updating and incorporating the IMU parametric model with the online IMU intrinsic parameter estimate.
-
公开(公告)号:US12008155B2
公开(公告)日:2024-06-11
申请号:US18201419
申请日:2023-05-24
Applicant: Snap Inc.
Inventor: Jeroen Diederik Hol , Matthias Kalkgruber , Erick Mendez Mendez , Niall Murphy , Gerald Nilles , Mathieu Emmanuel Vignau
CPC classification number: G06F3/012 , G01C21/1656 , G02B27/0172 , G02B27/0179 , G06F3/14 , G06T7/20 , G02B2027/0138 , G02B2027/014 , G02B2027/0178
Abstract: A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data.
-
公开(公告)号:US11988833B2
公开(公告)日:2024-05-21
申请号:US17937950
申请日:2022-10-04
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Tiago Miguel Pereira Torres , Weston Welge , Ramzi Zahreddine
CPC classification number: G02B27/017 , G02B27/0093 , G06T19/006 , G02B2027/0178
Abstract: A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.
-
-
-
-
-
-
-
-
-