-
公开(公告)号:US20240427156A1
公开(公告)日:2024-12-26
申请号:US18826772
申请日:2024-09-06
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services it provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US20240280814A1
公开(公告)日:2024-08-22
申请号:US18643790
申请日:2024-04-23
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Tiago Miguel Pereira Torres , Weston Welge , Ramzi Zahreddine
CPC classification number: G02B27/017 , G02B27/0093 , G06T19/006 , G02B2027/0178
Abstract: A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.
-
公开(公告)号:US12014523B2
公开(公告)日:2024-06-18
申请号:US18198414
申请日:2023-05-17
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Kai Zhou
CPC classification number: G06T7/80 , G06V10/443 , H04N17/002 , H04N23/61 , H04N23/651 , H04N23/6812
Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.
-
公开(公告)号:US20240176428A1
公开(公告)日:2024-05-30
申请号:US18435540
申请日:2024-02-07
Applicant: Snap Inc.
Inventor: Jeroen Diederik Hol , Matthias Kalkgruber
IPC: G06F3/0346 , G06F3/038
CPC classification number: G06F3/0346 , G06F3/038
Abstract: A method for dynamically initializing a 3 degrees of freedom (3DOF) tracking device is described. In one aspect, the method includes accessing a gyroscope signal from a gyroscope of the 3DOF tracking device, accessing an accelerometer signal from an accelerometer of the 3DOF tracking device, determining an initial state includes a combination of an initial orientation, an initial position, and an initial velocity of the 3DOF tracking device, the initial state indicating a starting condition of the 3DOF tracking device, integrating the gyroscope signal and the accelerometer signal to obtain orientation and position signals using the initial state, and refining an inclination signal of the orientation signal using the position signal.
-
公开(公告)号:US20240111156A1
公开(公告)日:2024-04-04
申请号:US17937950
申请日:2022-10-04
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Tiago Miguel Pereira Torres , Weston Welge , Ramzi Zahreddine
CPC classification number: G02B27/017 , G02B27/0093 , G06T19/006 , G02B2027/0178
Abstract: A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.
-
公开(公告)号:US20230350206A1
公开(公告)日:2023-11-02
申请号:US18218905
申请日:2023-07-06
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
CPC classification number: G02B27/0172 , G01K7/00 , G06F1/26 , G06F3/011 , G06T19/006 , G01K2215/00 , G02B27/0093
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services it provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US20230300464A1
公开(公告)日:2023-09-21
申请号:US18321565
申请日:2023-05-22
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Daniel Wolf
CPC classification number: H04N23/6811 , G06T5/002 , G06T7/20 , G06T3/40 , G06V10/443 , H04N23/6812
Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.
-
公开(公告)号:US11683585B2
公开(公告)日:2023-06-20
申请号:US17521109
申请日:2021-11-08
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Daniel Wolf
CPC classification number: H04N23/6811 , G06T3/40 , G06T5/002 , G06T7/20 , G06V10/443 , H04N23/6812
Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.
-
公开(公告)号:US20220366600A1
公开(公告)日:2022-11-17
申请号:US17480405
申请日:2021-09-21
Applicant: Snap Inc.
Inventor: Sagi Katz , Matthias Kalkgruber
Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.
-
公开(公告)号:US20220365592A1
公开(公告)日:2022-11-17
申请号:US17743194
申请日:2022-05-12
Applicant: Snap Inc.
Inventor: Jeroen Diederik Hol , Matthias Kalkgruber , Erick Mendez Mendez , Niall Murphy , Gerald Nilles , Mathieu Emmanuel Vignau
Abstract: A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data.
-
-
-
-
-
-
-
-
-