-
公开(公告)号:WO2022245855A1
公开(公告)日:2022-11-24
申请号:PCT/US2022/029673
申请日:2022-05-17
Applicant: SNAP INC.
Inventor: KATZ, Sagi , WAGNER, Daniel , WELGE, Weston
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vison, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.
-
公开(公告)号:WO2022146781A1
公开(公告)日:2022-07-07
申请号:PCT/US2021/064593
申请日:2021-12-21
Applicant: SNAP INC.
Inventor: DEWALL, Jeffrey Michael , SCHNITZER, Dominik , SINGH, Amit , WAGNER, Daniel
IPC: H04N9/31
Abstract: A method for configuring a digital light projector (DLP) of an augmented reality (AR) display device is described. A light source component of the DLP projector is configured to generate a single red-green-blue color sequence repetition per image frame. The AR display device identifies a color sequence of the light source component of the DLP projector and tracks a motion of the AR display device. The AR display device adjusts an operation of the DLP projector based on the single red-green-blue color sequence repetition, the color sequence of the light source component of the DLP projector, and the motion of the AR display device.
-
公开(公告)号:WO2022005698A1
公开(公告)日:2022-01-06
申请号:PCT/US2021/036096
申请日:2021-06-07
Applicant: SNAP INC.
Inventor: KALKGRUBER, Matthias , MENDEZ, Erick Mendez , WAGNER, Daniel , WOLF, Daniel , ZHOU, Kai
IPC: G05D1/02 , G01C11/02 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B27/0172 , G05D1/0253 , G06F3/012 , H04N5/2252 , H04N5/3532
Abstract: Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The eyewear device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the eyewear device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.
-
公开(公告)号:WO2023059473A1
公开(公告)日:2023-04-13
申请号:PCT/US2022/044798
申请日:2022-09-27
Applicant: SNAP INC.
Inventor: HEGER, Jason , NILLES, Gerald , RYUMA, Dmitry , SIMONS, Patrick Timothy McSweeney , WAGNER, Daniel
IPC: G06F1/16 , G06F1/20 , G01K13/00 , G02B2027/0138 , G02B2027/0178 , G02B27/0172 , G06F1/163 , G06F1/206 , H04N13/239 , H04N13/344 , H04N23/10 , H04N23/90
Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate the OS, a first color camera, a second color camera, a first display, and a second display. A second SoC is configured to run computer vision (CV) algorithms, visual odometry (VIO), tracking hand gestures of the user, and providing depth from stereo. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.
-
公开(公告)号:WO2022246384A1
公开(公告)日:2022-11-24
申请号:PCT/US2022/072341
申请日:2022-05-16
Applicant: SNAP INC.
Inventor: JUNG, Bernhard , WAGNER, Daniel
Abstract: A method for minimizing latency of moving objects in an augmented reality (AR) display device is described. In one aspect, the method includes determining an initial pose of a visual tracking device, identifying an initial location of an object in an image that is generated by an optical sensor of the visual tracking device, the image corresponding to the initial pose of the visual tracking device, rendering virtual content based on the initial pose and the initial location of the object, retrieving an updated pose of the visual tracking device, tracking an updated location of the object in an updated image that corresponds to the updated pose, and applying a time warp transformation to the rendered virtual content based on the updated pose and the updated location of the object to generate transformed virtual content.
-
公开(公告)号:WO2023064125A1
公开(公告)日:2023-04-20
申请号:PCT/US2022/045395
申请日:2022-09-30
Applicant: SNAP INC.
Inventor: HEGER, Jason , NILLES, Gerald , RYUMA, Dmitry , SIMONS, Patrick Timothy McSweeney , WAGNER, Daniel
Abstract: Eyewear devices that include two SoCs (602A, 602B) that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC (602A) to operate a first color camera, a second color camera, a first display, and a second display. The first SoC (602A) and a second SoC (602B) are configured to selectively operate a first and second computer vision (CV) camera algorithms. The first SoC (602A) is configured to perform visual odometry (VIO), track hand gestures of the user, and provide depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.
-
公开(公告)号:WO2022245961A1
公开(公告)日:2022-11-24
申请号:PCT/US2022/029855
申请日:2022-05-18
Applicant: SNAP INC.
Inventor: BORYS, Olha , CANBERK, Ilteris Kaan , WAGNER, Daniel , ZILLNER, Jakob
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for continuous surface and depth estimation. A continuous surface and depth estimation system determines the depth and surface normal of physical objects by using stereo vision limited within a predetermined window.
-
公开(公告)号:WO2022072262A1
公开(公告)日:2022-04-07
申请号:PCT/US2021/052138
申请日:2021-09-27
Applicant: SNAP INC.
Inventor: BIRKLBAUER, Clemens , HALMETSCHLAGER-FUNEK, Georg , HOL, Jeroen , KALKGRUBER, Matthias , WAGNER, Daniel
IPC: G06F3/01 , G02B27/01 , H04N13/344 , G06T19/00
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
公开(公告)号:EP4416571A1
公开(公告)日:2024-08-21
申请号:EP22809932.1
申请日:2022-09-30
Applicant: Snap Inc.
Inventor: HEGER, Jason , NILLES, Gerald , RYUMA, Dmitry , SIMONS, Patrick Timothy McSweeney , WAGNER, Daniel
CPC classification number: G02B27/0176 , G02B2027/017820130101 , G02B2027/013820130101 , G06F1/163 , G06F1/206 , G06F1/329 , G06F3/011
-
公开(公告)号:EP4341900A1
公开(公告)日:2024-03-27
申请号:EP22729942.7
申请日:2022-05-18
Applicant: Snap Inc.
Inventor: BORYS, Olha , CANBERK, Ilteris Kaan , WAGNER, Daniel , ZILLNER, Jakob
-
-
-
-
-
-
-
-
-