VARIED DEPTH DETERMINATION USING STEREO VISION AND PHASE DETECTION AUTO FOCUS (PDAF)

    公开(公告)号:WO2022245855A1

    公开(公告)日:2022-11-24

    申请号:PCT/US2022/029673

    申请日:2022-05-17

    Applicant: SNAP INC.

    Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vison, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.

    DIGITAL LIGHT PROJECTORS FOR AUGMENTED REALITY

    公开(公告)号:WO2022146781A1

    公开(公告)日:2022-07-07

    申请号:PCT/US2021/064593

    申请日:2021-12-21

    Applicant: SNAP INC.

    Abstract: A method for configuring a digital light projector (DLP) of an augmented reality (AR) display device is described. A light source component of the DLP projector is configured to generate a single red-green-blue color sequence repetition per image frame. The AR display device identifies a color sequence of the light source component of the DLP projector and tracks a motion of the AR display device. The AR display device adjusts an operation of the DLP projector based on the single red-green-blue color sequence repetition, the color sequence of the light source component of the DLP projector, and the motion of the AR display device.

    VISUAL-INERTIAL TRACKING USING ROLLING SHUTTER CAMERAS

    公开(公告)号:WO2022005698A1

    公开(公告)日:2022-01-06

    申请号:PCT/US2021/036096

    申请日:2021-06-07

    Applicant: SNAP INC.

    Abstract: Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The eyewear device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the eyewear device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.

    LATE WARPING TO MINIMIZE LATENCY OF MOVING OBJECTS

    公开(公告)号:WO2022246384A1

    公开(公告)日:2022-11-24

    申请号:PCT/US2022/072341

    申请日:2022-05-16

    Applicant: SNAP INC.

    Abstract: A method for minimizing latency of moving objects in an augmented reality (AR) display device is described. In one aspect, the method includes determining an initial pose of a visual tracking device, identifying an initial location of an object in an image that is generated by an optical sensor of the visual tracking device, the image corresponding to the initial pose of the visual tracking device, rendering virtual content based on the initial pose and the initial location of the object, retrieving an updated pose of the visual tracking device, tracking an updated location of the object in an updated image that corresponds to the updated pose, and applying a time warp transformation to the rendered virtual content based on the updated pose and the updated location of the object to generate transformed virtual content.

    DUAL SYSTEM ON A CHIP EYEWEAR
    6.
    发明申请

    公开(公告)号:WO2023064125A1

    公开(公告)日:2023-04-20

    申请号:PCT/US2022/045395

    申请日:2022-09-30

    Applicant: SNAP INC.

    Abstract: Eyewear devices that include two SoCs (602A, 602B) that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC (602A) to operate a first color camera, a second color camera, a first display, and a second display. The first SoC (602A) and a second SoC (602B) are configured to selectively operate a first and second computer vision (CV) camera algorithms. The first SoC (602A) is configured to perform visual odometry (VIO), track hand gestures of the user, and provide depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

Patent Agency Ranking