公开(公告)号：US11360558B2

公开(公告)日：2022-06-14

申请号：US16395806

申请日：2019-04-26

Applicant: Apple Inc.

Inventor： Paul X. Wang ,  Nicolai Georg ,  Benjamin R. Blachnitzky ,  Alhad A. Palkar ,  Minhazul Islam ,  Alex J. Lehmann ,  Madeleine S. Cordier ,  Joon-Sup Han ,  Hongcheng Sun ,  Sang E. Lee ,  Kevin Z. Lo ,  Lilli Ing-Marie Jonsson ,  Luis Deliz Centeno ,  Yuhao Pan ,  Stephen E. Dey ,  Paul N. DuMontelle ,  Jonathan C. Atler ,  Tianjia Sun ,  Jian Li ,  Chang Zhang

IPC: G09G5/00 ,  G06F3/01 ,  G06T19/00 ,  G06F3/04883 ,  G06F3/0482 ,  G06F3/044 ,  G06F3/04815 ,  G06F3/038

Abstract: A system may include finger devices. A touch sensor may be mounted in a finger device housing to gather input from an external object as the object moves along an exterior surface of the housing. The touch sensor may include capacitive sensor electrodes. Sensors such as force sensors, ultrasonic sensors, inertial measurement units, optical sensors, and other components may be used in gathering finger input from a user. Finger input from a user may be used to manipulate virtual objects in a mixed reality or virtual reality environment while a haptic output device in a finger device provides associated haptic output. A user may interact with real-world objects while computer-generated content is overlaid over some or all of the objects. Object rotations and other movements may be converted into input for a mixed reality or virtual reality system using force measurements or other sensors measurements made with the finger devices.

公开(公告)号：US12189888B1

公开(公告)日：2025-01-07

申请号：US18482976

申请日：2023-10-09

Applicant: Apple Inc.

Inventor： Lejing Wang ,  Benjamin R. Blachnitzky ,  Lilli I. Jonsson ,  Nicolai Georg

IPC: G06F3/01 ,  G06F3/041 ,  G06F3/0488

Abstract: Detecting a touch includes receiving image data of a touching object of a user selecting selectable objects of a target surface, determining a rate of movement of the touching object, in response to determining that the rate of movement satisfies a predetermined threshold, modifying a touch detection parameter for detecting a touch event between the touching object and the target surface, and detecting one or more additional touch events using the modified touch detection parameter.

公开(公告)号：US12189853B2

公开(公告)日：2025-01-07

申请号：US18601376

申请日：2024-03-11

Applicant: Apple Inc.

Inventor： Adam G Poulos ,  Aaron M. Burns ,  Arun Rakesh Yoganandan ,  Benjamin R. Blachnitzky ,  Nicolai Georg

IPC: G06F3/01

Abstract: A method includes displaying a plurality of computer-generated objects, and obtaining finger manipulation data from a finger-wearable device via a communication interface. In some implementations, the method includes receiving an untethered input vector that includes a plurality of untethered input indicator values. Each of the plurality of untethered input indicator values is associated with one of a plurality of untethered input modalities. In some implementations, the method includes obtaining proxy object manipulation data from a physical proxy object via the communication interface. The proxy object manipulation data corresponds to sensor data associated with one or more sensors integrated in the physical proxy object. The method includes registering an engagement event with respect to a first one of the plurality of computer-generated objects based on a combination of the finger manipulation data, the untethered input vector, and the proxy object manipulation data.

公开(公告)号：US20250004581A1

公开(公告)日：2025-01-02

申请号：US18576654

申请日：2022-07-01

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Anette L. Freiin von Kapri ,  Arun Rakesh Yoganandan ,  Benjamin R. Blachnitzky ,  Christopher L. Nolet ,  David M. Schattel ,  Samantha Koire

IPC: G06F3/038 ,  G06F3/01 ,  G06F3/0346 ,  G06V20/20

Abstract: In one implementation. a method for dynamically selecting an operation modality for a physical object. The method includes: obtaining a user input vector that includes at least one user input indicator value associated with one of a plurality of different input modalities; obtaining tracking data associated with a physical object; generating a first characterization vector for the physical object, including a pose value and a user grip value, based on the user input vector and the tracking data, wherein the pose value characterizes a spatial relationship between the physical object and a user of the computing system and the user grip value characterizes a manner in which the physical object is being held by the user; and selecting, based on the first characterization vector, a first operation modality as a current operation modality for the physical object.

公开(公告)号：US11966510B2

公开(公告)日：2024-04-23

申请号：US18114492

申请日：2023-02-27

Applicant: Apple Inc.

Inventor： Adam G. Poulos ,  Aaron M. Burns ,  Arun Rakesh Yoganandan ,  Benjamin R. Blachnitzky ,  Nicolai Georg

IPC: G06F3/01

CPC classification number: G06F3/014 ,  G06F3/013 ,  G06F3/017

Abstract: A method includes displaying a plurality of computer-generated objects, and obtaining finger manipulation data from a finger-wearable device via a communication interface. In some implementations, the method includes receiving an untethered input vector that includes a plurality of untethered input indicator values. Each of the plurality of untethered input indicator values is associated with one of a plurality of untethered input modalities. In some implementations, the method includes obtaining proxy object manipulation data from a physical proxy object via the communication interface. The proxy object manipulation data corresponds to sensor data associated with one or more sensors integrated in the physical proxy object. The method includes registering an engagement event with respect to a first one of the plurality of computer-generated objects based on a combination of the finger manipulation data, the untethered input vector, and the proxy object manipulation data.

公开(公告)号：US20230333645A1

公开(公告)日：2023-10-19

申请号：US18196882

申请日：2023-05-12

Applicant: Apple Inc.

Inventor： Alexis H. Palangie ,  Aaron M. Burns ,  Arun Rakesh Yoganandan ,  Benjamin R. Blachnitzky

IPC: G06F3/01 ,  G06F3/14 ,  G06F3/0354 ,  G06F3/0488 ,  G06F3/038 ,  G06F3/0481

CPC classification number: G06F3/013 ,  G06F3/1423 ,  G06F3/03547 ,  G06F3/0488 ,  G06F3/038 ,  G06F3/0481 ,  G06F2203/0381

Abstract: In one implementation, a method of processing input for multiple devices is performed by a first electronic device one or more processors and non-transitory memory. The method includes determining a gaze direction. The method includes selecting a target electronic device based on determining that the gaze direction is directed to the target electronic device. The method includes receiving, via an input device, one or more inputs. The method includes processing the one or more inputs based on the target electronic device.

公开(公告)号：US20230325047A1

公开(公告)日：2023-10-12

申请号：US18121673

申请日：2023-03-15

Applicant: Apple Inc.

Inventor： Nicolai Georg ,  Aaron M. Burns ,  Adam G. Poulos ,  Arun Rakesh Yoganandan ,  Benjamin Hylak ,  Benjamin R. Blachnitzky

IPC: G06F3/01 ,  G06F3/04815 ,  G06F3/0486

CPC classification number: G06F3/04815 ,  G06F3/014 ,  G06F3/0486 ,  G06F2203/0331 ,  G06F2203/04802

Abstract: A method includes displaying a plurality of computer-generated objects, including a first computer-generated object at a first position within an environment and a second computer-generated object at a second position within the environment. The first computer-generated object corresponds to a first user interface element that includes a first set of controls for modifying a content item. The method includes, while displaying the plurality of computer-generated objects, obtaining extremity tracking data. The method includes moving the first computer-generated object from the first position to a third position within the environment based on the extremity tracking data. The method includes, in accordance with a determination that the third position satisfies a proximity threshold with respect to the second position, merging the first computer-generated object with the second computer-generated object in order to generate a third computer-generated object for modifying the content item. The method includes displaying the third computer-generated object.

公开(公告)号：US20230315202A1

公开(公告)日：2023-10-05

申请号：US18114492

申请日：2023-02-27

Applicant: Apple Inc.

Inventor： Adam G. Poulos ,  Aaron M. Burns ,  Arun Rakesh Yoganandan ,  Benjamin R. Blachnitzky ,  Nicolai Georg

IPC: G06F3/01

CPC classification number: G06F3/014 ,  G06F3/013 ,  G06F3/017

Abstract: A method includes displaying a plurality of computer-generated objects, and obtaining finger manipulation data from a finger-wearable device via a communication interface. In some implementations, the method includes receiving an untethered input vector that includes a plurality of untethered input indicator values. Each of the plurality of untethered input indicator values is associated with one of a plurality of untethered input modalities. In some implementations, the method includes obtaining proxy object manipulation data from a physical proxy object via the communication interface. The proxy object manipulation data corresponds to sensor data associated with one or more sensors integrated in the physical proxy object. The method includes registering an engagement event with respect to a first one of the plurality of computer-generated objects based on a combination of the finger manipulation data, the untethered input vector, and the proxy object manipulation data.

公开(公告)号：US20230297168A1

公开(公告)日：2023-09-21

申请号：US18121993

申请日：2023-03-15

Applicant: Apple Inc.

Inventor： Nicolai Georg ,  Aaron M. Burns ,  Adam G. Poulos ,  Arun Rakesh Yoganandan ,  Benjamin Hylak ,  Benjamin R. Blachnitzky

IPC: G06F3/01 ,  G06F3/04842 ,  G06F3/04815 ,  G06F3/0346

CPC classification number: G06F3/014 ,  G06F3/017 ,  G06F3/04842 ,  G06F3/04815 ,  G06F3/0346

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, and a communication interface provided to communicate with a finger-wearable device. The method includes, while displaying a plurality of content items on the display, obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes selecting a first one of the plurality of content items based on a first portion of the finger manipulation data in combination with satisfaction of a proximity threshold. The first one of the plurality of content items is associated with a first dimensional representation. The method includes changing the first one of the plurality of content items from the first dimensional representation to a second dimensional representation based on a second portion of the finger manipulation data.

公开(公告)号：US20250165070A1

公开(公告)日：2025-05-22

申请号：US19027964

申请日：2025-01-17

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Adam G. Poulos ,  Arun Rakesh Yoganandan ,  Benjamin Hylak ,  Benjamin R. Blachnitzky ,  Nicolai Georg

IPC: G06F3/01

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, an extremity tracking system, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying a computer-generated object on the display. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining a multi-finger gesture based on extremity tracking data from the extremity tracking system and the finger manipulation data. The method includes registering an engagement event with respect to the computer-generated object according to the multi-finger gesture.