-
公开(公告)号:US20250104368A1
公开(公告)日:2025-03-27
申请号:US18971490
申请日:2024-12-06
Applicant: Apple Inc.
Inventor: Thomas G. Salter , Gregory Patrick Lane Lutter , Rahul Nair , Devin William Chalmers , Ioana Negoita
Abstract: A method is performed at an electronic device with a one or more processors, a non-transitory memory, and a display. The method includes obtaining a first semantic label value associated with a first object. The method includes determining, based on the first semantic label value, a first display priority value associated with the first object. The method includes prioritizing the first object over a second object based on the first display priority value. The method includes, in response to determining that the first object satisfies an offscreen criterion, displaying, on the display, an offscreen indicator that is associated with the first object according to the prioritization.
-
公开(公告)号:US20250005873A1
公开(公告)日:2025-01-02
申请号:US18829450
申请日:2024-09-10
Applicant: Apple Inc.
Inventor: Yutaka Yokokawa , Devin W. Chalmers , Brian W. Temple , Rahul Nair , Thomas G. Salter
Abstract: Various implementations disclosed herein include devices, systems, and methods that present virtual content based on detecting a reflective object and determining a three-dimensional (3D) position of the reflective object in a physical environment. For example, an example process may include obtaining sensor data in a physical environment that includes one or more objects. The method may further include detecting a reflection of a first object of the one or more objects upon a reflective surface of a reflective object based on the sensor data. The method may further include determining a 3D position of the reflective object in the physical environment based on determining a 3D position of the reflection of the first object. The method may further include presenting virtual content in a view of the physical environment. The virtual content may be positioned at a 3D location based on the 3D position of the reflective object.
-
公开(公告)号:US12154329B1
公开(公告)日:2024-11-26
申请号:US17387461
申请日:2021-07-28
Applicant: Apple Inc.
Inventor: Thomas G. Salter , Devin William Chalmers , Gregory Patrick Lane Lutter , Bart Colin Trzynadlowski , Rahul Nair
IPC: G06V20/20 , G06F3/0482 , G06T19/00 , G06V40/20
Abstract: In one implementation, a method of displaying a task list is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes obtaining, using the image sensor, a video stream of a physical environment. The method includes displaying, on the display in association with the physical environment, a task list including a plurality of task elements respectively associated with a plurality of tasks, wherein the plurality of task elements includes a first task element associated with a first task and a second task element associated with a second task. The method includes detecting, in the video stream of the physical environment, completion of the first task. The method includes, in response to detecting completion of the first task, changing display of the first task element.
-
公开(公告)号:US20240370082A1
公开(公告)日:2024-11-07
申请号:US18644218
申请日:2024-04-24
Applicant: Apple Inc.
Inventor: Guilherme Klink , Andrew Muehlhausen , Gregory Lutter , Luis R. Deliz Centeno , Paulo R. Jansen dos Reis , Peter Burgner , Rahul Nair , Yutaka Yokokawa , Anshu K. Chimalamarri , Ashwin K. Vijay , Benjamin S. Phipps , Brandon K. Schmuck
Abstract: A head-mounted device may be used to control one or more external electronic devices. Gaze input and camera images may be used to determine a point of gaze relative to a display for an external electronic device. The external electronic device may receive information regarding the user's gaze input from the head-mounted device and may highlight one out of multiple user interface elements that is targeted by the gaze input. The head-mounted device may receive input such as keystroke information from an accessory device and relay the input to an external electronic device that is being viewed. The head-mounted device may receive a display configuration request, determine layout information for displays in the physical environment of the head-mounted device, and transmit the layout information to an external device associated with the displays.
-
公开(公告)号:US20240005612A1
公开(公告)日:2024-01-04
申请号:US18214575
申请日:2023-06-27
Applicant: Apple Inc.
Inventor: Yutaka Yokokawa , Devin W. Chalmers , Brian W. Temple , Rahul Nair , Thomas G. Salter
CPC classification number: G06T19/006 , G06T7/73 , G06F3/012 , G06T7/246 , G06V20/50 , H04S7/303 , G06T2207/30201 , G06T2207/10028 , H04S2400/11
Abstract: Various implementations disclosed herein include devices, systems, and methods that present virtual content based on detecting a reflective object and determining a three-dimensional (3D) position of the reflective object in a physical environment. For example, an example process may include obtaining sensor data (e.g., image, sound, motion, etc.) from a sensor of an electronic device in a physical environment that includes one or more objects. The method may further include detecting a reflective object amongst the one or more objects based on the sensor data. The method may further include determining a 3D position of the reflective object in the physical environment (e.g., where the plane of the mirror is located). The method may further include presenting virtual content in a view of the physical environment. The virtual content may be positioned at a 3D location based on the 3D position of the reflective object.
-
公开(公告)号:US11609739B2
公开(公告)日:2023-03-21
申请号:US17056126
申请日:2019-04-24
Applicant: Apple Inc.
Inventor: Rahul Nair , Golnaz Abdollahian , Avi Bar-Zeev , Niranjan Manjunath
Abstract: In an exemplary technique for providing audio information, an input is received, and audio information responsive to the received input is provided using a speaker. While providing the audio information, an external sound is detected. If it is determined that the external sound is a communication of a first type, then the provision of the audio information is stopped. If it is determined that the external sound is a communication of a second type, then the provision of the audio information continues.
-
公开(公告)号:US20210397407A1
公开(公告)日:2021-12-23
申请号:US17322691
申请日:2021-05-17
Applicant: Apple Inc.
Inventor: Christopher T. Eubank , Devin W. Chalmers , Kirill Kalinichev , Rahul Nair , Thomas G. Salter
IPC: G06F3/16 , H04R1/10 , G10L25/78 , H04R1/08 , H04R1/40 , H04R3/00 , G06F3/01 , G06K9/00 , G10K11/178 , G10L25/51 , G10K11/175
Abstract: A method performed by an audio system comprising a headset. The method sends a playback signal containing user-desired audio content to drive a speaker of the headset that is being worn by a user, receives a microphone signal from a microphone that is arranged to capture sounds within an ambient environment in which the user is located, performs a speech detection algorithm upon the microphone signal to detect speech contained therein, in response to a detection of speech, determines that the user intends to engage in a conversation with a person who is located within the ambient environment, and, in response to determining that the user intends to engage in the conversation, adjusts the playback signal based on the user-desired audio content.
-
公开(公告)号:US11132162B2
公开(公告)日:2021-09-28
申请号:US16828852
申请日:2020-03-24
Applicant: Apple Inc.
Inventor: Avi Bar-Zeev , Ryan S. Burgoyne , Devin W. Chalmers , Luis R. Deliz Centeno , Rahul Nair , Timothy R. Oriol , Alexis H. Palangie
IPC: G06F3/048 , G06F3/14 , G06K9/00 , G06T19/00 , H04B5/00 , G06T7/73 , G06F3/01 , G06F3/0346 , G02B27/00 , G02B27/01 , G06F3/0481 , G06F3/0484
Abstract: In an exemplary process for interacting with user interface objects using an eye gaze, an affordance associated with a first object is displayed. A gaze direction or a gaze depth is determined. While the gaze direction or the gaze depth is determined to correspond to a gaze at the affordance, a first input representing user instruction to take action on the affordance is received, and the affordance is selected responsive to receiving the first input.
-
公开(公告)号:US20200264006A1
公开(公告)日:2020-08-20
申请号:US16651990
申请日:2018-09-25
Applicant: Apple Inc.
Inventor: Bruno M. Sommer , Avi Bar-Zeev , Frank Angermann , Stephen E. Pinto , Lilli Ing-Marie Jonsson , Rahul Nair
Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.
-
公开(公告)号:US20250085132A1
公开(公告)日:2025-03-13
申请号:US18957331
申请日:2024-11-22
Applicant: Apple Inc.
Inventor: Bruno M. Sommer , Avi Bar-Zeev , Frank Angermann , Stephen E. Pinto , Lilli Ing-Marie Jonsson , Rahul Nair
Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.
-
-
-
-
-
-
-
-
-