-
11.
公开(公告)号:US20210064910A1
公开(公告)日:2021-03-04
申请号:US17001788
申请日:2020-08-25
Applicant: Apple Inc.
Inventor: Peter Meier , Daniel Kurz , Brian Chris Clark , Mohamed Selim Ben Himane
Abstract: Various implementations disclosed herein include devices, systems, and methods that detect surfaces and reflections in such surfaces. Some implementations involve providing a CGR environment that includes virtual content that replaces the appearance of a user or the user's device in a mirror or other surface providing a reflection. For example, a CGR environment may be modified to include a reflection of the user that does not include the device that the user is holding or wearing. In another example, the CGR environment is modified so that virtual content, such as a newer version of the electronic device or a virtual wand, replaces the electronic device in the reflection. In another example, the CGR environment is modified so that virtual content, such as a user avatar, replaces the user in the reflection.
-
12.
公开(公告)号:US10819962B2
公开(公告)日:2020-10-27
申请号:US14758121
申请日:2012-12-28
Applicant: Apple Inc.
Inventor: Peter Meier , Mohamed Selim Ben Himane , Daniel Kurz
IPC: H04N9/31 , H04N5/225 , H04N5/33 , H04N13/128 , H04N13/15 , H04N13/257 , G01B11/24 , G01B11/25 , H04N13/00
Abstract: A method of projecting digital information on a real object in a real environment includes the steps of projecting digital information on a real object or part of a real object with a visible light projector, capturing at least one image of the real object with the projected digital information using a camera, providing a depth sensor registered with the camera, the depth sensor capturing depth data of the real object or part of the real object, and calculating a spatial transformation between the visible light projector and the real object based on the at least one image and the depth data. The invention is also concerned with a corresponding system.
-
公开(公告)号:US20200089313A1
公开(公告)日:2020-03-19
申请号:US16567970
申请日:2019-09-11
Applicant: APPLE INC.
Inventor: Mohamed Selim Ben Himane
IPC: G06F3/01 , G06T7/70 , G06F3/0346
Abstract: Some implementations provide improved user interfaces for interacting with a virtual environment. The virtual environment is presented by a display of a first device having an image sensor. The first device uses the image sensor to determine a relative position and orientation of a second device based on a marker displayed on a display of the second device. The first device uses the determined relative position of the second device to display a representation of the second device including virtual content in place of the marker.
-
公开(公告)号:US10192145B2
公开(公告)日:2019-01-29
申请号:US15444404
申请日:2017-02-28
Applicant: Apple Inc.
Inventor: Mohamed Selim Ben Himane , Daniel Kurz , Thomas Olszamowski
Abstract: A method of providing a set of feature descriptors configured to be used in matching an object in an image of a camera is provided. The method includes: a) providing at least two images of a first object; b) extracting in at least two of the images at least one feature from the respective image, c) providing at least one descriptor for an extracted feature, and storing the descriptors; d) matching descriptors in the first set of descriptors; e) computing a score parameter based on the result of the matching process; f) selecting at least one descriptor based on its score parameter; g) adding the selected descriptor(s) to a second set of descriptors; and h) updating the score parameter of descriptors in the first set based on a selection process and to the result of the matching process.
-
公开(公告)号:US20240403590A1
公开(公告)日:2024-12-05
申请号:US18802129
申请日:2024-08-13
Applicant: APPLE INC.
Inventor: Arun Srivatsan Rangaprasad , Anselm Grundhoefer , Mohamed Selim Ben Himane , Dhruv A. Govil , Joseph M. Luxton , Jean-Charles Bernard Marcel Bazin , Shubham Agrawal
IPC: G06K19/06
Abstract: Various implementations disclosed herein include devices, systems, and methods that provide a visual marker including a plurality of markings arranged in a corresponding plurality of shapes. In some implementations, each marking is formed of a set of sub-markings separated by gaps and arranged according to a respective shape, and the gaps of the plurality of markings are configured to encode data and indicate orientation of the visual marker. In some implementations, the plurality of markings are arranged in a plurality of concentric rings of increasing size. In some implementations, the orientation is encoded in a first set of gaps and data in a second set of gaps of the gaps in the plurality of markings.
-
公开(公告)号:US20240281055A1
公开(公告)日:2024-08-22
申请号:US18654595
申请日:2024-05-03
Applicant: APPLE INC.
Inventor: Mohamed Selim Ben Himane
IPC: G06F3/01 , G06F3/0346 , G06T7/70
CPC classification number: G06F3/011 , G06F3/0346 , G06T7/70 , G06T2200/24 , G06T2207/30204
Abstract: Some implementations provide improved user interfaces for interacting with a virtual environment. The virtual environment is presented by a display of a first device having an image sensor. The first device uses the image sensor to determine a relative position and orientation of a second device based on a marker displayed on a display of the second device. The first device uses the determined relative position of the second device to display a representation of the second device including virtual content in place of the marker.
-
公开(公告)号:US20240098232A1
公开(公告)日:2024-03-21
申请号:US18369621
申请日:2023-09-18
Applicant: Apple Inc.
Inventor: Emmanuel Piuze-Phaneuf , Hermannus J. Damveld , Jean-Nicola F. Blanchet , Mohamed Selim Ben Himane , Vincent Chapdelaine-Couture , Xiaojin Shi
IPC: H04N13/117 , H04N13/383
CPC classification number: H04N13/117 , H04N13/383
Abstract: In one implementation, a method of performing perspective correction is performed by a device having a three-dimensional device coordinate system and including a first image sensor, a first display, one or more processors, and non-transitory memory. The method includes capturing, using the first image sensor, a first image of a physical environment. The method includes transforming the first image from a first perspective of the first image sensor to a second perspective based on a difference between the first perspective and the second perspective, wherein the second perspective is a first distance away from a location corresponding to a first eye of a user less than a second distance between the first perspective and the location corresponding to the first eye of the user. The method includes displaying, on the first display, the transformed first image of the physical environment.
-
公开(公告)号:US11682138B2
公开(公告)日:2023-06-20
申请号:US17524298
申请日:2021-11-11
Applicant: Apple Inc.
Inventor: Mohamed Selim Ben Himane
CPC classification number: G06T7/75 , G06T7/251 , G06T19/006
Abstract: The present disclosure relates generally to localization and mapping. In some examples, an electronic device obtains first image data and motion data using a motion sensor. The electronic device receives information corresponding to a second electronic device. The electronic device generates a representation of a first pose of the first electronic device using the first image data, the motion data, and the information corresponding to the second electronic device. The electronic device displays, on the display, a virtual object, wherein the displaying of the virtual object is based on the representation of the first pose of the first electronic device.
-
公开(公告)号:US11237671B1
公开(公告)日:2022-02-01
申请号:US16903564
申请日:2020-06-17
Applicant: Apple Inc.
Inventor: Lejing Wang , Mohamed Selim Ben Himane
Abstract: Detecting a touch includes determining, from first raw touch data, an estimated touch type for a first plurality of frames, obtaining second raw touch data comprising a probability that a touch has occurred for each of a second plurality of frames, applying the selected filter to the additional raw data to obtain processed data, and detecting whether a touch has occurred for a particular frame based on the processed data.
-
公开(公告)号:US20210279898A1
公开(公告)日:2021-09-09
申请号:US17326559
申请日:2021-05-21
Applicant: Apple, Inc.
Inventor: Vincent Chapdelaine-Couture , Mohamed Selim Ben Himane
Abstract: One exemplary implementation facilitates object detection using multiple scans of an object in different lighting conditions. For example, a first scan of the object can be created by capturing images of the object by moving an image sensor on a first path in a first lighting condition, e.g., bright lighting. A second scan of the object can then be created by capturing additional images of the object by moving the image sensor on a second path in a second lighting condition, e.g., dim lighting. Implementations determine a transform that associates the scan data from these multiple scans to one another and use the transforms to generate a 3D model of the object in a single coordinate system. Augmented content can be positioned relative to that object in the single coordinate system and thus will be displayed in the appropriate location regardless of the lighting condition in which the physical object is later detected.
-
-
-
-
-
-
-
-
-