-
公开(公告)号:US20240069688A1
公开(公告)日:2024-02-29
申请号:US18451787
申请日:2023-08-17
Applicant: Apple Inc.
Inventor: Daniel M Golden , John M Nefulda , Joaquim Goncalo Lobo Ferreira da Silva , Anuj Bhatnagar , Mark A Ebbole , Andrew A Haas , Seyedkoosha Mirhosseini , Colin D Munro
IPC: G06F3/04815 , G06F3/01 , G06T19/00 , G06T19/20
CPC classification number: G06F3/04815 , G06F3/012 , G06T19/006 , G06T19/20 , G06F2203/04805 , G06F2203/04806 , G06T2200/24 , G06T2219/2016
Abstract: A head-mounted device is provided that includes displays configured to display an image and to simultaneously display a magnifying window that presents a magnified portion of the image. The magnifying window lies in a magnification plane that is fixed relative to a user's head. One or more processors in the head-mounted device can be used to perform a first ray cast operation to identify an input point where a detected user input intersects the magnifying window, to obtain a remapped point from the input point, to compute a directional vector based on the remapped point and a reference point associated with the user's head, to obtain a shifted point by shifting the remapped point from the magnification plane to another plane parallel to the magnification plane, and to perform a second ray cast operation using the shifted point and the directional vector.
-
公开(公告)号:US11734867B2
公开(公告)日:2023-08-22
申请号:US17479489
申请日:2021-09-20
Applicant: Apple Inc.
Inventor: Seyedkoosha Mirhosseini , Avi Bar-Zeev , Duncan A. K. McRoberts
Abstract: Techniques for alerting a user, who is immersed in a virtual reality environment, to physical obstacles in their physical environment are disclosed.
-
公开(公告)号:US20250111589A1
公开(公告)日:2025-04-03
申请号:US18826434
申请日:2024-09-06
Applicant: Apple Inc.
Inventor: Simon Fortin-Deschenes , Luke A Pillans , Anselm Grundhoefer , Christian I Moore , Seyedkoosha Mirhosseini
Abstract: Various implementations provide passthrough video based on adjusting camera parameters based on environment modeling. An environment characteristic may be determined based on modeling the physical environment based on sensor data captured via one or more sensors. For example, this may involve determining environment light source optical characteristics, environment surfaces optical characteristics, a 3D mapping of the environment, user behavior, a prediction of optical characteristics of light coming in the camera, and the like. The method may involve, based on the environment characteristic, determining a camera parameter for an image captured via the image sensor. For example, the method may determine exposure, gain, tone mapping, color balance, noise reduction, sharpness enhancement. The method may determine the camera parameter based on user information, e.g., user preferences, user activity, etc. The method may involve providing passthrough video of the physical environment based on the determined camera parameter.
-
公开(公告)号:US20240404230A1
公开(公告)日:2024-12-05
申请号:US18672992
申请日:2024-05-23
Applicant: Apple Inc.
Inventor: Conner J. Brooks , Seyedkoosha Mirhosseini
Abstract: In one implementation, a method of displaying an image is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, using the image sensor, an image of an object in a physical environment. The method includes obtaining, based on the image, a first predicted object pose of the object in the physical environment at a display time. The method includes rendering virtual content based on the first predicted object pose. The method includes obtaining a second predicted object pose of the object in the physical environment at the display time. The method includes warping the virtual content based on the second predicted object pose. The method includes displaying, on the display at the display time, the warped virtual content.
-
公开(公告)号:US20240404165A1
公开(公告)日:2024-12-05
申请号:US18672922
申请日:2024-05-23
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Jonathan Moorman , Mark L. Ma , Michael E. Buerli , Seyedkoosha Mirhosseini , Sushant Ojal
Abstract: In one implementation, a method of displaying image is performed by a device including one or more processors and non-transitory memory. The method includes obtaining gaze information. The method includes obtaining, based on the gaze information, a first resolution function and a second resolution function different than the first resolution function. The method includes rendering a first layer based on first virtual content and the first resolution function. The method includes rendering a second layer based on second virtual content and the second resolution function. The method includes compositing the first layer and the second layer into an image. The method includes displaying, on the display, the image.
-
公开(公告)号:US20240331661A1
公开(公告)日:2024-10-03
申请号:US18616064
申请日:2024-03-25
Applicant: Apple Inc.
CPC classification number: G09G5/391 , G02B27/0093 , G02B27/0172 , G06F3/012 , G06T9/007 , G06T17/005 , H04N19/625 , H04N19/96 , G06T2207/20052 , G09G2340/0407
Abstract: Prior to rendering a current frame, a device obtains a previously rendered frame. The device determines that a first portion of the previously rendered frame is associated with a particular type of content. The device renders a first portion of the current frame that corresponds to the first portion of the previously rendered frame with a first rendering characteristic while rendering a second portion of the current frame with a second rendering characteristic that is different from the first rendering characteristic.
-
公开(公告)号:US20240267503A1
公开(公告)日:2024-08-08
申请号:US18437143
申请日:2024-02-08
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Seyedkoosha Mirhosseini , Tobias Eble
IPC: H04N13/296 , G06T3/40 , G06T15/00 , H04N13/344
CPC classification number: H04N13/296 , G06T3/40 , G06T15/00 , H04N13/344
Abstract: In one implementation, a method of generating an image is performed by a device including one or more processors and non-transitory memory. The method includes generating a first resolution function based on a formula with a set of variables having a first set of values. The method includes generating a first image based on first content and the first resolution function. The method includes detecting a resolution constraint. The method includes generating a second resolution function based on the formula with the set of variables having a second set of values, wherein the second resolution function has a summation value that satisfies the resolution constraint. The method includes generating a second image based on second content and the second resolution function.
-
公开(公告)号:US12014472B1
公开(公告)日:2024-06-18
申请号:US16983201
申请日:2020-08-03
Applicant: Apple Inc.
Inventor: Seyedkoosha Mirhosseini
CPC classification number: G06T3/18 , G06T19/20 , G06T2219/2021
Abstract: In some implementations, a method includes: obtaining a reference image frame and forward flow information; for a respective pixel within a target image frame, obtaining a plurality of starting points within the reference image frame with different depths; generating a plurality of intermediate warp results based on the plurality of starting points and the forward flow information, wherein each of the plurality of intermediate warp results is associated with a candidate warp position and an associated depth; selecting a warp result for the respective pixel from among the plurality of intermediate warp results, wherein the warp result corresponds to the candidate warp position associated with a closest depth to a viewpoint associated with the reference image frame; and populating pixel information for the respective pixel within the target image frame based on pixel information for a reference pixel within the reference image frame that corresponds to the warp result.
-
-
-
-
-
-
-