-
公开(公告)号:US20220295084A1
公开(公告)日:2022-09-15
申请号:US17825167
申请日:2022-05-26
Applicant: Apple Inc.
Inventor: Maneli Noorkami , Ranjit Desai
Abstract: Systems and methods for gaze-driven recording of video are described. Some implementations may include accessing gaze data captured using one or more gaze-tracking sensors; applying a temporal filter to the gaze data to obtain a smoothed gaze estimate; determining a region of interest based on the smoothed gaze estimate, wherein the region of interest identifies a subset of a field of view; accessing a frame of video; recording a portion of the frame associated with the region of interest as an enhanced frame of video, wherein the portion of the frame corresponds to a smaller field of view than the frame; and storing, transmitting, or displaying the enhanced frame of video.
-
公开(公告)号:US20220095123A1
公开(公告)日:2022-03-24
申请号:US17320178
申请日:2021-05-13
Applicant: Apple Inc.
Inventor: Ranjit Desai , Joel N. Kerr , Borna Ghavam
Abstract: Techniques are disclosed relating to identifying connection quality for locations within an environment. A first computing device may collect environment information pertaining to a layout of an environment in which the first computing device and a second computing device are located. The first computing device may be in wireless communication with the second computing device. The first computing device may determine, based on the environment information, a location within the environment to locate the first computing device to improve the wireless communication. The first computing device may provide an indication of the location to a user of the first computing device.
-
公开(公告)号:US20200082576A1
公开(公告)日:2020-03-12
申请号:US16566742
申请日:2019-09-10
Applicant: Apple Inc.
Inventor: Alvin Li Lai , Perry A. Caro , Michael J. Rockwell , Venu Madhav Duggineni , Ranjit Desai
Abstract: An electronic device: obtains pass-through image data characterizing a field of view captured by an image sensor; determines whether a recognized subject in the pass-through image data satisfies a confidence score threshold associated with a user-specific recommendation profile; generates one or more computer-generated reality (CGR) content items associated with the recognized subject in response to determining that the recognized subject in the pass-through image data satisfies the confidence score threshold; and composites the pass-through image data with the one or more CGR content items, where the one or more CGR content items are proximate to the recognized subject in the field of view.
-
公开(公告)号:US12301825B2
公开(公告)日:2025-05-13
申请号:US18097165
申请日:2023-01-13
Applicant: Apple Inc.
Inventor: Maneli Noorkami , Afshin Taghavi Nasrabadi , Ranjit Desai
IPC: H04N19/136 , H04N19/107 , H04N19/119 , H04N19/159 , H04N19/172 , H04N19/176 , H04N19/30 , H04N19/50
Abstract: Aspects of the subject technology relate to encoding of video frames having content with a variable resolution that varies within the video frame. Aspects of the subject technology can provide an efficient encoding by using smaller macroblocks for lower resolution content within the video frame, and larger macroblocks for higher resolution content within the video frame. An encoder may be provided with resolution information for the content of the video frame, which can be used by the encoder to determine macroblock sizes, macroblock divisions, and/or prediction modes for the encoding of the video frame.
-
公开(公告)号:US11804019B2
公开(公告)日:2023-10-31
申请号:US17693881
申请日:2022-03-14
Applicant: Apple Inc.
Inventor: Ranjit Desai , Venu M. Duggineni , Perry A. Caro , Alexsandr M. Movshovich , Gurjeet S. Saund
CPC classification number: G06T19/006 , G06F3/011 , G06T3/00 , G06T9/00 , G10L25/51 , H04L65/61 , H04L65/70
Abstract: One implementation forms a composited stream of computer-generated reality (CGR) content using multiple data streams related to a CGR experience to facilitate recording or streaming. A media compositor obtains a first data stream of rendered frames and a second data stream of additional data. The rendered frame content (e.g., 3D models) represents real and virtual content rendered during a CGR experience at a plurality of instants in time. The additional data of the second data stream relates to the CGR experience, for example, relating to audio, audio sources, metadata identifying detected attributes of the CGR experience, image data, data from other devices involved in the CGR experience, etc. The media compositor forms a composited stream that aligns the rendered frame content with the additional data for the plurality of instants in time, for example, by forming time-stamped, n-dimensional datasets (e.g., images) corresponding to individual instants in time.
-
公开(公告)号:US11790653B2
公开(公告)日:2023-10-17
申请号:US17016127
申请日:2020-09-09
Applicant: Apple Inc.
Inventor: Ranjit Desai , Maneli Noorkami
CPC classification number: G06V20/42 , G06T17/20 , G06T19/006 , H04N9/8715 , G06V20/44
Abstract: Implementations of the subject technology provides analyzing a recording of content. The subject technology generates metadata information based at least in part on the analyzing. The subject technology identifies, based at least in part on at least one of a user preference or a detected event, a region of interest or an object of interest in the recording of content. Based at least in part on the identified region of interest or object of interest, the subject technology generates a modified version of the recording of content. Further, the subject technology stores the modified version of the recording of content for subsequent playback on an electronic device.
-
公开(公告)号:US11308696B2
公开(公告)日:2022-04-19
申请号:US16533053
申请日:2019-08-06
Applicant: Apple Inc.
Inventor: Ranjit Desai , Venu M. Duggineni , Perry A. Caro , Aleksandr M. Movshovich , Gurjeet S. Saund
Abstract: One implementation forms a composited stream of computer-generated reality (CGR) content using multiple data streams related to a CGR experience to facilitate recording or streaming. A media compositor obtains a first data stream of rendered frames and a second data stream of additional data. The rendered frame content (e.g., 3D models) represents real and virtual content rendered during a CGR experience at a plurality of instants in time. The additional data of the second data stream relates to the CGR experience, for example, relating to audio, audio sources, metadata identifying detected attributes of the CGR experience, image data, data from other devices involved in the CGR experience, etc. The media compositor forms a composited stream that aligns the rendered frame content with the additional data for the plurality of instants in time, for example, by forming time-stamped, n-dimensional datasets (e.g., images) corresponding to individual instants in time.
-
公开(公告)号:US11204783B2
公开(公告)日:2021-12-21
申请号:US16548065
申请日:2019-08-22
Applicant: Apple Inc.
Inventor: Ranjit Desai , Michael J. Rockwell , Venu Madhav Duggineni , Robert Seon Wai Lee
Abstract: In one implementation, a method of accessing shared data among processes is performed by a device including processor(s), non-transitory memory, and an image acquisition interface. The method includes obtaining image data acquired by the image acquisition interface. The method further includes determining pose data based at least in part on inertial measurement unit (IMU) information measured by the image acquisition interface. The method also includes determining a gaze estimation based at least in part on eye tracking information obtained through the image acquisition interface. Based at least in part on characteristics of processes, the method includes determining an arrangement for the image data, the pose data, and the gaze estimation. The method additionally includes determining an access schedule for the processes based at least in part on at least one of: the arrangement, the characteristics of the processes, and hardware timing parameters associated with the device.
-
公开(公告)号:US10951904B2
公开(公告)日:2021-03-16
申请号:US16713778
申请日:2019-12-13
Applicant: Apple Inc.
Inventor: Maneli Noorkami , Ranjit Desai
Abstract: Systems and methods for gaze-driven recording of video are described. Some implementations may include accessing gaze data captured using one or more gaze-tracking sensors; applying a temporal filter to the gaze data to obtain a smoothed gaze estimate; determining a region of interest based on the smoothed gaze estimate, wherein the region of interest identifies a subset of a field of view; accessing a frame of video; recording a portion of the frame associated with the region of interest as an enhanced frame of video, wherein the portion of the frame corresponds to a smaller field of view than the frame; and storing, transmitting, or displaying the enhanced frame of video.
-
公开(公告)号:US20200312005A1
公开(公告)日:2020-10-01
申请号:US16835891
申请日:2020-03-31
Applicant: Apple Inc.
Inventor: Ranjit Desai , Michael J. Rockwell
Abstract: Techniques are disclosed relating to display devices. In some embodiments, a display device includes a display system configured to display three-dimensional content to a user. The display device is configured to discover, via a network interface, one or more compute nodes operable to facilitate rendering the three-dimensional content and receive information identifying abilities of the one or more compute nodes to facilitate the rendering. Based on the received information, the display device evaluates a set of tasks to identify one or more of the tasks to offload to the one or more compute nodes for facilitating the rendering and distributes, via the network interface, the identified one or more tasks to the one or more compute nodes for processing by the one or more compute nodes.
-
-
-
-
-
-
-
-
-