-
公开(公告)号:US12096112B2
公开(公告)日:2024-09-17
申请号:US17831305
申请日:2022-06-02
Applicant: Meta Platforms Technologies, LLC
Inventor: Sapna Shroff , Sebastian Sztuk , Johana Gabriela Coyoc Escudero , Jun Hu
IPC: G06V20/00 , G02B27/01 , G02C7/10 , G02C7/16 , G06F3/01 , G06F3/044 , G06F3/16 , G06F40/205 , G06V10/25 , G06V10/75 , G06V20/50 , G10L17/06 , G10L17/22 , H04N23/56 , H04N23/60 , H04N23/62 , H04N23/63 , H04N23/66 , H04N23/695 , H04N23/90
CPC classification number: H04N23/64 , G02B27/0172 , G02C7/101 , G02C7/16 , G06F3/013 , G06F3/016 , G06F3/017 , G06F3/044 , G06F3/167 , G06F40/205 , G06V10/25 , G06V10/759 , G06V20/50 , G10L17/06 , G10L17/22 , H04N23/56 , H04N23/62 , H04N23/63 , H04N23/66 , H04N23/695 , H04N23/90 , G02B2027/0138 , G02B2027/0141 , G02B2027/0178
Abstract: A wearable device for use in immersive reality applications is provided. The wearable device has a frame including an eyepiece to provide a forward-image to a user, a first forward-looking camera mounted on the frame, the first forward-looking camera having a field of view within the forward-image, a sensor configured to receive a command from the user, the command indicative of a region of interest within the field of view, and an interface device to indicate to the user that a field of view of the first forward-looking camera is aligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.
-
公开(公告)号:US20230156314A1
公开(公告)日:2023-05-18
申请号:US18053280
申请日:2022-11-07
Applicant: Meta Platforms Technologies, LLC
Inventor: Sebastian Sztuk , Salvael Ortega Estrada , Sapna Shroff , Jun Hu , Yilei Li
CPC classification number: H04N5/23219 , G02B27/017 , G02B27/0093 , G02B27/0101 , G06F3/013 , H04N5/23296 , H04N5/232127 , G02B2027/014 , G02B2027/0138
Abstract: A method for capturing a scene in a virtual environment for an immersive reality application running in a headset is provided. The method includes determining initiation of an auto-capture session in a headset by a user, the headset running an immersive reality application hosted by a remote server, executing a gaze model based on the initiation, detecting through the gaze model a gaze of the user, tracking the gaze of the user, capturing a scene in a virtual environment based on the gaze of the user, and storing the scene as a media file in storage. A headset and a memory storing instructions to cause the headset and a remote server to perform the above method are also provided.
-
公开(公告)号:US12101549B2
公开(公告)日:2024-09-24
申请号:US17856760
申请日:2022-07-01
Applicant: Meta Platforms Technologies, LLC
Inventor: Sapna Shroff , Linsen Bie , Jun Hu , David Tao , Demetrios Basil Karanikos , Sebastian Sztuk , Zhaonian Zhang , Jiangtao Kuang , Danni Luo , Yilei Li
CPC classification number: H04N23/62 , G02B27/017 , G02B27/0179 , G06F3/012 , G06F3/013 , G06F3/017 , H04N23/64 , H04N23/667 , H04N23/90 , G02B2027/0138 , G02B2027/014 , G06F3/167
Abstract: A method for using cameras in an augmented reality headset is provided. The method includes receiving a signal from a sensor mounted on a headset worn by a user, the signal being indicative of a user intention for capturing an image. The method also includes identifying the user intention for capturing the image, based on a model to classify the signal from the sensor according to the user intention, selecting a first image capturing device in the headset based on a specification of the first image capturing device and the user intention for capturing the image, and capturing the image with the first image capturing device. An augmented reality headset, a memory storing instructions, and a processor to execute the instructions to cause the augmented reality headset as above are also provided.
-
公开(公告)号:US20230012426A1
公开(公告)日:2023-01-12
申请号:US17856760
申请日:2022-07-01
Applicant: Meta Platforms Technologies, LLC
Inventor: Sapna Shroff , Linsen Bie , Jun Hu , David Tao , Demetrios Basil Karanikos , Sebastian Sztuk , Zhaonian Zhang , Jiangtao Kuang , Danni Luo , Yilei Li
Abstract: A method for using cameras in an augmented reality headset is provided. The method includes receiving a signal from a sensor mounted on a headset worn by a user, the signal being indicative of a user intention for capturing an image. The method also includes identifying the user intention for capturing the image, based on a model to classify the signal from the sensor according to the user intention, selecting a first image capturing device in the headset based on a specification of the first image capturing device and the user intention for capturing the image, and capturing the image with the first image capturing device. An augmented reality headset, a memory storing instructions, and a processor to execute the instructions to cause the augmented reality headset as above are also provided.
-
5.
公开(公告)号:US11494960B2
公开(公告)日:2022-11-08
申请号:US17348458
申请日:2021-06-15
Applicant: Meta Platforms Technologies, LLC
Inventor: Jiangtao Kuang , Edward Buckley , Honghong Peng , Sapna Shroff , Romain Bachy
Abstract: A display assembly generates environmentally matched virtual content for an electronic display. The display assembly includes a display controller and a display. The display controller is configured to estimate environmental matching information for a target area within a local area based in part on light information received from a light sensor. The target area is a region for placement of a virtual object. The light information describes light values. The display controller generates display instructions for the target area based in part on a human vision model, the estimated environmental matching information, and rendering information associated with the virtual object. The display is configured to present the virtual object as part of artificial reality content in accordance with the display instructions. The color and brightness of the virtual object is environmentally matched to the portion of the local area surrounding the target area.
-
公开(公告)号:US12132983B2
公开(公告)日:2024-10-29
申请号:US17859808
申请日:2022-07-07
Applicant: Meta Platforms Technologies, LLC
Inventor: Sapna Shroff , Sebastian Sztuk , Jun Hu , Johana Gabriela Coyoc Escudero
IPC: H04N23/60 , G02B27/01 , G02C7/10 , G02C7/16 , G06F3/01 , G06F3/044 , G06F3/16 , G06F40/205 , G06V10/25 , G06V10/75 , G06V20/50 , G10L17/06 , G10L17/22 , H04N23/56 , H04N23/62 , H04N23/63 , H04N23/66 , H04N23/695 , H04N23/90
CPC classification number: H04N23/64 , G02B27/0172 , G02C7/101 , G02C7/16 , G06F3/013 , G06F3/016 , G06F3/017 , G06F3/044 , G06F3/167 , G06F40/205 , G06V10/25 , G06V10/759 , G06V20/50 , G10L17/06 , G10L17/22 , H04N23/56 , H04N23/62 , H04N23/63 , H04N23/66 , H04N23/695 , H04N23/90 , G02B2027/0138 , G02B2027/0141 , G02B2027/0178
Abstract: A wearable device for use in immersive reality applications is provided. The wearable device includes eyepieces to provide a forward-image to a user, a first forward-looking camera mounted on the frame and having a field of view, a processor configured to identify a region of interest within the forward-image, and an interface device to indicate to the user that a field of view of the first forward-looking camera is misaligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.
-
公开(公告)号:US20230032467A1
公开(公告)日:2023-02-02
申请号:US17859808
申请日:2022-07-07
Applicant: Meta Platforms Technologies, LLC
Inventor: Sapna Shroff , Sebastian Sztuk , Jun Hu , Johana Gabriela Coyoc Escudero
IPC: H04N5/232 , G06V10/25 , G06V10/75 , H04N5/225 , G06F3/01 , G06F3/16 , G02C7/16 , G02C7/10 , G02B27/01
Abstract: A wearable device for use in immersive reality applications is provided. The wearable device includes eyepieces to provide a forward-image to a user, a first forward-looking camera mounted on the frame and having a field of view, a processor configured to identify a region of interest within the forward-image, and an interface device to indicate to the user that a field of view of the first forward-looking camera is misaligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.
-
公开(公告)号:US20230031871A1
公开(公告)日:2023-02-02
申请号:US17831305
申请日:2022-06-02
Applicant: Meta Platforms Technologies, LLC
Inventor: Sapna Shroff , Sebastian Sztuk , Johana Gabriela Coyoc Escudero , Jun Hu
IPC: H04N5/232 , H04N5/247 , G10L17/06 , G10L17/22 , G06F40/205 , G06F3/044 , G06F3/01 , G06V20/50 , G06V10/25
Abstract: A wearable device for use in immersive reality applications is provided. The wearable device has a frame including an eyepiece to provide a forward-image to a user, a first forward-looking camera mounted on the frame, the first forward-looking camera having a field of view within the forward-image, a sensor configured to receive a command from the user, the command indicative of a region of interest within the field of view, and an interface device to indicate to the user that a field of view of the first forward-looking camera is aligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.
-
公开(公告)号:US20250030940A1
公开(公告)日:2025-01-23
申请号:US18885376
申请日:2024-09-13
Applicant: Meta Platforms Technologies, LLC
Inventor: Sapna Shroff , Sebastian Sztuk , Johana Gabriela Coyoc Escudero , Jun Hu
IPC: H04N23/60 , G02B27/01 , G02C7/10 , G02C7/16 , G06F3/01 , G06F3/044 , G06F3/16 , G06F40/205 , G06V10/25 , G06V10/75 , G06V20/50 , G10L17/06 , G10L17/22 , H04N23/56 , H04N23/62 , H04N23/63 , H04N23/66 , H04N23/695 , H04N23/90
Abstract: A wearable device for use in immersive reality applications is provided. The wearable device has a frame including an eyepiece to provide a forward-image to a user, a first forward-looking camera mounted on the frame, the first forward-looking camera having a field of view within the forward-image, a sensor configured to receive a command from the user, the command indicative of a region of interest within the field of view, and an interface device to indicate to the user that a field of view of the first forward-looking camera is aligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.
-
公开(公告)号:US20250024138A1
公开(公告)日:2025-01-16
申请号:US18897630
申请日:2024-09-26
Applicant: Meta Platforms Technologies, LLC
Inventor: Sapna Shroff , Sebastian Sztuk , Jun Hu , Johana Gabriela Coyoc Escudero
IPC: H04N23/60 , G02B27/01 , G02C7/10 , G02C7/16 , G06F3/01 , G06F3/044 , G06F3/16 , G06F40/205 , G06V10/25 , G06V10/75 , G06V20/50 , G10L17/06 , G10L17/22 , H04N23/56 , H04N23/62 , H04N23/63 , H04N23/66 , H04N23/695 , H04N23/90
Abstract: A wearable device for use in immersive reality applications is provided. The wearable device includes eyepieces to provide a forward-image to a user, a first forward-looking camera mounted on the frame and having a field of view, a processor configured to identify a region of interest within the forward-image, and an interface device to indicate to the user that a field of view of the first forward-looking camera is misaligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.
-
-
-
-
-
-
-
-
-