公开(公告)号：US09684999B1

公开(公告)日：2017-06-20

申请号：US14713876

申请日：2015-05-15

Applicant: Apple Inc.

Inventor： Domenico P. Porcino ,  Jacques P. Gasselin de Richebourg ,  Norman N. Wang ,  Timothy R. Oriol

IPC: G06T17/10 ,  G06T17/20 ,  G06T13/20

CPC classification number: G06T17/20 ,  A63F13/52 ,  A63F2300/6615 ,  G06T13/20 ,  G06T17/10 ,  G06T19/20 ,  G06T2200/04 ,  G06T2219/2021

Abstract: Techniques are disclosed for providing easily computable representations of dynamic objects so that a graphic systems' physics engine can more accurately and realistically determine the result of physical actions on, or with, such dynamic objects. More particularly, disclosed techniques generate a convex decomposition of an arbitrarily complex polygonal shape that is then simplified in a manner that preserves physically significant details, resulting in an object having a relatively small number of convex shapes that cover the original polygonal shape. The salience of a physically significant detail may be controlled via a threshold value which may be user or system specified.

公开(公告)号：US20160357532A1

公开(公告)日：2016-12-08

申请号：US15081451

申请日：2016-03-25

Applicant: Apple Inc.

Inventor： Jacques P. Gasselin de Richebourg ,  Domenico P. Porcino ,  Timothy R. Oriol

IPC: G06F9/45 ,  G06T1/20 ,  G06T15/80

Abstract: The disclosure pertains to the operation of graphics systems and to a variety of architectures for design and/or operation of a graphics system spanning from the output of an application program and extending to the presentation of visual content in the form of pixels or otherwise. In general, many embodiments of the invention envision the processing of graphics programming according to an on-the-fly decision made regarding how best to use the specific available hardware and software. In some embodiments, a software arrangement may be used to evaluate the specific system hardware and software capabilities, then make a decision regarding what is the best graphics programming path to follow for any particular graphics request. The decision regarding the best path may be made after evaluating the hardware and software alternatives for the path in view of the particulars of the graphics program to be processed.

Abstract translation: 本公开涉及图形系统的操作以及用于从应用程序的输出跨越到以像素或其他形式呈现视觉内容的图形系统的设计和/或操作的各种架构。 通常，本发明的许多实施例根据关于如何最好地使用特定的可用硬件和软件的即时决定来设想图形编程的处理。 在一些实施例中，可以使用软件布置来评估特定的系统硬件和软件能力，然后作出关于什么是用于任何特定图形请求的最佳图形编程路径的决定。 考虑到要处理的图形程序的细节，可以在评估路径的硬件和软件替代方案之后做出关于最佳路径的决定。

公开(公告)号：US09245358B2

公开(公告)日：2016-01-26

申请号：US14292731

申请日：2014-05-30

Applicant: Apple Inc.

Inventor： Norman N. Wang ,  Timothy R. Oriol ,  Jacques P. Gasselin de Richebourg ,  Domenico P. Porcino

IPC: G09G5/00 ,  G06T11/00 ,  G09G5/02 ,  G06T5/00 ,  G06T3/40

CPC classification number: G06T11/001 ,  G06T3/40 ,  G06T5/002 ,  G06T5/003 ,  G06T15/04 ,  G06T15/503 ,  G09G5/026

Abstract: Systems, methods and program storage devices are disclosed, which comprise instructions to cause one or more processing units to dynamically generate refined normal maps for 2D texture maps, e.g., supplied by a programmer or artist. Generally speaking, there are two pertinent properties to keep in balance when generating normal vectors comprising a normal map: “smoothness” and “bumpiness.” The smoothness of the normal vectors is influenced by how many neighboring pixels are involved in the “smoothening” calculation. Incorporating the influence of a greater number of neighboring pixels' values reduces the overall bumpiness of the normal map, as each pixel's value takes weight from those neighboring pixels. Thus, the techniques described herein iteratively: downsample height maps; generate normal maps; scale the normal maps to maintain bumpiness; and blend the generated scaled normal maps with generated normal maps from previous iterations—until the smoothness of the resultant normal map has reached desired levels.

Abstract translation: 公开了系统，方法和程序存储设备，其包括使一个或多个处理单元动态地生成2D纹理贴图的精细法线贴图的指令，例如由程序员或艺术家提供。 一般来说，当产生包含法线贴图的法向矢量时，有两个相关的属性保持平衡：“平滑度”和“颠簸”。法向矢量的平滑度受“平滑”计算中涉及的相邻像素数量的影响 。 结合更多数量的相邻像素值的影响可减少法线贴图的整体颠簸，因为每个像素的值从这些相邻像素获取权重。 因此，本文描述的技术迭代地：下采样高度图; 生成法线贴图; 缩放法线贴图以保持颠簸; 并将生成的缩放法线图与先前迭代中生成的法线贴图混合，直到得到的法线贴图的平滑度达到期望水平。

公开(公告)号：US20150348511A1

公开(公告)日：2015-12-03

申请号：US14291464

申请日：2014-05-30

Applicant: Apple Inc.

Inventor： Timothy R. Oriol ,  Norman N. Wang ,  Domenico P. Porcino ,  Jacques P. Gasselin de Richebourg

IPC: G09G5/36 ,  G06F3/01

CPC classification number: G06F3/01 ,  G06F1/1694 ,  G06F1/3265 ,  G06F3/011 ,  G09G5/003 ,  G09G2320/0261 ,  G09G2320/103 ,  G09G2330/021 ,  G09G2330/022 ,  G09G2340/0435 ,  G09G2356/00 ,  H04N5/23241

Abstract: The refresh rate of a display of a portable display device is dependent on the degree of device motion detected by one or more motion sensors included in the portable display device, according to an embodiment of the invention. In an embodiment, when no device motion is detected by the one or more sensors, the display of the portable display device is refreshed at an initial refresh rate. When the one or more motion sensors detects a degree of device motion above a motion threshold, the refresh rate of the display is decreased to a motion-based refresh rate, according to an embodiment. In an embodiment, the degree of motion of moving content on the display is also taken into account when determining the display refresh rate.

Abstract translation: 根据本发明的实施例，便携式显示设备的显示器的刷新率取决于由便携式显示设备中包括的一个或多个运动传感器检测到的设备运动的程度。 在一个实施例中，当一个或多个传感器没有检测到装置运动时，以初始刷新率刷新便携式显示装置的显示。 当一个或多个运动传感器检测到高于运动阈值的装置运动程度时，根据实施例，显示器的刷新率被降低到基于运动的刷新率。 在一个实施例中，当确定显示刷新率时也考虑移动内容在显示器上的运动程度。

公开(公告)号：US20150348316A1

公开(公告)日：2015-12-03

申请号：US14292761

申请日：2014-05-30

Applicant: APPLE INC.

Inventor： Domenico P. Porcino ,  Timothy R. Oriol ,  Norman N. Wang ,  Jacques P. Gasselin de Richebourg

IPC: G06T15/80 ,  G06T1/20 ,  G06T13/20 ,  G06T7/40 ,  G06K9/46

CPC classification number: G06T1/20 ,  G06K9/2027 ,  G06K9/4661 ,  G06T7/40 ,  G06T15/04

Abstract: Systems, methods and program storage devices are disclosed, which cause one or more processing units to: obtain one or more two-dimensional components and one or more three-dimensional components; convert the pixel color values of the two-dimensional components into luminance values; create height maps over the two-dimensional components using the converted luminance values; calculate a normal vector for each pixel in each of two-dimensional components; and cause one or more processing units to render three-dimensional lighting effects on the one or more two-dimensional components and one or more three-dimensional components in a mixed scene, wherein the calculated normal vectors are used as the normal maps for the two-dimensional components, the pixel color values are used as the texture maps for the two-dimensional components, and the one or more three-dimensional components are rendered in the scene according their respective depth values, textures, and/or vertices—along with the one or more two-dimensional components.

Abstract translation: 公开了一种系统，方法和程序存储设备，其使一个或多个处理单元获得一个或多个二维分量和一个或多个三维分量; 将二维分量的像素颜色值转换为亮度值; 使用转换的亮度值在二维分量上创建高度图; 为每个二维分量中的每个像素计算法向量; 并且使一个或多个处理单元对混合场景中的一个或多个二维分量和一个或多个三维分量呈现三维照明效果，其中所计算的法向量用作两者的法线图 将像素颜色值用作二维分量的纹理图，并且根据其各自的深度值，纹理和/或顶点在场景中呈现一个或多个三维分量，以及 一个或多个二维组件。

公开(公告)号：US20140184606A1

公开(公告)日：2014-07-03

申请号：US14063970

申请日：2013-10-25

Applicant: Apple Inc.

Inventor： Jacques P. Gasselin de Richebourg ,  Norman N. Wang ,  Timothy R. Oriol ,  Geoffrey G. Stahl

IPC: G06T11/20

CPC classification number: G06T1/20 ,  G06T1/60 ,  G06T13/80 ,  G06T15/005 ,  G06T15/04 ,  G06T2210/61

Abstract: A set of tools, in the form of a software developers kit (SDK) for a graphics rendering system, is provided to improve overall graphics operations. In general, the tools are directed to analyzing a scene tree and optimizing its presentation to one or more graphics processing units (GPUs) so as to improve rendering operations. This overall goal is provided through a number of different capabilities, each of which is presented to software developers through a new applications programming interface (API).

Abstract translation: 提供了一套用于图形渲染系统的软件开发工具包（SDK）的工具，以改善整体图形操作。 通常，这些工具旨在分析场景树并将其呈现优化到一个或多个图形处理单元（GPU），以便改进渲染操作。 这个总体目标是通过许多不同的功能提供的，每个功能都通过新的应用程序编程接口（API）提供给软件开发人员。

公开(公告)号：US20250036252A1

公开(公告)日：2025-01-30

申请号：US18910335

申请日：2024-10-09

Applicant: Apple Inc.

Inventor： Edwin Iskandar ,  Ittinop Dumnernchanvanit ,  Samuel L. Iglesias ,  Timothy R. Oriol

IPC: G06F3/04815 ,  G06F3/01 ,  G06F3/04842 ,  G06F3/04845 ,  G06F3/16

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide a CGR environment in which virtual objects from one or more apps are included. User interactions with the virtual objects are detected and interpreted by a system that is separate from the apps that provide the virtual objects. The system detects user interactions received via one or more input modalities and interprets those user interactions as events. These events provide a higher-level, input modality-independent, abstractions of the lower-level input-modality dependent user interactions that are detected. The system uses UI capability data provided by the apps to interpret user interactions with respect to the virtual object provided by the apps. For example, the UI capability data can identify whether a virtual object is moveable, actionable, hover-able, etc. and the system interprets user interactions at or near the virtual object accordingly.

公开(公告)号：US20240394952A1

公开(公告)日：2024-11-28

申请号：US18797340

申请日：2024-08-07

Applicant: Apple Inc.

Inventor： Arthur Y Zhang ,  Ray L. Chang ,  Timothy R. Oriol ,  Ling Su ,  Gurjeet S. Saund ,  Guy Cote ,  Jim C. Chou ,  Hao Pan ,  Tobias Eble ,  Avi Bar-Zeev ,  Sheng Zhang ,  Justin A. Hensley ,  Geoffrey Stahl

IPC: G06T15/00 ,  G06F3/01 ,  G06T3/18 ,  G06T9/00 ,  H04W76/10 ,  H04W88/08

Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

公开(公告)号：US12141414B2

公开(公告)日：2024-11-12

申请号：US18217711

申请日：2023-07-03

Applicant: Apple Inc.

Inventor： Edwin Iskandar ,  Ittinop Dumnernchanvanit ,  Samuel L. Iglesias ,  Timothy R. Oriol

IPC: G06F3/04815 ,  G06F3/01 ,  G06F3/04842 ,  G06F3/04845 ,  G06F3/16

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide a CGR environment in which virtual objects from one or more apps are included. User interactions with the virtual objects are detected and interpreted by a system that is separate from the apps that provide the virtual objects. The system detects user interactions received via one or more input modalities and interprets those user interactions as events. These events provide a higher-level, input modality-independent, abstractions of the lower-level input-modality dependent user interactions that are detected. The system uses UI capability data provided by the apps to interpret user interactions with respect to the virtual object provided by the apps. For example, the UI capability data can identify whether a virtual object is moveable, actionable, hover-able, etc. and the system interprets user interactions at or near the virtual object accordingly.

公开(公告)号：US11875162B2

公开(公告)日：2024-01-16

申请号：US17845708

申请日：2022-06-21

Applicant: Apple Inc.

Inventor： Helmut Garstenauer ,  Martin Garstenauer ,  Edwin Iskandar ,  Timothy R. Oriol ,  Geoffrey Stahl ,  Cody J. White

IPC: G06F9/451 ,  G06F3/01 ,  G06T19/00

CPC classification number: G06F9/451 ,  G06F3/011 ,  G06T19/006

Abstract: The present disclosure relates to providing a computer-generated reality (CGR) platform for generating CGR environments including virtual and augmented reality environments. In some embodiments, information related to an object to be simulated and rendered in the CGR environment is provided to the CGR platform, and a three-dimensional representation of the object is displayed in the CGR environment.