公开(公告)号：WO2018057283A1

公开(公告)日：2018-03-29

申请号：PCT/US2017/050142

申请日：2017-09-05

Applicant: APPLE INC.

Inventor： JOHNSON, Garrett M. ,  HAYWARD, David

IPC: G06T5/00 ,  G06T5/40

Abstract: This invention provides methods for spatially localized image editing. For example, an input image is divided into multiple bins in each dimension. For each bin, a histogram is computed, along with local image statistics such as mean, medium and cumulative histogram. Next, for each tile, a type of adjustment is determined and applied, including adjustment associated with Exposure, Brightness, Shadows, Highlights, Contrast, and Blackpoint. The adjustments are done for all tiles in the input image to render a small adjustment image. The small image is then interpolated, for example, using an edge-preserving interpolation, to get a full size adjustment image with adjustment curve for each pixel. Subsequently, per-pixel image adjustments can be performed across an entire input image to render a final adjusted image.

Abstract translation: 本发明提供了用于空间定位的图像编辑的方法。 例如，输入图像在每个维度上被分成多个分箱。 对于每个bin，计算直方图以及局部图像统计信息，如平均值，中等和累积直方图。 接下来，对于每个图块，确定并应用一种调整类型，包括与曝光，亮度，阴影，高光，对比度和黑点相关的调整。 对输入图像中的所有图块进行调整，以呈现小调整图像。 然后例如使用边缘保留插值对小图像进行插值，以获得具有每个像素的调整曲线的全尺寸调整图像。 随后，可以在整个输入图像上执行每像素图像调整以渲染最终调整的图像。

公开(公告)号：WO2012018513A1

公开(公告)日：2012-02-09

申请号：PCT/US2011/044433

申请日：2011-07-19

Applicant: APPLE INC. ,  ZIMMER, Mark ,  STAHL, Geoff ,  HAYWARD, David ,  DOEPKE, Frank

Inventor： ZIMMER, Mark ,  STAHL, Geoff ,  HAYWARD, David ,  DOEPKE, Frank

IPC: G06T15/20

CPC classification number: G06F3/04815 ,  G06F3/005 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/0488 ,  G06F2203/0381 ,  G06T15/20

Abstract: The techniques disclosed herein use a compass, MEMS accelerometer, GPS module, and MEMS gyrometer to infer a frame of reference for a hand-held device. This can provide a true Frenet frame, i.e., X- and Y-vectors for the display, and also a Z-vector that points perpendicularly to the display. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track the Frenet frame of the device in real time to provide a continuous 3D frame-of-reference. Once this continuous frame of reference is known, the position of a user's eyes may either be inferred or calculated directly by using a device's front-facing camera. With the position of the user's eyes and a continuous 3D frame-of-reference for the display, more realistic virtual 3D depictions of the objects on the device's display may be created and interacted with by the user.

Abstract translation: 本文公开的技术使用罗盘，MEMS加速度计，GPS模块和MEMS陀螺仪来推断用于手持设备的参考框架。 这可以提供真正的Frenet帧，即用于显示的X和Y向量，以及垂直于显示器指向的Z向量。 事实上，随着来自加速度计，陀螺仪和其他实时报告状态的仪器的各种惯性线索，可以实时跟踪设备的Frenet帧，以提供连续的3D参考帧。 一旦知道了这个连续的参考框架，用户的眼睛的位置可以通过使用设备的前置摄像机来直接推断或计算。 随着用户眼睛的位置和用于显示器的连续的3D参考框架，可以创建和显示设备显示器上的对象的更逼真的虚拟3D描绘，并由用户进行交互。

公开(公告)号：WO2015047658A1

公开(公告)日：2015-04-02

申请号：PCT/US2014/053377

申请日：2014-08-29

Applicant: APPLE INC.

Inventor： GREEMEBAUM, Kenneth ,  HENDRY, Ian ,  OLLMAN, Ian ,  HAYWARD, David ,  TRIPATHI, Brijesh

IPC: G11B27/034 ,  H04N19/30 ,  H04N21/2343 ,  H04N21/845 ,  H04N21/2662

CPC classification number: H04N19/85 ,  G06T9/00 ,  G11B27/034 ,  H04N19/186 ,  H04N19/30 ,  H04N19/33 ,  H04N19/463 ,  H04N21/234327 ,  H04N21/2662 ,  H04N21/845

Abstract: Techniques are provided for encoding an extended image such that it is backwards compatible with existing decoding devices. An extended image format is defined such that the extended image format is consistent with an existing image format over the full range of the existing image format. Because the extended image format is consistent with the existing image format over the full range of the existing image format, additional image information that is included in an extended image can be extracted from the extended image. A base version of an image (expressed using the existing image format) may be encoded in a payload portion and the extracted additional information may be stored in a metadata portion of a widely supported image file format.

Abstract translation: 提供了用于对扩展图像进行编码的技术，使得其与现有的解码装置向后兼容。 定义扩展图像格式，使得扩展图像格式与现有图像格式的全部范围内的现有图像格式一致。 由于扩展图像格式与现有图像格式的全部范围内的现有图像格式一致，所以可以从扩展图像中提取包括在扩展图像中的附加图像信息。 图像的基本版本（使用现有图像格式表示）可以被编码在有效载荷部分中，并且所提取的附加信息可以存储在广泛支持的图像文件格式的元数据部分中。

公开(公告)号：WO2012128835A1

公开(公告)日：2012-09-27

申请号：PCT/US2012/021408

申请日：2012-01-16

Applicant: APPLE INC. ,  HAYWARD, David ,  ZHANG, Chendi

Inventor： HAYWARD, David ,  ZHANG, Chendi

IPC: H04N5/232 ,  H04N5/235

CPC classification number: H04N5/23216 ,  H04N5/23212 ,  H04N5/23229 ,  H04N5/23293 ,  H04N5/235

Abstract: This disclosure pertains to apparatuses, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image filters, while simultaneously setting auto exposure, auto focus, auto white balance, and/or other image processing technique input parameters based on the appropriate underlying image sensor data in a way that provides a seamless, dynamic, and intuitive experience for both the user and the client application software developer. Such techniques may handle the processing of image filters applying location-based distortions as well as those image filters that do not apply location-based distortions to the captured image data. Additionally, techniques are provided for increasing the performance and efficiency of various image processing systems when employed in conjunction with image filters that do not require all of an image sensor's captured image data to produce their desired image filtering effects.

Abstract translation: 本公开涉及用于将特定用户交互（例如手势）映射到各种图像滤波器的输入参数的装置，方法和计算机可读介质，同时设置自动曝光，自动对焦，自动白平衡和/或其他图像处理 基于适当的底层图像传感器数据的技术输入参数，为用户和客户端应用软件开发人员提供无缝，动态和直观的体验。 这样的技术可以处理应用基于位置的失真的图像滤波器的处理以及不对捕获的图像数据应用基于位置的失真的那些图像滤波器。 此外，当与不需要图像传感器的所有图像数据的所有图像数据以产生其期望的图像滤波效果的图像滤波器结合使用时，提供了用于提高各种图像处理系统的性能和效率的技术。

公开(公告)号：WO2008048767A1

公开(公告)日：2008-04-24

申请号：PCT/US2007/079670

申请日：2007-09-27

Applicant: APPLE INC. ,  MARCU, Gabriel, G. ,  ZIMMER, Mark ,  HAYWARD, David

Inventor： MARCU, Gabriel, G. ,  ZIMMER, Mark ,  HAYWARD, David

IPC: H04N1/60

CPC classification number: H04N1/407 ,  H04N1/6027 ,  H04N1/6086 ,  H04N5/23229 ,  H04N9/045 ,  H04N2209/046

Abstract: An automated RAW image processing method and system are disclosed. A RAW image and metadata related to the RAW image are obtained from a digital camera or other source. The RAW image and the related metadata are automatically processed using an Operating System service of a processing device to produce a resulting image in an absolute color space. When automatically processing, a predetermined tone reproduction curve is applied to the interpolate RAW image to produce the resulting image. The predetermined tone reproduction curve is derived from a plurality of reference images and is selected based on the metadata associated with the RAW image. The resulting image is then made available to an application program executing on the processing device through an application program interface with the Operating System service.

Abstract translation: 公开了一种自动化RAW图像处理方法和系统。 与RAW图像有关的RAW图像和元数据是从数码相机或其他来源获得的。 使用处理设备的操作系统服务自动处理RAW图像和相关的元数据，以在绝对颜色空间中产生结果图像。 当自动处理时，将预定的色调再现曲线应用于内插RAW图像以产生所得到的图像。 预定的色调再现曲线是从多个参考图像导出的，并且基于与RAW图像相关联的元数据被选择。 然后，所得到的图像通过与操作系统服务的应用程序接口可用于在处理设备上执行的应用程序。

公开(公告)号：EP2074814B1

公开(公告)日：2017-12-06

申请号：EP07853652.1

申请日：2007-09-27

Applicant: APPLE INC. ,  Marcu, Gabriel G. ,  Zimmer, Mark ,  Hayward, David

Inventor： MARCU, Gabriel G. ,  ZIMMER, Mark ,  HAYWARD, David

IPC: H04N1/60

CPC classification number: H04N1/407 ,  H04N1/6027 ,  H04N1/6086 ,  H04N5/23229 ,  H04N9/045 ,  H04N2209/046

公开(公告)号：EP3036743A1

公开(公告)日：2016-06-29

申请号：EP14767204.2

申请日：2014-08-29

Applicant: APPLE INC.

Inventor： GREEMEBAUM, Kenneth ,  HENDRY, Ian ,  OLLMAN, Ian ,  HAYWARD, David ,  TRIPATHI, Brijesh

IPC: G11B27/034 ,  H04N19/30 ,  H04N21/2343 ,  H04N21/845 ,  H04N21/2662

Abstract: Techniques are provided for encoding an extended image such that it is backwards compatible with existing decoding devices. An extended image format is defined such that the extended image format is consistent with an existing image format over the full range of the existing image format. Because the extended image format is consistent with the existing image format over the full range of the existing image format, additional image information that is included in an extended image can be extracted from the extended image. A base version of an image (expressed using the existing image format) may be encoded in a payload portion and the extracted additional information may be stored in a metadata portion of a widely supported image file format.

Abstract translation: 提供了用于对扩展图像进行编码的技术，使得其与现有的解码装置向后兼容。 定义扩展图像格式，使得扩展图像格式与现有图像格式的全部范围内的现有图像格式一致。 由于扩展图像格式与现有图像格式的全部范围内的现有图像格式一致，所以可以从扩展图像中提取包括在扩展图像中的附加图像信息。 图像的基本版本（使用现有图像格式表示）可以被编码在有效载荷部分中，并且所提取的附加信息可以存储在广泛支持的图像文件格式的元数据部分中。

公开(公告)号：EP2601640A1

公开(公告)日：2013-06-12

申请号：EP11738365.3

申请日：2011-07-19

Applicant: Apple Inc.

Inventor： ZIMMER, Mark ,  STAHL, Geoff ,  HAYWARD, David ,  DOEPKE, Frank

IPC: G06T15/20

CPC classification number: G06F3/04815 ,  G06F3/005 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/0488 ,  G06F2203/0381 ,  G06T15/20

Abstract: The techniques disclosed herein use a compass, MEMS accelerometer, GPS module, and MEMS gyrometer to infer a frame of reference for a hand-held device. This can provide a true Frenet frame, i.e., X- and Y-vectors for the display, and also a Z-vector that points perpendicularly to the display. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track the Frenet frame of the device in real time to provide a continuous 3D frame-of-reference. Once this continuous frame of reference is known, the position of a user's eyes may either be inferred or calculated directly by using a device's front-facing camera. With the position of the user's eyes and a continuous 3D frame-of-reference for the display, more realistic virtual 3D depictions of the objects on the device's display may be created and interacted with by the user.

Abstract translation: 的技术的光盘游离缺失使用罗盘，MEMS加速度计，GPS模块，和MEMS陀螺仪推断的参考框架用于一个手持式装置。 这可以提供一个真正的Frenet标帧，即，X和Y向量的显示，因而Z-向量做点垂直于显示器。 事实上，与加速度计，陀螺仪和其他仪器的各种惯性线索做实时报告他们的状态，它可以跟踪设备的Frenet标架实时提供连续3D帧的参考。 一旦参考该连续帧是已知的，用户的眼睛的位置可以被推断任一者或通过使用设备的前置摄像头直接计算。 与用户的眼睛的位置和一个连续的3D帧的参考的显示，在设备的显示器上的对象的更加逼真的虚拟3D描绘可以被创建并与由用户交互。

公开(公告)号：EP3036743B1

公开(公告)日：2019-11-13

申请号：EP14767204.2

申请日：2014-08-29

Applicant: Apple Inc.

Inventor： GREEMEBAUM, Kenneth ,  HENDRY, Ian ,  OLLMAN, Ian ,  HAYWARD, David ,  TRIPATHI, Brijesh

IPC: G11B27/034 ,  H04N19/30 ,  H04N21/2343 ,  H04N21/845 ,  H04N21/2662 ,  H04N19/463 ,  G06T9/00 ,  H04N19/186 ,  H04N19/33 ,  H04N19/85

公开(公告)号：EP2601640B1

公开(公告)日：2017-03-01

申请号：EP11738365.3

申请日：2011-07-19

Applicant: Apple Inc.

Inventor： ZIMMER, Mark ,  STAHL, Geoff ,  HAYWARD, David ,  DOEPKE, Frank

IPC: G06T15/20

CPC classification number: G06F3/04815 ,  G06F3/005 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/0488 ,  G06F2203/0381 ,  G06T15/20