公开(公告)号：WO2016004115A1

公开(公告)日：2016-01-07

申请号：PCT/US2015/038682

申请日：2015-06-30

Applicant: APPLE INC.

Inventor： MCALLISTER, Iain A. ,  MOLGAARD, Claus

IPC: H04N5/225 ,  H04N5/232 ,  H04N5/262 ,  H04N3/14

CPC classification number: G03B13/34 ,  H04N3/1593 ,  H04N5/2258 ,  H04N5/2259 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23293 ,  H04N5/23296 ,  H04N5/2628

Abstract: Some embodiments include methods and/or systems for using multiple cameras to provide optical zoom to a user. Some embodiments include a first camera unit of a multifunction device capturing a first image of a first visual field. A second camera unit of the multifunction device simultaneously captures a second image of a second visual field. In some embodiments, the first camera unit includes a first optical package with a first focal length. In some embodiments, the second camera unit includes a second optical package with a second focal length. In some embodiments, the first focal length is different from the second focal length, and the first visual field is a subset of the second visual field. In some embodiments, the first image and the second image are preserved to a storage medium as separate data structures.

Abstract translation: 一些实施例包括使用多个相机向用户提供光学变焦的方法和/或系统。 一些实施例包括捕获第一视野的第一图像的多功能装置的第一相机单元。 多功能装置的第二相机单元同时捕获第二视野的第二图像。 在一些实施例中，第一相机单元包括具有第一焦距的第一光学封装。 在一些实施例中，第二相机单元包括具有第二焦距的第二光学封装。 在一些实施例中，第一焦距与第二焦距不同，第一视野是第二视野的子集。 在一些实施例中，将第一图像和第二图像作为单独的数据结构保存到存储介质。

公开(公告)号：WO2015184408A1

公开(公告)日：2015-12-03

申请号：PCT/US2015/033411

申请日：2015-05-29

Applicant: APPLE INC.

Inventor： MOLGAARD, Claus ,  TICO, Marius ,  TOFT, Rolf ,  HUBEL, Paul, M.

IPC: G06T5/50 ,  H04N5/235 ,  G06T7/20 ,  H04N5/355 ,  H04N5/232

CPC classification number: H04N5/23277 ,  G06T5/002 ,  G06T5/003 ,  G06T5/50 ,  G06T7/20 ,  G06T7/254 ,  G06T11/60 ,  G06T2207/10004 ,  G06T2207/10144 ,  G06T2207/20221 ,  H04N5/23229 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/2355 ,  H04N5/2356 ,  H04N5/35581 ,  H04N5/3597 ,  H04N5/91

Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images [e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a "spatial difference map." Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.

Abstract translation: 公开了从稳定的图像捕获装置捕捉和融合场景的短曝光和长曝光图像的技术。 更具体地，所公开的技术不仅使用共拍摄的短曝光图像和长曝光图像之间的单独的像素差异，而且使用长曝光图像中的遮挡区域的空间结构[例如，长曝光图像的区域 ）呈现由于场景物体运动造成的模糊）。 用于表示长曝光图像的该特征的新型装置是“空间差异图”。 可以使用空间差异图来识别用于融合的短曝光和长曝光图像中的像素，并且在一个实施例中，可以使用空间差异图来识别来自短曝光图像的像素以过滤融合后的图像，以便减少 输出图像中的视觉不连续性。

公开(公告)号：WO2018048895A1

公开(公告)日：2018-03-15

申请号：PCT/US2017/050269

申请日：2017-09-06

Applicant: APPLE INC.

Inventor： MOLGAARD, Claus ,  HUBEL, Paul M. ,  ATTAR, Ziv ,  VOLFIN, Ilana

IPC: G06K9/00 ,  G06K9/32 ,  G06K9/46

Abstract: Techniques are described for automated analysis and filtering of image data. Image data is analyzed to identify regions of interest (ROIs) within the image content. The image data also may have depth estimates applied to content therein. One or more of the ROIs may be designated to possess a base depth, representing a depth of image content against which depths of other content may be compared. Moreover, the depth of the image content within a spatial area of an ROI may be set to be a consistent value, regardless of depth estimates that may have been assigned from other sources. Thereafter, other elements of image content may be assigned content adjustment values in gradients based on their relative depth in image content as compared to the base depth and, optionally, based on their spatial distance from the designated ROI. Image content may be adjusted based on the content adjustment values.

Abstract translation: 描述了用于图像数据的自动分析和过滤的技术。 分析图像数据以识别图像内容中的感兴趣区域（ROI）。 图像数据还可以具有应用于其中的内容的深度估计。 一个或多个ROI可以被指定为具有基本深度，表示可以与其他内容的深度进行比较的图像内容的深度。 此外，ROI的空间区域内的图像内容的深度可以被设置为一致的值，而不管可能已经从其他源分配的深度估计。 此后，与基础深度相比，可选地，基于它们与指定ROI的空间距离，可以基于图像内容中的它们的相对深度，为图像内容的其他元素分配梯度内的内容调整值。 图像内容可以根据内容调整值进行调整。

公开(公告)号：WO2015017312A1

公开(公告)日：2015-02-05

申请号：PCT/US2014/048377

申请日：2014-07-28

Applicant: APPLE INC.

Inventor： SACHS, Todd S. ,  HUNTER, Kevin L. ,  ZULIANI, Marco ,  MOLGAARD, Claus

IPC: H04N17/00 ,  H04N5/232

CPC classification number: G06T7/0018 ,  G06T7/80 ,  G06T2207/10004 ,  H04N5/23216 ,  H04N5/23293 ,  H04N17/002

Abstract: A method for dynamically calibrating rotational offset in a device includes obtaining an image captured by a camera of the device. Orientation information of the device at the time of image capture may be associated with the image. Pixel data of the image may be analyzed to determine an image orientation angle for the image. A device orientation angle may be determined from the orientation information. A rotational offset, based on the image orientation angle and the device orientation angle, may be determined. The rotational offset is relative to the camera or orientation sensor. A rotational bias may be determined from statistical analysis of numerous rotational offsets from numerous respective images. In some embodiments, various thresholds and predetermined ranges may be used to exclude some rotational offsets from the statistical analysis or to discontinue processing for that image.

Abstract translation: 用于动态校准装置中的旋转偏移的方法包括获得由装置的照相机拍摄的图像。 图像拍摄时设备的方向信息可能与图像相关联。 可以分析图像的像素数据以确定图像的图像取向角度。 可以根据取向信息来确定设备取向角度。 可以确定基于图像取向角度和装置取向角度的旋转偏移。 旋转偏移量相对于相机或方位传感器。 旋转偏差可以根据来自大量各自图像的许多旋转偏移的统计分析来确定。 在一些实施例中，可以使用各种阈值和预定范围来从统计分析中排除一些旋转偏移或者中断对该图像的处理。

公开(公告)号：WO2016200741A1

公开(公告)日：2016-12-15

申请号：PCT/US2016/036078

申请日：2016-06-06

Applicant: APPLE INC.

Inventor： MOLGAARD, Claus ,  KEATING, Brett, M. ,  WILLIAMS, George, E. ,  ZULIANI, Marco ,  WONG, Vincent, Y. ,  DOEPKE, Frank ,  TIRA-THOMPSON, Ethan, J.

IPC: H04N5/232 ,  H04N5/262

CPC classification number: G11B27/34 ,  G06K9/00268 ,  G06K9/00718 ,  G06K9/4661 ,  H04N5/23229 ,  H04N5/23245 ,  H04N5/2352 ,  H04N5/2353 ,  H04N5/2621

Abstract: The invention relates to systems, methods, and computer readable media for responding to a user snapshot request by capturing anticipatory pre-snapshot image data as well as post-snapshot image data. The captured information may be used, depending upon the embodiment, to create archival image information and image presentation information that is both useful and pleasing to a user. The captured information may automatically be trimmed or edited to facilitate creating an enhanced image, such as a moving still image. Varying embodiments of the invention offer techniques for trimming and editing based upon the following: exposure, brightness, focus, white balance, detected motion of the camera, substantive image analysis, detected sound, image metadata, and/or any combination of the foregoing.

Abstract translation: 本发明涉及通过捕获预先预先快照图像数据以及快照后图像数据来响应用户快照请求的系统，方法和计算机可读介质。 根据实施例，可以使用捕获的信息来创建对用户有用和令人愉快的档案图像信息和图像呈现信息。 捕获的信息可以自动修剪或编辑，以便于创建增强图像，例如移动的静止图像。 本发明的不同实施例提供了基于以下内容进行修剪和编辑的技术：曝光，亮度，焦点，白平衡，检测到的相机运动，实质图像分析，检测到的声音，图像元数据和/或前述的任何组合。

公开(公告)号：WO2015034725A1

公开(公告)日：2015-03-12

申请号：PCT/US2014/052965

申请日：2014-08-27

Applicant: APPLE INC.

Inventor： KEATING, Brett ,  WONG, Vincent ,  SACHS, Todd ,  MOLGAARD, Claus ,  ROUSSON, Michael ,  HARRIS, Elliott ,  TITI, Justin ,  HSU, Karl ,  BRASKET, Jeff ,  ZULIANI, Marco

IPC: H04N5/232 ,  H04N1/21

CPC classification number: H04N5/77 ,  G06K9/00765 ,  G06K9/46 ,  G06K9/6201 ,  G06K9/6267 ,  G06K2009/4666 ,  G06T7/11 ,  H04N5/147 ,  H04N5/23219 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23293 ,  H04N21/8456

Abstract: Systems and methods for improving automatic selection of keeper images from a commonly captured set of images are described. A combination of image type identification and image quality metrics may be used to identify one or more images in the set as keeper images. Image type identification may be used to categorize the captured images into, for example, three or more categories. The categories may include portrait, action, or "other." Depending on the category identified, the images may be analyzed differently to identify keeper images. For portrait images, an operation may be used to identify the best set of faces. For action images, the set may be divided into sections such that keeper images selected from each section tell the story of the action. For the "other" category, the images may be analyzed such that those having higher quality metrics for an identified region of interest are selected.

Abstract translation: 描述了用于改善从一组共同拍摄的图像中保持图像的自动选择的系统和方法。 可以使用图像类型识别和图像质量度量的组合来识别该集合中的一个或多个图像作为保持器图像。 可以使用图像类型识别来将捕获的图像分类为例如三个或更多个类别。 类别可能包括纵向，动作或“其他”。 根据识别的类别，可以不同地分析图像以识别饲养员图像。 对于肖像图像，可以使用操作来识别最佳面部组。 对于动作图像，该集合可以被划分为部分，使得从每个部分中选择的守护者图像讲述动作的故事。 对于“其他”类别，可以分析图像，以便选择对于所识别的感兴趣区域具有较高质量度量的图像。

公开(公告)号：WO2018213149A1

公开(公告)日：2018-11-22

申请号：PCT/US2018/032482

申请日：2018-05-12

Applicant: APPLE, INC.

Inventor： MARINEAU-MES, Sebastien ,  MEZAK, Charles A. ,  BRADLEY, Arwen ,  NELSON, Alex T. ,  MITCHELL, Douglas P. ,  MOLGAARD, Claus ,  KLIVINGTON, Jason ,  VAN DER MERWE, Rudolph ,  SADEGHIPOOR KERMANI, Zahra ,  BAQAI, Farhan ,  SACHS, Todd S. ,  HUBEL, Paul

IPC: G06T5/50

CPC classification number: H04N5/23267 ,  G06T3/0068 ,  G06T3/40 ,  G06T5/003 ,  G06T5/50 ,  G06T7/207 ,  G06T7/337 ,  G06T2200/24 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20016 ,  G06T2207/20028 ,  G06T2207/20216 ,  G06T2207/20221 ,  G06T2207/30201

Abstract: In various implementations a method includes obtaining a plurality of source images, stabilizing the plurality of source images to generate a plurality of stabilized images, and averaging the plurality of stabilized image to generate a synthetic long exposure image. In various implementations, stabilizing the plurality of source images includes: selecting one of the plurality of source images to serve as a reference frame; and registering others of the plurality of source images to the reference frame by applying a perspective transformation to others of the plurality of the source images.

公开(公告)号：WO2017039853A1

公开(公告)日：2017-03-09

申请号：PCT/US2016/042816

申请日：2016-07-18

Applicant: APPLE INC.

Inventor： BISHOP, Thomas, E. ,  LINDSKOG, Alexander ,  MOLGAARD, Claus ,  DOEPKE, Frank

IPC: H04N5/235

CPC classification number: H04N13/106 ,  G06T5/002 ,  G06T7/593 ,  H04N5/23229 ,  H04N5/2356

Abstract: Generating an image with a selected level of background blur includes capturing, by a first image capture device, a plurality of frames of a scene, wherein each of the plurality of frames has a different focus depth, obtaining a depth map of the scene, determining a target object and a background in the scene based on the depth map, determining a goal blur for the background, and selecting, for each pixel in an output image, a corresponding pixel from the focus stack.

Abstract translation: 生成具有所选择的背景模糊级别的图像包括由第一图像捕获装置捕获场景的多个帧，其中多个帧中的每一个具有不同的焦点深度，获得场景的深度图，确定 基于深度图的场景中的目标对象和背景，确定背景的目标模糊，以及从输出图像中的每个像素选择来自焦点堆栈的对应像素。

公开(公告)号：EP3044947A1

公开(公告)日：2016-07-20

申请号：EP14767189.5

申请日：2014-08-27

Applicant: Apple Inc.

Inventor： KEATING, Brett ,  WONG, Vincent ,  SACHS, Todd ,  MOLGAARD, Claus ,  ROUSSON, Michael ,  HARRIS, Elliott ,  TITI, Justin ,  HSU, Karl ,  BRASKET, Jeff ,  ZULIANI, Marco

IPC: H04N5/232 ,  H04N1/21

Abstract: Systems and methods for improving automatic selection of keeper images from a commonly captured set of images are described. A combination of image type identification and image quality metrics may be used to identify one or more images in the set as keeper images. Image type identification may be used to categorize the captured images into, for example, three or more categories. The categories may include portrait, action, or “other.” Depending on the category identified, the images may be analyzed differently to identify keeper images. For portrait images, an operation may be used to identify the best set of faces. For action images, the set may be divided into sections such that keeper images selected from each section tell the story of the action. For the “other” category, the images may be analyzed such that those having higher quality metrics for an identified region of interest are selected.

Abstract translation: 描述了一种用于改善从一组共同拍摄的图像中保持图像的自动选择的系统和方法。 可以使用图像类型识别和图像质量度量的组合来识别该集合中的一个或多个图像作为保持器图像。 图像类型识别可以用于将捕获的图像分类为例如三个或更多个类别。 类别可以包括纵向，动作或“其他”。根据所识别的类别，可以不同地分析图像以识别守护者图像。 对于肖像图像，可以使用操作来识别最佳面部组。 对于动作图像，该集合可以被划分为部分，使得从每个部分中选择的守护者图像讲述动作的故事。 对于“其他”类别，可以分析图像，以便选择对于所识别的感兴趣区域具有较高质量度量的图像。

公开(公告)号：EP3044947B1

公开(公告)日：2020-09-23

申请号：EP14767189.5

申请日：2014-08-27

Applicant: Apple Inc.

Inventor： KEATING, Brett ,  WONG, Vincent ,  SACHS, Todd ,  MOLGAARD, Claus ,  ROUSSON, Michael ,  HARRIS, Elliott ,  TITI, Justin ,  HSU, Karl ,  BRASKET, Jeff ,  ZULIANI, Marco

IPC: H04N5/232 ,  H04N1/21 ,  G06T7/11