SCENE MOTION CORRECTION IN FUSED IMAGE SYSTEMS
    1.
    发明申请
    SCENE MOTION CORRECTION IN FUSED IMAGE SYSTEMS 审中-公开
    融合图像系统中的场景运动校正

    公开(公告)号:WO2015184408A1

    公开(公告)日:2015-12-03

    申请号:PCT/US2015/033411

    申请日:2015-05-29

    Applicant: APPLE INC.

    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images [e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a "spatial difference map." Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.

    Abstract translation: 公开了从稳定的图像捕获装置捕捉和融合场景的短曝光和长曝光图像的技术。 更具体地,所公开的技术不仅使用共拍摄的短曝光图像和长曝光图像之间的单独的像素差异,而且使用长曝光图像中的遮挡区域的空间结构[例如,长曝光图像的区域 )呈现由于场景物体运动造成的模糊)。 用于表示长曝光图像的该特征的新型装置是“空间差异图”。 可以使用空间差异图来识别用于融合的短曝光和长曝光图像中的像素,并且在一个实施例中,可以使用空间差异图来识别来自短曝光图像的像素以过滤融合后的图像,以便减少 输出图像中的视觉不连续性。

    STILL IMAGE STABILIZATION/OPTICAL IMAGE STABILIZATION SYNCHRONIZATION IN MULTI-CAMERA IMAGE CAPTURE
    2.
    发明申请
    STILL IMAGE STABILIZATION/OPTICAL IMAGE STABILIZATION SYNCHRONIZATION IN MULTI-CAMERA IMAGE CAPTURE 审中-公开
    多相机图像捕获中的静止图像稳定/光学图像稳定化同步

    公开(公告)号:WO2018048838A1

    公开(公告)日:2018-03-15

    申请号:PCT/US2017/050186

    申请日:2017-09-06

    Applicant: APPLE INC.

    Abstract: Techniques are disclosed for managing image capture and processing in a multi-camera imaging system. In such a system, a pair of cameras each may output a sequence of frames representing captured image data. The cameras output may be synchronized to each other to cause synchronism in the image capture operations of the cameras. The system may assess image quality of frames output from the cameras and, based on the image quality, designate a pair of the frames to serve as a reference frame pair. Thus, one frame from the first camera and a paired frame from the second camera will be designated as the reference frame pair. The system may adjust each reference frame in the pair using other frames from their respective cameras. The reference frames also may be processed by other operations within the system, such as image fusion.

    Abstract translation: 公开了用于管理多相机成像系统中的图像捕获和处理的技术。 在这样的系统中,一对照相机各自可以输出表示捕获的图像数据的一系列帧。 摄像机输出可以彼此同步以引起摄像机的图像捕捉操作中的同步。 系统可以评估从相机输出的帧的图像质量,并基于图像质量指定一对帧以用作参考帧对。 因此,来自第一摄像机的一帧和来自第二摄像机的成对帧将被指定为参考帧对。 系统可以使用来自它们各自相机的其他帧来调整该对中的每个参考帧。 参考帧也可以通过系统内的其他操作进行处理,例如图像融合。

    MISMATCHED FOREIGN LIGHT DETECTION AND MITIGATION IN THE IMAGE FUSION OF A TWO-CAMERA SYSTEM
    4.
    发明申请
    MISMATCHED FOREIGN LIGHT DETECTION AND MITIGATION IN THE IMAGE FUSION OF A TWO-CAMERA SYSTEM 审中-公开
    双摄像头系统图像融合中的不匹配外光检测与降低

    公开(公告)号:WO2017214523A1

    公开(公告)日:2017-12-14

    申请号:PCT/US2017/036785

    申请日:2017-06-09

    Applicant: APPLE INC.

    Abstract: Foreign lighting effects, such as lens flare, are very common in natural images. In a two-camera-system, the two images may be fused together to generate one image of a better quality. However, there are frequently different foreign light patterns in the two images that form the image pair, e.g., due to the difference in lens design, sensor and position, etc. Directly fusing such pairs of images will result in non-photorealistic images, with composed foreign light patterns from both images from the image pair. This disclosure describes a general foreign light mitigation scheme to detect all kinds of foreign light region mismatches. The detected foreign light mismatch regions may be deemphasized or excluded in the fusion step, in order to create a fused image that keeps a natural-looking foreign light pattern that is close to what was seen by the user of an image capture device during an image capture preview mode.

    Abstract translation: 外部照明效果,例如镜头光晕,在​​自然图像中非常常见。 在双摄像机系统中,两幅图像可以融合在一起以生成更好质量的一幅图像。 然而,例如由于透镜设计,传感器和位置等的差异,在形成图像对的两个图像中经常存在不同的外来光图案。直接融合这样的图像对将导致非真实感图像,其中 组成来自图像对的两个图像的外来光图案。 本公开描述了用于检测各种外来光区域不匹配的一般外来光缓解方案。 检测到的异质光失配区域可以在融合步骤中不被强调或排除,以便创建融合图像,该融合图像保持与图像捕获设备的用户在图像期间看到的接近自然的外来光图案 捕获预览模式。

    METHODS OF IMAGE FUSION FOR IMAGE STABILIZATON
    5.
    发明申请
    METHODS OF IMAGE FUSION FOR IMAGE STABILIZATON 审中-公开
    图像融合方法对图像稳定性的影响

    公开(公告)号:WO2014197154A1

    公开(公告)日:2014-12-11

    申请号:PCT/US2014/036879

    申请日:2014-05-06

    Applicant: APPLE INC.

    Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. Novel approaches for fusing non- reference images with a pre-selected reference frame in a set of commonly captured images are disclosed. The fusing approach may use a soft transition by using a weighted average for ghost/non-ghost pixels to avoid sudden transition between neighborhood and almost similar pixels. Additionally, the ghost/non-ghost decision can be made based on a set of neighboring pixels rather than independently for each pixel. An alternative approach may involve performing a multi-resolution decomposition of all the captured images, using temporal fusion, spatio-temporal fusion, or combinations thereof, at each level and combining the different levels to generate an output image.

    Abstract translation: 描述了用于改善图像稳定操作的系统,方法和计算机可读介质。 公开了一组用于将非参考图像与一组常规拍摄图像中的预选参考帧融合的新方法。 融合方法可以通过使用重影/非重像素的加权平均值来使用软转换,以避免邻域和几乎相似像素之间的突然过渡。 此外,可以基于一组相邻像素而不是针对每个像素独立地进行重影/非重影决定。 替代方法可以包括在每个级别上使用时间融合,时空融合或其组合执行所有捕获图像的多分辨率分解,并组合不同的级别以生成输出图像。

Patent Agency Ranking