Compressed Video Streaming for Multi-Camera Systems

    公开(公告)号:US20250111541A1

    公开(公告)日:2025-04-03

    申请号:US18477256

    申请日:2023-09-28

    Applicant: Apple Inc.

    Abstract: This disclosure describes techniques to concurrently capture several redundant (e.g., overlapping) video image streams on electronic devices having multiple image capture devices (e.g., on mobile devices having two or more digital video cameras). The techniques described herein advantageously capture at least one “compressed” video image stream, such that the overall multi-video image stream capture process uses significantly less power than capturing each stream independently in an “uncompressed” fashion. These techniques provide an electronic device with the ability to provide a user with more video streams that are of a higher frame rate and/or higher quality for a longer capture time-without exceeding the device's thermal limits. In particular, a “compressed” amount of image information may be processed and saved from at least one camera at capture time, and then deferred processing operations may be used to reconstruct any missing information and produce the higher frame rate/higher quality video image streams.

    Hue preservation post processing with early exit for highlight recovery

    公开(公告)号:US11620738B2

    公开(公告)日:2023-04-04

    申请号:US17373362

    申请日:2021-07-12

    Applicant: Apple Inc.

    Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

    Adaptive-Flash Photography, Videography, and/or Flashlight Using Camera, Scene, or User Input Parameters

    公开(公告)号:US20230098699A1

    公开(公告)日:2023-03-30

    申请号:US17934494

    申请日:2022-09-22

    Applicant: Apple Inc.

    Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.

    Shallow depth of field (SDOF) rendering

    公开(公告)号:US10897558B1

    公开(公告)日:2021-01-19

    申请号:US16566017

    申请日:2019-09-10

    Applicant: Apple Inc.

    Abstract: This disclosure relates to the lightweight and efficient synthesis of shallow depth of field (SDOF) renderings. According to some embodiments, coarse focus information and semantic segmentation information may be leveraged to generate SDOF renderings in a “live preview” or “streaming” mode. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Segmentations may include as many classes as are desired by a given implementation (e.g., a ‘foreground’ class and a ‘background’ class). In some embodiments, the rendering of synthetic SDOF images according to the techniques described herein may be completed using only a single camera of a device and without the use of dedicated depth-sensing technology (e.g., structured light cameras, stereo cameras, time-of-flight cameras, etc.), thereby allowing the SDOF rendering process to operate in a fashion that is not unduly time-, processing-, and/or power-intensive.

    Techniques for providing virtual light adjustments to image data

    公开(公告)号:US10740959B2

    公开(公告)日:2020-08-11

    申请号:US16032418

    申请日:2018-07-11

    Applicant: Apple Inc.

    Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A user interface for presenting and/or modifying image data may be provided via an electronic device. User input may be received that indicates a selection of a virtual lighting mode. Landmark points corresponding to a set of pixels of the image data may be identified based, at least in part, on depth measurement values of the set of pixels. One or more masks may be generated from the landmark points. One or more virtual lighting adjustments associated with the selected virtual lighting mode may be made to the image data using these masks (or the landmark points and an implied geometry of the landmark points). The adjusted/modified image may be presented to the user via the user interface at the electronic device.

    HUE PRESERVATION POST PROCESSING WITH EARLY EXIT FOR HIGHLIGHT RECOVERY

    公开(公告)号:US20210342989A1

    公开(公告)日:2021-11-04

    申请号:US17373362

    申请日:2021-07-12

    Applicant: Apple Inc.

    Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

    TECHNIQUES FOR PROVIDING VIRTUAL LIGHTING ADJUSTMENTS UTILIZING REGRESSION ANALYSIS AND FUNCTIONAL LIGHTMAPS

    公开(公告)号:US20200082607A1

    公开(公告)日:2020-03-12

    申请号:US16563335

    申请日:2019-09-06

    Applicant: Apple Inc.

    Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A number of source images may be generated to individually depict solid colors of a color space (e.g., RGB color space). Virtual lighting adjustments associated with a virtual lighting mode may be applied to each source image to generate a corresponding target image. The source images and the target images may be utilized to train a model to identify pixel modifications to be applied to image data. The modifications may be associated with a virtual lighting mode. Subsequently, a user may obtain image data (e.g., an image or video) select a virtual lighting mode via an image data processing application. The previously trained model may be utilized to modify the image to apply the virtual lighting effects associated with the selected virtual lighting mode.

    HUE PRESERVATION POST PROCESSING FOR HIGHLIGHT RECOVERY

    公开(公告)号:US20200074601A1

    公开(公告)日:2020-03-05

    申请号:US16121389

    申请日:2018-09-04

    Applicant: Apple Inc.

    Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

    TECHNIQUES FOR PROVIDING VIRTUAL LIGHT ADJUSTMENTS TO IMAGE DATA

    公开(公告)号:US20190080508A1

    公开(公告)日:2019-03-14

    申请号:US16032418

    申请日:2018-07-11

    Applicant: Apple Inc.

    Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A user interface for presenting and/or modifying image data may be provided via an electronic device. User input may be received that indicates a selection of a virtual lighting mode. Landmark points corresponding to a set of pixels of the image data may be identified based, at least in part, on depth measurement values of the set of pixels. One or more masks may be generated from the landmark points. One or more virtual lighting adjustments associated with the selected virtual lighting mode may be made to the image data using these masks (or the landmark points and an implied geometry of the landmark points). The adjusted/modified image may be presented to the user via the user interface at the electronic device.

Patent Agency Ranking