公开(公告)号：US20250119642A1

公开(公告)日：2025-04-10

申请号：US18983988

申请日：2024-12-17

Applicant: GoPro, Inc.

Inventor： Thomas Nicolas Emmanuel Veit ,  Sylvain Leroy ,  Heng Zhang ,  Ingrid Cotoros

IPC: H04N23/667 ,  H04N23/68 ,  H04N23/71 ,  H04N23/741

Abstract: A camera mode to use for capturing an image or video is selected by estimating high dynamic range (HDR), motion, and light intensity with respect to a scene of the image or video to capture. An image capture device includes a HDR estimation unit to detect whether HDR is present in a scene of an image to capture, a motion estimation unit to determine whether motion is detected within the scene, and a light intensity estimation unit to determine whether a scene luminance for the scene meets a threshold. A mode selection unit selects a camera mode to use for capturing the image based on output of the HDR estimation unit, the motion estimation unit, and the light intensity estimation unit. An image sensor captures the image according to the selected camera mode.

公开(公告)号：US20240177275A1

公开(公告)日：2024-05-30

申请号：US18435359

申请日：2024-02-07

Applicant: GoPro, Inc.

Inventor： Matias Tassano Ferrés ,  Thomas Nicolas Emmanuel Veit ,  Julie Delon

IPC: G06T5/70 ,  G06N3/08 ,  G06T5/50

CPC classification number: G06T5/70 ,  G06N3/08 ,  G06T5/50 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: An image capture device includes an image sensor and a processor. The image sensor is configured to capture a first plurality of frames, a second plurality of frames, and a third plurality of frames. The processor includes a first denoising layer and a second denoising layer. The first denoising layer includes a first denoiser, a second denoiser, and a third denoiser. The first denoiser is configured to denoise the first plurality of frames and output a first denoised frame. The second denoiser is configured to denoise the second plurality of frames and output a second denoised frame. The third denoiser is configured to denoise the third plurality of frames and output a third denoised frame. The second denoising layer includes a fourth denoiser. The fourth denoiser is configured to output a denoised frame based on the first denoised frame, the second denoised frame, and the third denoised frame.

公开(公告)号：US20220377224A1

公开(公告)日：2022-11-24

申请号：US17881371

申请日：2022-08-04

Applicant: GoPro, Inc.

Inventor： Bruno César Douady-Pleven ,  Thomas Nicolas Emmanuel Veit ,  Guillaume Matthieu Guérin

IPC: H04N5/235 ,  G06T5/00 ,  H04N5/232

Abstract: An image capture apparatus may include an image sensor, a motion sensor, and an auto-exposure unit. The auto-exposure unit may obtain an input image captured during an exposure interval and corresponding motion data indicating motion of the image capture apparatus during the exposure interval. The auto-exposure unit may obtain image information-amount data for the input image. The auto-exposure unit may obtain derivative information-amount data based on the information-amount data and a candidate exposure adjustment. The auto-exposure unit may obtain an information-amount maximizing exposure interval based on the information-amount data and the derivative information-amount data. The image capture apparats may control the image sensor to obtain a subsequent input image signal representing a subsequent input image captured during the information-amount maximizing exposure interval, and output or store information representing the subsequent input image.

公开(公告)号：US11508046B2

公开(公告)日：2022-11-22

申请号：US17132357

申请日：2020-12-23

Applicant: GoPro, Inc.

Inventor： Heng Zhang ,  Thomas Nicolas Emmanuel Veit ,  Guillaume Matthieu Guérin

IPC: G06T5/00 ,  G06T5/20 ,  H04N9/64

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include accessing an image from an image sensor; detecting an object area on the image; classifying the object area on the image; applying a filter to an object area of the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.

公开(公告)号：US20220360711A1

公开(公告)日：2022-11-10

申请号：US17872529

申请日：2022-07-25

Applicant: GoPro, Inc.

Inventor： Thomas Nicolas Emmanuel Veit ,  Sylvain Leroy ,  Heng Zhang ,  Ingrid Cotoros

IPC: H04N5/232 ,  H04N5/235

Abstract: A camera mode to use for capturing an image or video is selected by estimating high dynamic range (HDR), motion, and light intensity with respect to a scene of the image or video to capture. An image capture device includes a HDR estimation unit to detect whether HDR is present in a scene of an image to capture, a motion estimation unit to determine whether motion is detected within the scene, and a light intensity estimation unit to determine whether a scene luminance for the scene meets a threshold. A mode selection unit selects a camera mode to use for capturing the image based on output of the HDR estimation unit, the motion estimation unit, and the light intensity estimation unit. An image sensor captures the image according to the selected camera mode.

公开(公告)号：US20210166354A1

公开(公告)日：2021-06-03

申请号：US16756732

申请日：2018-10-17

Applicant: GoPro, Inc.

Inventor： Thomas Nicolas Emmanuel Veit ,  Marc Lebrun

IPC: G06T5/00 ,  G06K9/62 ,  G06K9/46

Abstract: Systems and methods are disclosed for denoising chrominance channels of images. For example, methods may include receiving an image from one or more image sensors; determining a set of weights for the image based on a luminance channel of the image, wherein a weight in the set of weights corresponds to a subject pixel and a candidate pixel and is determined based on luminance values of one or more pixels of the image centered at the subject pixel and one or more pixels of the image centered at the candidate pixel; applying the set of weights to chrominance channels of the image to obtain a denoised image, wherein the subject pixel of the denoised image is determined based on the weight multiplied by the candidate pixel of the image; and storing, displaying, or transmitting an output image based on the denoised image.

公开(公告)号：US10757384B2

公开(公告)日：2020-08-25

申请号：US16043487

申请日：2018-07-24

Applicant: GoPro, Inc.

Inventor： Bruno César Douady-Pleven ,  Thomas Nicolas Emmanuel Veit ,  Marc Lebrun

IPC: G06K9/00 ,  H04N9/64 ,  G06T7/90 ,  H04N9/04 ,  G06T5/50 ,  G06T5/00

Abstract: Image signal processing may include desaturation control, which may include adaptive desaturation control. Image signal processing with desaturation control may include obtaining, by an image signal processor, from an image sensor, an input image signal representing an input image, obtaining, by the image signal processor, color correction information for the input image, obtaining a color corrected image based on the input image using color correction with desaturation control such that inaccurate colorization of the color corrected image is minimized, and outputting the color corrected image.

公开(公告)号：US20200267339A1

公开(公告)日：2020-08-20

申请号：US16303892

申请日：2017-05-24

Applicant: GoPro, Inc.

Inventor： Bruno César Douady-Pleven ,  Michael Serge Andre Kraak ,  Guillaume Matthieu Guérin ,  Thomas Nicolas Emmanuel Veit

IPC: H04N5/357 ,  G06T5/50 ,  G06T5/20 ,  H04N13/271 ,  H04N19/90 ,  H04N19/70 ,  H04N19/423 ,  H04N19/176 ,  H04N19/136 ,  H04N19/10 ,  H04N5/232 ,  G06T3/40 ,  G06T7/80 ,  H04N5/225 ,  G06T3/00 ,  H04N19/85 ,  H04N17/00 ,  H04N5/247

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.

公开(公告)号：US10530995B2

公开(公告)日：2020-01-07

申请号：US15821032

申请日：2017-11-22

Applicant: GoPro, Inc.

Inventor： Bruno César Douady-Pleven ,  Michael Serge Andre Kraak ,  Guillaume Matthieu Guérin ,  Thomas Nicolas Emmanuel Veit

IPC: G06T5/00 ,  H04N5/232 ,  H04N1/407 ,  H04N9/64 ,  H04N9/73 ,  H04N9/77 ,  G06T3/40 ,  G06T5/50 ,  H04N5/235 ,  H04N5/357 ,  H04N9/68 ,  H04N1/60 ,  H04N9/04

Abstract: A system accesses an image with each pixel of the image having luminance values each representative of a color component of the pixel. The system generates a first histogram for aggregate luminance values of the image, and accesses a target histogram for the image representative of a desired global image contrast. The system computes a transfer function based on the first histogram and the target histogram such that when the transfer function is applied, a histogram of the modified aggregate luminance values is within a threshold similarity of the target histogram. The system modifies the image by applying the transfer function to the luminance values of the image to produce a tone mapped image, and outputs the modified image.

公开(公告)号：US20240137658A1

公开(公告)日：2024-04-25

申请号：US18539952

申请日：2023-12-14

Applicant: GoPro, Inc.

Inventor： Bruno César Douady ,  Michael Serge Andre Kraak ,  Thomas Nicolas Emmanuel Veit ,  Guillaume Matthieu Guérin

IPC: H04N23/80 ,  G06T3/4015 ,  G06T5/40 ,  G06T5/50 ,  G06T5/75 ,  G06T5/92 ,  H04N1/407 ,  H04N1/60 ,  H04N9/64 ,  H04N9/68 ,  H04N9/77 ,  H04N23/10 ,  H04N23/60 ,  H04N23/741 ,  H04N23/88 ,  H04N25/60 ,  H04N25/61

CPC classification number: H04N23/80 ,  G06T3/4015 ,  G06T5/40 ,  G06T5/50 ,  G06T5/75 ,  G06T5/92 ,  H04N1/4074 ,  H04N1/6008 ,  H04N1/603 ,  H04N9/643 ,  H04N9/646 ,  H04N9/68 ,  H04N9/77 ,  H04N23/10 ,  H04N23/60 ,  H04N23/741 ,  H04N23/88 ,  H04N25/60 ,  H04N25/61 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20012 ,  G06T2207/20182 ,  H04N2209/046

Abstract: A non-transitory computer-readable storage medium stores executable instructions that, when executed by a processor, cause performance of operations comprising operations to access an image captured by an image sensor, obtain a transfer function for mapping pixel values, determine a faces indication that reflects a proportion of a scene depicted in the image that includes one or more human faces, and modify the transfer function based on the faces indication. Modifying the transfer function based on the faces indication comprises adjusting a gain of the transfer function to move the gain closer to unity. The operations include to apply the transfer function to pixel values of the image to produce a tone mapped image and output the tone mapped image.