-
公开(公告)号:US10984276B2
公开(公告)日:2021-04-20
申请号:US16586827
申请日:2019-09-27
Applicant: FotoNation Limited
Inventor: Kartik Venkataraman , Semyon Nisenzon , Dan Lelescu
IPC: G06K9/00 , G06K9/36 , H04N13/128 , H04N13/161 , H04N13/243 , H04N13/271 , G06T7/50 , G06T9/00 , G06T9/20 , H04N19/597 , H04N19/625 , H04N19/136 , G06T3/40 , H04N19/85 , G06T15/08 , G06T7/593 , H04N13/00
Abstract: Systems and methods in accordance with embodiments of the invention are configured to render images using light field image files containing an image synthesized from light field image data and metadata describing the image that includes a depth map. One embodiment of the invention includes a processor and memory containing a rendering application and a light field image file including an encoded image, a set of low resolution images, and metadata describing the encoded image, where the metadata comprises a depth map that specifies depths from the reference viewpoint for pixels in the encoded image. In addition, the rendering application configures the processor to: locate the encoded image within the light field image file; decode the encoded image; locate the metadata within the light field image file; and post process the decoded image by modifying the pixels based on the depths indicated within the depth map and the set of low resolution images to create a rendered image.
-
公开(公告)号:US20210042952A1
公开(公告)日:2021-02-11
申请号:US17078732
申请日:2020-10-23
Applicant: FotoNation Limited
Inventor: Ankit Jain , Priyam Chatterjee , Kartik Venkataraman
Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.
-
公开(公告)号:US10767981B2
公开(公告)日:2020-09-08
申请号:US16177191
申请日:2018-10-31
Applicant: FotoNation Limited
Inventor: Kartik Venkataraman , Jacques Duparré
Abstract: Systems and methods in accordance with embodiments of the invention estimate depth from projected texture using camera arrays. One embodiment of the invention includes: at least one two-dimensional array of cameras comprising a plurality of cameras; an illumination system configured to illuminate a scene with a projected texture; a processor; and memory containing an image processing pipeline application and an illumination system controller application. In addition, the illumination system controller application directs the processor to control the illumination system to illuminate a scene with a projected texture. Furthermore, the image processing pipeline application directs the processor to: utilize the illumination system controller application to control the illumination system to illuminate a scene with a projected texture capture a set of images of the scene illuminated with the projected texture; determining depth estimates for pixel locations in an image from a reference viewpoint using at least a subset of the set of images. Also, generating a depth estimate for a given pixel location in the image from the reference viewpoint includes: identifying pixels in the at least a subset of the set of images that correspond to the given pixel location in the image from the reference viewpoint based upon expected disparity at a plurality of depths along a plurality of epipolar lines aligned at different angles; comparing the similarity of the corresponding pixels identified at each of the plurality of depths; and selecting the depth from the plurality of depths at which the identified corresponding pixels have the highest degree of similarity as a depth estimate for the given pixel location in the image from the reference viewpoint.
-
24.
公开(公告)号:US10694114B2
公开(公告)日:2020-06-23
申请号:US16529522
申请日:2019-08-01
Applicant: FotoNation Limited
Inventor: Kartik Venkataraman , Amandeep S. Jabbi , Robert H. Mullis , Jacques Duparre , Shane Ching-Feng Hu
IPC: H04N5/225 , H04N13/239 , H04N5/247 , G02B13/00 , G02B5/20 , H04N5/365 , H04N13/128 , H04N5/232 , H04N5/33 , H04N5/341 , H04N5/349 , H04N5/355 , H04N5/357 , H04N9/04 , G06T7/557 , G06T7/50 , H04N9/097 , G06T19/20 , H04N9/09 , H04N9/73 , H04N5/262 , H04N5/265 , G06T11/60 , G02B3/00 , H04N13/257 , H04N13/00
Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.
-
公开(公告)号:US20200151894A1
公开(公告)日:2020-05-14
申请号:US16685881
申请日:2019-11-15
Applicant: FotoNation Limited
Inventor: Ankit Jain , Priyam Chatterjee , Kartik Venkataraman
Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.
-
26.
公开(公告)号:US20200026948A1
公开(公告)日:2020-01-23
申请号:US16586827
申请日:2019-09-27
Applicant: FotoNation Limited
Inventor: Kartik Venkataraman , Semyon Nisenzon , Dan Lelescu
IPC: G06K9/36 , H04N13/128 , H04N13/161 , H04N13/243 , H04N13/271 , G06T7/50 , G06T9/00 , G06T9/20 , H04N19/597 , H04N19/625 , H04N19/136 , G06T3/40 , H04N19/85 , G06T15/08 , G06T7/593
Abstract: Systems and methods in accordance with embodiments of the invention are configured to render images using light field image files containing an image synthesized from light field image data and metadata describing the image that includes a depth map. One embodiment of the invention includes a processor and memory containing a rendering application and a light field image file including an encoded image, a set of low resolution images, and metadata describing the encoded image, where the metadata comprises a depth map that specifies depths from the reference viewpoint for pixels in the encoded image. In addition, the rendering application configures the processor to: locate the encoded image within the light field image file; decode the encoded image; locate the metadata within the light field image file; and post process the decoded image by modifying the pixels based on the depths indicated within the depth map and the set of low resolution images to create a rendered image.
-
公开(公告)号:US10482618B2
公开(公告)日:2019-11-19
申请号:US15682295
申请日:2017-08-21
Applicant: FotoNation Limited
Inventor: Ankit Jain , Priyam Chatterjee , Kartik Venkataraman
Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.
-
公开(公告)号:US10311649B2
公开(公告)日:2019-06-04
申请号:US15694700
申请日:2017-09-01
Applicant: FotoNation Limited
Inventor: Andrew Kenneth John McMahon , Kartik Venkataraman , Robert Mullis
IPC: G06T19/20 , G06F3/041 , G06F3/01 , G06F3/0488 , G06T19/00
Abstract: Systems and methods for the manipulation of captured light fields and captured light field image data in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a system for manipulating captured light field image data includes a processor, a display, a user input device, and a memory, wherein a depth map includes depth information for one or more pixels in the image data, and wherein an image manipulation application configures the processor to display a first synthesized image, receive user input data identifying a region within the first synthesized image, determine boundary data for the identified region using the depth map, receive user input data identifying at least one action, and perform the received action using the boundary data and the captured light field image data.
-
公开(公告)号:US10182216B2
公开(公告)日:2019-01-15
申请号:US15287626
申请日:2016-10-06
Applicant: FotoNation Limited
Inventor: Robert H. Mullis , Dan Lelescu , Kartik Venkataraman
Abstract: Systems and methods for extended color processing on Pelican array cameras in accordance with embodiments of the invention are disclosed. In one embodiment, a method of generating a high resolution image includes obtaining input images, where a first set of images includes information in a first band of visible wavelengths and a second set of images includes information in a second band of visible wavelengths and non-visible wavelengths, determining an initial estimate by combining the first set of images into a first fused image, combining the second set of images into a second fused image, spatially registering the fused images, denoising the fused images using bilateral filters, normalizing the second fused image in the photometric reference space of the first fused image, combining the fused images, determining a high resolution image that when mapped through a forward imaging transformation matches the input images within at least one predetermined criterion.
-
30.
公开(公告)号:US10142560B2
公开(公告)日:2018-11-27
申请号:US15687882
申请日:2017-08-28
Applicant: FotoNation Limited
Inventor: Kartik Venkataraman , Amandeep S. Jabbi , Robert H. Mullis , Jacques Duparre , Shane Ching-Feng Hu
IPC: H04N5/262 , H04N5/225 , H04N5/247 , G02B13/00 , G02B5/20 , H04N5/365 , H04N13/128 , H04N5/232 , H04N5/33 , H04N5/341 , H04N5/355 , H04N5/357 , H04N9/04 , H04N9/097 , G06T19/20 , H04N9/09 , H04N9/73 , H04N5/265 , G06T11/60 , G02B3/00 , G06T7/557 , H04N5/349 , H04N13/257 , H04N13/00
Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.
-
-
-
-
-
-
-
-
-