APPARATUS AND METHOD FOR GENERATING NEW VIEWPOINT IMAGE USING FEW-SHOT 2D IMAGES

    公开(公告)号:US20250157137A1

    公开(公告)日:2025-05-15

    申请号:US18393004

    申请日:2023-12-21

    Abstract: The present disclosure relates to an apparatus and a method for generating an image, which may generate a new viewpoint image using few-shot 2D images and is characterized by extracting and learning albedo representing intrinsic color information from the few-show 2D input images, intrinsically decomposing a color value synthesized in the form of patch from a new viewpoint using the few-shot 2D input images and extracting patch-wise albedo during learning, perform geometric alignment necessary for pixel correspondence between a new viewpoint image and a selected 2D input image using a depth value synthesized in the form of patch from the new viewpoint, and generating the new viewpoint image by calculating an albedo consistency loss between the patch-wise albedo.

    APPARATUS AND METHOD FOR SYNTHESIZING 2D IMAGE AND MEDIA USING INVERSE RENDERING WITH 3D SPATIALLY VARYING LIGHTING INFORMATION ESTIMATION

    公开(公告)号:US20250157131A1

    公开(公告)日:2025-05-15

    申请号:US18393078

    申请日:2023-12-21

    Abstract: The present disclosure relates to an apparatus for synthesizing a 2D image and media using a reverse rendering including 3D spatially varying lighting information estimation, and the apparatus includes a target view analysis unit configured to estimate a normal map and direct lighting using a plurality of 2D images, a material estimation unit configured to reflect the normal map and direct lighting estimated from the target view analysis unit and estimate material information, a 3D lighting estimation unit configured to reflect the direct lighting estimated from the target view analysis unit and the material information estimated from the material estimation unit and estimate 3D spatially varying lighting information, and an image generation unit configured to reflect the estimated shapes, materials, and 3D spatially varying lighting information, synthesize the 2D images with 3D objects, and generate a synthesized image.

Patent Agency Ranking