-
公开(公告)号：US20240303787A1
公开(公告)日：2024-09-12
申请号：US18179855
申请日：2023-03-07
Applicant: Adobe Inc.
Inventor： Yuqian Zhou , Connelly Barnes , Zijun Wei , Zhe Lin , Elya Shechtman , Sohrab Amirghodsi , Xiaoyang Liu
CPC classification number: G06T5/77 , G06T7/11 , G06V20/176 , G06T2207/20021 , G06T2207/30184
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for inpainting a digital image using a hybrid wire removal pipeline. For example, the disclosed systems use a hybrid wire removal pipeline that integrates multiple machine learning models, such as a wire segmentation model, a hole separation model, a mask dilation model, a patch-based inpainting model, and a deep inpainting model. Using the hybrid wire removal pipeline, in some embodiments, the disclosed systems generate a wire segmentation from a digital image depicting one or more wires. The disclosed systems also utilize the hybrid wire removal pipeline to extract or identify portions of the wire segmentation that indicate specific wires or portions of wires. In certain embodiments, the disclosed systems further inpaint pixels of the digital image corresponding to the wires indicated by the wire segmentation mask using the patch-based inpainting model and/or the deep inpainting model.
-
公开(公告)号：US20230141734A1
公开(公告)日：2023-05-11
申请号：US17520249
申请日：2021-11-05
Applicant: Adobe Inc.
Inventor： Yuqian Zhou , Connelly Barnes , Sohrab Amirghodsi , Elya Shechtman
CPC classification number: G06T5/005 , G06T7/11 , G06T11/00 , G06K9/6215 , G06N3/02 , G06T2207/20084
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately generating inpainted digital images utilizing a guided inpainting model guided by both plane panoptic segmentation and plane grouping. For example, the disclosed systems utilize a guided inpainting model to fill holes of missing pixels of a digital image as informed or guided by an appearance guide and a geometric guide. Specifically, the disclosed systems generate an appearance guide utilizing plane panoptic segmentation and generate a geometric guide by grouping plane panoptic segments. In some embodiments, the disclosed systems generate a modified digital image by implementing an inpainting model guided by both the appearance guide (e.g., a plane panoptic segmentation map) and the geometric guide (e.g., a plane grouping map).
-
公开(公告)号：US11538140B2
公开(公告)日：2022-12-27
申请号：US17098055
申请日：2020-11-13
Applicant: ADOBE INC.
Inventor： Yuqian Zhou , Elya Shechtman , Connelly Stuart Barnes , Sohrab Amirghodsi
Abstract: Various disclosed embodiments are directed to inpainting one or more portions of a target image based on merging (or selecting) one or more portions of a warped image with (or from) one or more portions of an inpainting candidate (e.g., via a learning model). This, among other functionality described herein, resolves the inaccuracies of existing image inpainting technologies.
-
公开(公告)号：US20240331214A1
公开(公告)日：2024-10-03
申请号：US18610861
申请日：2024-03-20
Applicant: ADOBE INC.
Inventor： Yuqian Zhou , Elya Shechtman , Zhe Lin , Krishna Kumar Singh , Jingwan Lu , Connelly Stuart Barnes , Sohrab Amirghodsi
IPC: G06T11/00 , G06T3/4046 , G06T5/30
CPC classification number: G06T11/00 , G06T3/4046 , G06T5/30 , G06T2200/24 , G06T2207/20084
Abstract: Systems and methods for image processing (e.g., image extension or image uncropping) using neural networks are described. One or more aspects include obtaining an image (e.g., a source image, a user provided image, etc.) having an initial aspect ratio, and identifying a target aspect ratio (e.g., via user input) that is different from the initial aspect ratio. The image may be positioned in an image frame having the target aspect ratio, where the image frame includes an image region containing the image and one or more extended regions outside the boundaries of the image. An extended image may be generated (e.g., using a generative neural network), where the extended image includes the image in the image region as well as generated image portions in the extended regions and the one or more generated image portions comprise an extension of a scene element depicted in the image.
-
公开(公告)号：US12086965B2
公开(公告)日：2024-09-10
申请号：US17520361
申请日：2021-11-05
Applicant: Adobe Inc.
Inventor： Yunhan Zhao , Connelly Barnes , Yuqian Zhou , Sohrab Amirghodsi , Elya Shechtman
CPC classification number: G06T5/77 , G06T3/18 , G06T3/4046 , G06T5/50 , G06T7/30 , G06T7/50 , G06T7/90 , G06T2207/20084 , G06T2207/20221
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media for accurately restoring missing pixels within a hole region of a target image utilizing multi-image inpainting techniques based on incorporating geometric depth information. For example, in various implementations, the disclosed systems utilize a depth prediction of a source image as well as camera relative pose parameters. Additionally, in some implementations, the disclosed systems jointly optimize the depth rescaling and camera pose parameters before generating the reprojected image to further increase the accuracy of the reprojected image. Further, in various implementations, the disclosed systems utilize the reprojected image in connection with a content-aware fill model to generate a refined composite image that includes the target image having a hole, where the hole is filled in based on the reprojected image of the source image.
-
Patent Agency Ranking
公开(公告)号：US20230145498A1
公开(公告)日：2023-05-11
申请号：US17520361
申请日：2021-11-05
Applicant: Adobe Inc.
Inventor： Yunhan Zhao , Connelly Barnes , Yuqian Zhou , Sohrab Amirghodsi , Elya Shechtman
CPC classification number: G06T5/005 , G06T3/0093 , G06T3/4046 , G06T5/50 , G06T7/30 , G06T7/50 , G06T7/90 , G06T2207/20084 , G06T2207/20221
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media for accurately restoring missing pixels within a hole region of a target image utilizing multi-image inpainting techniques based on incorporating geometric depth information. For example, in various implementations, the disclosed systems utilize a depth prediction of a source image as well as camera relative pose parameters. Additionally, in some implementations, the disclosed systems jointly optimize the depth rescaling and camera pose parameters before generating the reprojected image to further increase the accuracy of the reprojected image. Further, in various implementations, the disclosed systems utilize the reprojected image in connection with a content-aware fill model to generate a refined composite image that includes the target image having a hole, where the hole is filled in based on the reprojected image of the source image.
-
公开(公告)号：US20220156893A1
公开(公告)日：2022-05-19
申请号：US17098055
申请日：2020-11-13
Applicant: ADOBE INC.
Inventor： Yuqian Zhou , Elya Schechtman , Connelly Stuart Barnes , Sohrab Amirghodsi
Abstract: Various disclosed embodiments are directed to inpainting one or more portions of a target image based on merging (or selecting) one or more portions of a warped image with (or from) one or more portions of an inpainting candidate (e.g., via a learning model). This, among other functionality described herein, resolves the inaccuracies of existing image inpainting technologies.
-
公开(公告)号：US20250069203A1
公开(公告)日：2025-02-27
申请号：US18454850
申请日：2023-08-24
Applicant: ADOBE INC.
Inventor： Yuqian Zhou , Krishna Kumar Singh , Benjamin Delarre , Zhe Lin , Jingwan Lu , Taesung Park , Sohrab Amirghodsi , Elya Shechtman
Abstract: A method, non-transitory computer readable medium, apparatus, and system for image generation are described. An embodiment of the present disclosure includes obtaining an input image, an inpainting mask, and a plurality of content preservation values corresponding to different regions of the inpainting mask, and identifying a plurality of mask bands of the inpainting mask based on the plurality of content preservation values. An image generation model generates an output image based on the input image and the inpainting mask. The output image is generated in a plurality of phases. Each of the plurality of phases uses a corresponding mask band of the plurality of mask bands as an input.
-
公开(公告)号：US20240428384A1
公开(公告)日：2024-12-26
申请号：US18212992
申请日：2023-06-22
Applicant: Adobe Inc.
Inventor： Yuqian Zhou , Zhe Lin , Xiaoyang Liu , Sohrab Amirghodsi , Qing Liu , Lingzhi Zhang , Elya Schechtman , Connelly Stuart Barnes
Abstract: Inpainting dispatch techniques for digital images are described. In one or more examples, an inpainting system includes a plurality of inpainting modules. The inpainting modules are configured to employ a variety of different techniques, respectively, as part of performing an inpainting operation. An inpainting dispatch module is also included as part of the inpainting system that is configured to select which of the plurality of inpainting modules are to be used to perform an inpainting operation for one or more regions in a digital image, automatically and without user intervention.
-
公开(公告)号：US20240404013A1
公开(公告)日：2024-12-05
申请号：US18515378
申请日：2023-11-21
Applicant: ADOBE INC.
Inventor： Yuqian Zhou , Krishna Kumar Singh , Zhe Lin , Qing Liu , Zhifei Zhang , Sohrab Amirghodsi , Elya Shechtman , Jingwan Lu
Abstract: Embodiments include systems and methods for generative image filling based on text and a reference image. In one aspect, the system obtains an input image, a reference image, and a text prompt. Then, the system encodes the reference image to obtain an image embedding and encodes the text prompt to obtain a text embedding. Subsequently, a composite image is generated based on the input image, the image embedding, and the text embedding.
-
-
-
-
-
-
-
-
-
Search Results
22
records
(took 0.016 seconds)
