-
公开(公告)号：US20230141734A1
公开(公告)日：2023-05-11
申请号：US17520249
申请日：2021-11-05
Applicant: Adobe Inc.
Inventor： Yuqian Zhou , Connelly Barnes , Sohrab Amirghodsi , Elya Shechtman
CPC classification number: G06T5/005 , G06T7/11 , G06T11/00 , G06K9/6215 , G06N3/02 , G06T2207/20084
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately generating inpainted digital images utilizing a guided inpainting model guided by both plane panoptic segmentation and plane grouping. For example, the disclosed systems utilize a guided inpainting model to fill holes of missing pixels of a digital image as informed or guided by an appearance guide and a geometric guide. Specifically, the disclosed systems generate an appearance guide utilizing plane panoptic segmentation and generate a geometric guide by grouping plane panoptic segments. In some embodiments, the disclosed systems generate a modified digital image by implementing an inpainting model guided by both the appearance guide (e.g., a plane panoptic segmentation map) and the geometric guide (e.g., a plane grouping map).
-
公开(公告)号：US20220292341A1
公开(公告)日：2022-09-15
申请号：US17198670
申请日：2021-03-11
Applicant: ADOBE INC.
Inventor： lshit bhadresh Mehta , Michaël Gharbi , Connelly Barnes , Elya Shechtman
Abstract: Systems and methods for signal processing are described. Embodiments receive a digital signal comprising original signal values corresponding to a discrete set of original sample locations, generate modulation parameters based on the digital signal using a modulator network, wherein each of a plurality of modulator layers of the modulator network outputs a set of the modulation parameters, and generate a predicted signal value of the digital signal at an additional location using a synthesizer network, wherein each of a plurality of synthesizer layers of the synthesizer network operates based on the set of the modulation parameters from a corresponding modulator layer of the modulator network.
-
公开(公告)号：US11024060B1
公开(公告)日：2021-06-01
申请号：US16812669
申请日：2020-03-09
Applicant: Adobe Inc.
Inventor： Liqian Ma , Jingwan Lu , Zhe Lin , Connelly Barnes , Alexei A. Efros
Abstract: Techniques are provided for converting a self-portrait image into a neutral-pose portrait image, including receiving a self-portrait input image, which contains at least one person who is the subject of the self-portrait. A nearest pose search selects a target neutral-pose image that closely matches or approximates the pose of the upper torso region of the subject in the self-portrait input image. Coordinate-based inpainting maps pixels from the upper torso region in the self-portrait input image to corresponding regions in the selected target neutral-pose image to produce a coarse result image. A neutral-pose composition refines the coarse result image by synthesizing details in the body region of the subject (which in some cases includes the subject's head, arms, and torso), and inpainting pixels into missing portions of the background. The refined image is composited with the original self-portrait input image to produce a neutral-pose result image.
-
公开(公告)号：US20210056668A1
公开(公告)日：2021-02-25
申请号：US16548498
申请日：2019-08-22
Applicant: Adobe Inc.
Inventor： Connelly Barnes , Sohrab Amirghodsi , Elya Shechtman
Abstract: Techniques are disclosed for filling or otherwise replacing a target region of a primary image with a corresponding region of an auxiliary image. The filling or replacing can be done with an overlay (no subtractive process need be run on the primary image). Because the primary and auxiliary images may not be aligned, both geometric and photometric transformations are applied to the primary and/or auxiliary images. For instance, a geometric transformation of the auxiliary image is performed, to better align features of the auxiliary image with corresponding features of the primary image. Also, a photometric transformation of the auxiliary image is performed, to better match color of one or more pixels of the auxiliary image with color of corresponding one or more pixels of the primary image. The corresponding region of the transformed auxiliary image is then copied and overlaid on the target region of the primary image.
-
公开(公告)号：US12204610B2
公开(公告)日：2025-01-21
申请号：US17650967
申请日：2022-02-14
Applicant: Adobe Inc.
Inventor： Zhe Lin , Haitian Zheng , Jingwan Lu , Scott Cohen , Jianming Zhang , Ning Xu , Elya Shechtman , Connelly Barnes , Sohrab Amirghodsi
IPC: G06K9/00 , G06F18/214 , G06N3/08 , G06T5/77 , G06T7/11
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for training a generative inpainting neural network to accurately generate inpainted digital images via object-aware training and/or masked regularization. For example, the disclosed systems utilize an object-aware training technique to learn parameters for a generative inpainting neural network based on masking individual object instances depicted within sample digital images of a training dataset. In some embodiments, the disclosed systems also (or alternatively) utilize a masked regularization technique as part of training to prevent overfitting by penalizing a discriminator neural network utilizing a regularization term that is based on an object mask. In certain cases, the disclosed systems further generate an inpainted digital image utilizing a trained generative inpainting model with parameters learned via the object-aware training and/or the masked regularization.
-
Patent Agency Ranking
公开(公告)号：US20240362757A1
公开(公告)日：2024-10-31
申请号：US18307546
申请日：2023-04-26
Applicant: Adobe Inc.
Inventor： Sohrab Amirghodsi , Lingzhi Zhang , Connelly Barnes , Elya Shechtman , Yuqian Zhou , Zhe Lin
CPC classification number: G06T5/77 , G06T5/30 , G06T5/50 , G06T7/11 , G06T2207/20076 , G06T2207/20081 , G06T2207/20084
Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for inpainting digital images utilizing mask-robust machine-learning models. In particular, in one or more embodiments, the disclosed systems obtain an initial mask for an object depicted in a digital image. Additionally, in some embodiments, the disclosed systems generate, utilizing a mask-robust inpainting machine-learning model, an inpainted image from the digital image and the initial mask. Moreover, in some implementations, the disclosed systems generate a relaxed mask that expands the initial mask. Furthermore, in some embodiments, the disclosed systems generate a modified image by compositing the inpainted image and the digital image utilizing the relaxed mask.
-
公开(公告)号：US20230360180A1
公开(公告)日：2023-11-09
申请号：US17661985
申请日：2022-05-04
Applicant: Adobe Inc.
Inventor： Haitian Zheng , Zhe Lin , Jingwan Lu , Scott Cohen , Elya Shechtman , Connelly Barnes , Jianming Zhang , Ning Xu , Sohrab Amirghodsi
CPC classification number: G06T5/005 , G06T3/4046 , G06V10/40 , G06T2207/20084
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media that generate inpainted digital images utilizing a cascaded modulation inpainting neural network. For example, the disclosed systems utilize a cascaded modulation inpainting neural network that includes cascaded modulation decoder layers. For example, in one or more decoder layers, the disclosed systems start with global code modulation that captures the global-range image structures followed by an additional modulation that refines the global predictions. Accordingly, in one or more implementations, the image inpainting system provides a mechanism to correct distorted local details. Furthermore, in one or more implementations, the image inpainting system leverages fast Fourier convolutions block within different resolution layers of the encoder architecture to expand the receptive field of the encoder and to allow the network encoder to better capture global structure.
-
公开(公告)号：US11270415B2
公开(公告)日：2022-03-08
申请号：US16548498
申请日：2019-08-22
Applicant: Adobe Inc.
Inventor： Connelly Barnes , Sohrab Amirghodsi , Elya Shechtman
Abstract: Techniques are disclosed for filling or otherwise replacing a target region of a primary image with a corresponding region of an auxiliary image. The filling or replacing can be done with an overlay (no subtractive process need be run on the primary image). Because the primary and auxiliary images may not be aligned, both geometric and photometric transformations are applied to the primary and/or auxiliary images. For instance, a geometric transformation of the auxiliary image is performed, to better align features of the auxiliary image with corresponding features of the primary image. Also, a photometric transformation of the auxiliary image is performed, to better match color of one or more pixels of the auxiliary image with color of corresponding one or more pixels of the primary image. The corresponding region of the transformed auxiliary image is then copied and overlaid on the target region of the primary image.
-
公开(公告)号：US10964084B2
公开(公告)日：2021-03-30
申请号：US16451813
申请日：2019-06-25
Applicant: Adobe Inc.
Inventor： Jingwan Lu , Yi Zhou , Connelly Barnes , Jimei Yang
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating a digital animation of a digital animation character by utilizing a generative adversarial network and a hip motion prediction network. For example, the disclosed systems can utilize an unconditional generative adversarial network to generate a sequence of local poses of a digital animation character based on an input of a random code vector. The disclosed systems can also utilize a conditional generative adversarial network to generate a sequence of local poses based on an input of a set of keyframes. Based on the sequence of local poses, the disclosed systems can utilize a hip motion prediction network to generate a sequence of global poses based on hip velocities. In addition, the disclosed systems can generate an animation of a digital animation character based on the sequence of global poses.
-
公开(公告)号：US20210082124A1
公开(公告)日：2021-03-18
申请号：US17103119
申请日：2020-11-24
Applicant: Adobe Inc.
Inventor： Zhe Lin , Wei Xiong , Connelly Barnes , Jimei Yang , Xin Lu
Abstract: In some embodiments, an image manipulation application receives an incomplete image that includes a hole area lacking image content. The image manipulation application applies a contour detection operation to the incomplete image to detect an incomplete contour of a foreground object in the incomplete image. The hole area prevents the contour detection operation from detecting a completed contour of the foreground object. The image manipulation application further applies a contour completion model to the incomplete contour and the incomplete image to generate the completed contour for the foreground object. Based on the completed contour and the incomplete image, the image manipulation application generates image content for the hole area to generate a completed image.
-
-
-
-
-
-
-
-
-
Search Results
42
records
(took 0.043 seconds)
