公开(公告)号：US11829710B2

公开(公告)日：2023-11-28

申请号：US17583818

申请日：2022-01-25

Applicant: Adobe Inc.

Inventor： Oliver Brdiczka ,  Sanat Sharma ,  Jayant Kumar ,  Alexandru Vasile Costin ,  Aliakbar Darabi ,  Kushith Amerasinghe

IPC: G06F40/166 ,  G06F40/106 ,  G06F16/58 ,  G06F40/12 ,  G06F16/38 ,  G06V30/413

CPC classification number: G06F40/166 ,  G06F16/5866 ,  G06F40/106 ,  G06F40/12 ,  G06F16/38 ,  G06V30/413

Abstract: An illustrator system accesses a multi-element document, the multi-element document including a plurality of elements. The illustrator system determines, for each of the plurality of elements, an element-specific topic distribution comprising a ranked list of topics. The illustrator system creates a first aggregated topic distribution from the determined element-specific topic distributions. The illustrator system determines a global intent for the multi-element document, the global intent including one or more terms from the first aggregated topic distribution. The illustrator system queries a database using the global intent to retrieve a substitute element. The illustrator system generates a replacement multi-element document that includes a substitute element in place of an element in the multi-element document The at least one substitute element is different from the element in the displayed multi-element document.

公开(公告)号：US20220398712A1

公开(公告)日：2022-12-15

申请号：US17820649

申请日：2022-08-18

Applicant: Adobe Inc.

Inventor： Sohrab Amirghodsi ,  Aliakbar Darabi ,  Elya Shechtman

IPC: G06T7/00 ,  G06T3/40 ,  G06T9/00 ,  G06V10/75

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating modified digital images by utilizing a patch match algorithm to generate nearest neighbor fields for a second digital image based on a nearest neighbor field associated with a first digital image. For example, the disclosed systems can identify a nearest neighbor field associated with a first digital image of a first resolution. Based on the nearest neighbor field of the first digital image, the disclosed systems can utilize a patch match algorithm to generate a nearest neighbor field for a second digital image of a second resolution larger than the first resolution. The disclosed systems can further generate a modified digital image by filling a target region of the second digital image utilizing the generated nearest neighbor field.

公开(公告)号：US11467857B2

公开(公告)日：2022-10-11

申请号：US17069637

申请日：2020-10-13

Applicant: Adobe Inc.

Inventor： Oliver Brdiczka ,  Robert Alley ,  Kyoung Tak Kim ,  Kevin Gary Smith ,  Aliakbar Darabi

IPC: G06F11/34 ,  G06F9/451 ,  G06T11/00 ,  G06N20/00

Abstract: The present disclosure describes systems, non-transitory computer-readable media, and methods that intelligently sense digital user context across client devices applications utilizing a dynamic sensor graph framework and then utilize a persistent context store to generate flexible digital recommendations across digital applications. In one or more embodiments, the disclosed systems utilize triggers to select and activate one or more sensor graphs. These sensor graphs can include software sensors arranged according to an architecture of dependencies and subject to various constraints. The underlying architecture of dependencies and constraints in each sensor graph allows the disclosed systems to avoid race-conditions in persisting actionable user-context based signals, verify the validity of sensor output through the sensor graph, generate user-context based recommendations across multiple related applications, and accommodate a specific latency/refresh rate of context values.

公开(公告)号：US20220121931A1

公开(公告)日：2022-04-21

申请号：US17384371

申请日：2021-07-23

Applicant: Adobe Inc.

Inventor： Ratheesh Kalarot ,  Wei-An Lin ,  Cameron Smith ,  Zhixin Shu ,  Baldo Faieta ,  Shabnam Ghadar ,  Jingwan Lu ,  Aliakbar Darabi ,  Jun-Yan Zhu ,  Niloy Mitra ,  Richard Zhang ,  Elya Shechtman

IPC: G06N3/08 ,  G06N3/04 ,  G06K9/62

Abstract: Systems and methods train and apply a specialized encoder neural network for fast and accurate projection into the latent space of a Generative Adversarial Network (GAN). The specialized encoder neural network includes an input layer, a feature extraction layer, and a bottleneck layer positioned after the feature extraction layer. The projection process includes providing an input image to the encoder and producing, by the encoder, a latent space representation of the input image. Producing the latent space representation includes extracting a feature vector from the feature extraction layer, providing the feature vector to the bottleneck layer as input, and producing the latent space representation as output. The latent space representation produced by the encoder is provided as input to the GAN, which generates an output image based upon the latent space representation. The encoder is trained using specialized loss functions including a segmentation loss and a mean latent loss.

公开(公告)号：US12189919B2

公开(公告)日：2025-01-07

申请号：US17737452

申请日：2022-05-05

Applicant: Adobe Inc.

Inventor： Oliver Brdiczka ,  Nipun Jindal ,  Kushith Amerasinghe ,  Gabriel Boroghina ,  Dan-Gabriel Ghita ,  Cristian-Catalin Buzoiu ,  Arpit Mathur ,  Aliakbar Darabi ,  Alexandru Vasile Costin

IPC: G06F17/00 ,  G06F3/0482 ,  G06F3/04847 ,  G06F16/532 ,  G06F16/58 ,  G06F16/583

Abstract: An illustrator system accesses a multi-element document including a plurality of elements. The illustrator system selects, from the plurality of elements, a selected element. The illustrator system generates a replacement multi-element document that includes a substitute element in place of the selected element in the multi-element document, wherein the substitute element is different from the selected element. The illustrator system displays, via a user interface with the multi-element document, a preview of the replacement multi-element document providing a view of the replacement multi-element document, wherein the view of the replacement multi-element document is focused to depict the substitute element.

公开(公告)号：US20240135611A1

公开(公告)日：2024-04-25

申请号：US18188671

申请日：2023-03-23

Applicant: ADOBE INC.

Inventor： Alexandru Vasile Costin ,  Oliver Brdiczka ,  Aliakbar Darabi ,  Davis Taylor Brown ,  David Davenport Bourgin

IPC: G06T11/60 ,  G06T3/40 ,  G06T5/50 ,  G06V10/82

CPC classification number: G06T11/60 ,  G06T3/40 ,  G06T5/50 ,  G06V10/82 ,  G06T2207/20081 ,  G06T2207/20221

Abstract: One or more aspects of the method, apparatus, and non-transitory computer readable medium include obtaining an original image, a scene graph describing elements of the original image, and a description of a modification to the original image. The one or more aspects further include updating the scene graph based on the description of the modification. The one or more aspects further include generating a modified image using an image generation neural network based on the updated scene graph, wherein the modified image incorporates content based on the original image and the description of the modification.

公开(公告)号：US20210142463A1

公开(公告)日：2021-05-13

申请号：US16678132

申请日：2019-11-08

Applicant: Adobe Inc.

Inventor： Sohrab Amirghodsi ,  Aliakbar Darabi ,  Elya Shechtman

IPC: G06T7/00 ,  G06T3/40 ,  G06T9/00 ,  G06K9/62

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating modified digital images by utilizing a patch match algorithm to generate nearest neighbor fields for a second digital image based on a nearest neighbor field associated with a first digital image. For example, the disclosed systems can identify a nearest neighbor field associated with a first digital image of a first resolution. Based on the nearest neighbor field of the first digital image, the disclosed systems can utilize a patch match algorithm to generate a nearest neighbor field for a second digital image of a second resolution larger than the first resolution. The disclosed systems can further generate a modified digital image by filling a target region of the second digital image utilizing the generated nearest neighbor field.

公开(公告)号：US20190050961A1

公开(公告)日：2019-02-14

申请号：US16160855

申请日：2018-10-15

Applicant: ADOBE INC.

Inventor： Sohrab Amirghodsi ,  Aliakbar Darabi ,  Elya Shechtman

IPC: G06T3/40 ,  G06T7/73

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media directed at image synthesis utilizing sampling of patch correspondence information between iterations at different scales. A patch synthesis technique can be performed to synthesize a target region at a first image scale based on portions of a source region that are identified by the patch synthesis technique. The image can then be sampled to generate an image at a second image scale. The sampling can include generating patch correspondence information for the image at the second image scale. Invalid patch assignments in the patch correspondence information at the second image scale can then be identified, and valid patches can be assigned to the pixels having invalid patch assignments. Other embodiments may be described and/or claimed.

公开(公告)号：US20240420394A1

公开(公告)日：2024-12-19

申请号：US18334610

申请日：2023-06-14

Applicant: ADOBE INC.

Inventor： Ionut Mironica ,  Marian Lupascu ,  Alexandru Vasile Costin ,  Cristian Catalin Buzoiu ,  Aliakbar Darabi

IPC: G06T11/60 ,  G06T11/00

Abstract: Systems and methods are provided for image editing, and more particularly, for harmonizing background images with text. Embodiments of the present disclosure obtain an image including text and a region overlapping the text. In some aspects, the text includes a first color. Embodiments then select a second color that contrasts with the first color, and generate a modified image including the text and a modified region using a machine learning model that takes the image and the second color as input. The modified image is generated conditionally, so as to include the second color in a region corresponding to the text.

公开(公告)号：US11915133B2

公开(公告)日：2024-02-27

申请号：US17468546

申请日：2021-09-07

Applicant: Adobe Inc.

Inventor： Ratheesh Kalarot ,  Kevin Wampler ,  Jingwan Lu ,  Jakub Fiser ,  Elya Shechtman ,  Aliakbar Darabi ,  Alexandru Vasile Costin

IPC: G06K9/00 ,  G06N3/08 ,  G06F3/04845 ,  G06F3/04847 ,  G06T11/60 ,  G06N20/20 ,  G06T5/00 ,  G06T5/20 ,  G06T3/00 ,  G06T3/40 ,  G06T11/00 ,  G06F18/40 ,  G06F18/211 ,  G06F18/214 ,  G06F18/21 ,  G06N3/045

CPC classification number: G06N3/08 ,  G06F3/04845 ,  G06F3/04847 ,  G06F18/211 ,  G06F18/214 ,  G06F18/2163 ,  G06F18/40 ,  G06N3/045 ,  G06N20/20 ,  G06T3/0006 ,  G06T3/0093 ,  G06T3/40 ,  G06T3/4038 ,  G06T3/4046 ,  G06T5/005 ,  G06T5/20 ,  G06T11/001 ,  G06T11/60 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221 ,  G06T2210/22

Abstract: Systems and methods seamlessly blend edited and unedited regions of an image. A computing system crops an input image around a region to be edited. The system applies an affine transformation to rotate the cropped input image. The system provides the rotated cropped input image as input to a machine learning model to generate a latent space representation of the rotated cropped input image. The system edits the latent space representation and provides the edited latent space representation to a generator neural network to generate a generated edited image. The system applies an inverse affine transformation to rotate the generated edited image and aligns an identified segment of the rotated generated edited image with an identified corresponding segment of the input image to produce an aligned rotated generated edited image. The system blends the aligned rotated generated edited image with the input image to generate an edited output image.