公开(公告)号：US20210263962A1

公开(公告)日：2021-08-26

申请号：US16800415

申请日：2020-02-25

Applicant: Adobe Inc.

Inventor： Walter Wei Tuh Chang ,  Khoi Pham ,  Scott Cohen ,  Zhe Lin ,  Zhihong Ding

IPC: G06F16/532 ,  G06T11/60 ,  G06K9/62 ,  G06F40/279 ,  G06F40/247 ,  G06F40/30 ,  G06F16/583 ,  G06F16/242 ,  G06F16/28 ,  G06F16/538 ,  G06N20/00

Abstract: The present disclosure relates to an object selection system that automatically detects and selects objects in a digital image based on natural language-based inputs. For instance, the object selection system can utilize natural language processing tools to detect objects and their corresponding relationships within natural language object selection queries. For example, the object selection system can determine alternative object terms for unrecognized objects in a natural language object selection query. As another example, the object selection system can determine multiple types of relationships between objects in a natural language object selection query and utilize different object relationship models to select the requested query object.

公开(公告)号：US20210027471A1

公开(公告)日：2021-01-28

申请号：US16518880

申请日：2019-07-22

Applicant: Adobe Inc.

Inventor： Scott Cohen ,  Zhe Lin ,  Mingyang Ling

IPC: G06T7/11 ,  G06T7/90 ,  G06F16/33 ,  G06K9/46 ,  G06K9/62 ,  G10L15/22 ,  G06N3/04

Abstract: The present disclosure relates to an object selection system that accurately detects and automatically selects user-requested objects (e.g., query objects) in a digital image. For example, the object selection system builds and utilizes an object selection pipeline to determine which object detection neural network to utilize to detect a query object based on analyzing the object class of the query object. In addition, the object selection system can add, update, or replace portions of the object selection pipeline to improve overall accuracy and efficiency of automatic object selection within an image.

公开(公告)号：US10657652B2

公开(公告)日：2020-05-19

申请号：US16359880

申请日：2019-03-20

Applicant: ADOBE INC.

Inventor： Brian Lynn Price ,  Stephen Schiller ,  Scott Cohen ,  Ning Xu

IPC: G06T7/194 ,  G06T7/90 ,  G06N3/08 ,  G06T7/11 ,  G06N3/04

Abstract: Methods and systems are provided for generating mattes for input images. A neural network system can be trained where the training includes training a first neural network that generates mattes for input images where the input images are synthetic composite images. Such a neural network system can further be trained where the training includes training a second neural network that generates refined mattes from the mattes produced by the first neural network. Such a trained neural network system can be used to input an image and trimap pair for which the trained system will output a matte. Such a matte can be used to extract an object from the input image. Upon extracting the object, a user can manipulate the object, for example, to composite the object onto a new background.

公开(公告)号：US10290112B2

公开(公告)日：2019-05-14

申请号：US15996833

申请日：2018-06-04

Applicant: ADOBE INC.

Inventor： Xiaohui Shen ,  Scott Cohen ,  Peng Wang ,  Bryan Russell ,  Brian Price ,  Jonathan Eisenmann

IPC: G06T7/50 ,  G06T7/62 ,  G06T7/13

Abstract: Techniques for planar region-guided estimates of 3D geometry of objects depicted in a single 2D image. The techniques estimate regions of an image that are part of planar regions (i.e., flat surfaces) and use those planar region estimates to estimate the 3D geometry of the objects in the image. The planar regions and resulting 3D geometry are estimated using only a single 2D image of the objects. Training data from images of other objects is used to train a CNN with a model that is then used to make planar region estimates using a single 2D image. The planar region estimates, in one example, are based on estimates of planarity (surface plane information) and estimates of edges (depth discontinuities and edges between surface planes) that are estimated using models trained using images of other scenes.

公开(公告)号：US20250069297A1

公开(公告)日：2025-02-27

申请号：US18948839

申请日：2024-11-15

Applicant: Adobe Inc.

Inventor： Zhifei Zhang ,  Zhe Lin ,  Scott Cohen ,  Darshan Prasad ,  Zhihong Ding

IPC: G06T11/40 ,  G06T5/77 ,  G06T7/12

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for transferring global style features between digital images utilizing one or more machine learning models or neural networks. In particular, in one or more embodiments, the disclosed systems receive a request to transfer a global style from a source digital image to a target digital image, identify at least one target object within the target digital image, and transfer the global style from the source digital image to the target digital image while maintaining an object style of the at least one target object.

公开(公告)号：US12093306B2

公开(公告)日：2024-09-17

申请号：US18191651

申请日：2023-03-28

Applicant: Adobe Inc.

Inventor： Scott Cohen ,  Zhe Lin ,  Mingyang Ling

IPC: G06V20/70 ,  G06F16/535 ,  G06F18/2113 ,  G06F18/24 ,  G06V10/20 ,  G06V10/764 ,  G06V10/82 ,  G06V20/10

CPC classification number: G06F16/535 ,  G06F18/2113 ,  G06F18/24 ,  G06V10/255 ,  G06V10/764 ,  G06V10/82 ,  G06V20/10 ,  G06V20/70

Abstract: The present disclosure relates to an object selection system that accurately detects and optionally automatically selects user-requested objects (e.g., query objects) in digital images. For example, the object selection system builds and utilizes an object selection pipeline to determine which object detection neural network to utilize to detect a query object based on analyzing the object class of a query object. In particular, the object selection system can identify both known object classes as well as objects corresponding to unknown object classes.

公开(公告)号：US12020414B2

公开(公告)日：2024-06-25

申请号：US17819845

申请日：2022-08-15

Applicant: Adobe Inc.

Inventor： Scott Cohen ,  Zhe Lin ,  Mingyang Ling

IPC: G06T7/00 ,  G06F16/583 ,  G06F40/205 ,  G06T7/70 ,  G06T7/90 ,  G06T11/60

CPC classification number: G06T7/0002 ,  G06F16/5838 ,  G06F16/5854 ,  G06F40/205 ,  G06T7/70 ,  G06T7/90 ,  G06T11/60 ,  G06T2207/20084 ,  G06T2210/12

Abstract: The present disclosure relates to an object selection system that accurately detects and automatically selects target instances of user-requested objects (e.g., a query object instance) in a digital image. In one or more embodiments, the object selection system can analyze one or more user inputs to determine an optimal object attribute detection model from multiple specialized and generalized object attribute models. Additionally, the object selection system can utilize the selected object attribute model to detect and select one or more target instances of a query object in an image, where the image includes multiple instances of the query object.

公开(公告)号：US20240169628A1

公开(公告)日：2024-05-23

申请号：US18460150

申请日：2023-09-01

Applicant: Adobe Inc.

Inventor： Soo Ye Kim ,  Zhe Lin ,  Scott Cohen ,  Jianming Zhang ,  Luis Figueroa ,  Zhihong Ding

IPC: G06T11/60 ,  G06F3/0481 ,  G06F3/04845 ,  G06F3/0486 ,  G06T5/00 ,  G06T11/00

CPC classification number: G06T11/60 ,  G06F3/0481 ,  G06F3/04845 ,  G06F3/0486 ,  G06T5/002 ,  G06T5/005 ,  G06T11/001 ,  G06T2200/24 ,  G06T2207/20092 ,  G06T2207/20212

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that provides a graphical user interface experience to move objects and generate new shadows within a digital image scene. For instance, in one or more embodiments, the disclosed systems receive a digital image depicting a scene. The disclosed systems receive a selection to position an object in a first location within the scene. Further, the disclosed systems composite an image by placing the object at the first location within the scene of the digital image. Moreover, the disclosed systems generate a modified digital image having a shadow of the object where the shadow is consistent with the scene and provides the modified digital image to the client device.

公开(公告)号：US20240169624A1

公开(公告)日：2024-05-23

申请号：US18058538

申请日：2022-11-23

Applicant: Adobe Inc.

Inventor： Jonathan Brandt ,  Scott Cohen ,  Zhe Lin ,  Zhihong Ding ,  Darshan Prasad ,  Matthew Joss ,  Celso Gomes ,  Jianming Zhang ,  Olena Soroka ,  Klaas Stoeckmann ,  Michael Zimmermann ,  Thomas Muehrke

IPC: G06T11/60 ,  G06F3/04842 ,  G06F3/04845 ,  G06T11/40

CPC classification number: G06T11/60 ,  G06F3/04842 ,  G06F3/04845 ,  G06T11/40

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify digital images via scene-based editing using image understanding facilitated by artificial intelligence. For instance, in one or more embodiments, the disclosed systems generate utilizing a segmentation neural network, an object mask for each object of a plurality of objects of a digital image. The disclosed systems detect a first user interaction with an object in the digital image displayed via a graphical user interface. The disclosed systems surface, via the graphical user interface, the object mask for the object in response to the first user interaction. The disclosed systems perform an object-aware modification of the digital image in response to a second user interaction with the object mask for the object.

公开(公告)号：US20240168617A1

公开(公告)日：2024-05-23

申请号：US18058622

申请日：2022-11-23

Applicant: Adobe Inc.

Inventor： Zhe Lin ,  Scott Cohen ,  Kushal Kafle

IPC: G06F3/04845 ,  G06F3/0482 ,  G06F3/04847 ,  G06F3/04886 ,  G06F40/166 ,  G06V10/26 ,  G06V20/70

CPC classification number: G06F3/04845 ,  G06F3/0482 ,  G06F3/04847 ,  G06F3/04886 ,  G06F40/166 ,  G06V10/26 ,  G06V20/70 ,  G06V10/82

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify digital images via scene-based editing using image understanding facilitated by artificial intelligence. For instance, in one or more embodiments, the disclosed systems detect a selection of an object portrayed in a digital image displayed within a graphical user interface of a client device. The disclosed systems provide, for display within the graphical user interface in response to detecting the selection of the object, an interactive window displaying one or more attributes of the object. The disclosed systems receive, via the interactive window, a user interaction to change an attribute from the one or more attributes. The disclosed systems modify the digital image by changing the attribute of the object in accordance with the user interaction.