-
公开(公告)号:US11443193B2
公开(公告)日:2022-09-13
申请号:US16865605
申请日:2020-05-04
Applicant: Adobe Inc.
Inventor: Kai Li , Christopher Alan Tensmeyer , Curtis Michael Wigington , Handong Zhao , Nikolaos Barmpalios , Tong Sun , Varun Manjunatha , Vlad Ion Morariu
IPC: G06K9/00 , G06N3/08 , G06N20/10 , G06K9/62 , G06F17/18 , G06V10/75 , G06V20/20 , G06V30/413 , G06V30/414
Abstract: Adapting a machine learning model to process data that differs from training data used to configure the model for a specified objective is described. A domain adaptation system trains the model to process new domain data that differs from a training data domain by using the model to generate a feature representation for the new domain data, which describes different content types included in the new domain data. The domain adaptation system then generates a probability distribution for each discrete region of the new domain data, which describes a likelihood of the region including different content described by the feature representation. The probability distribution is compared to ground truth information for the new domain data to determine a loss function, which is used to refine model parameters. After determining that model outputs achieve a threshold similarity to the ground truth information, the model is output as a domain-agnostic model.
-
公开(公告)号:US20220100714A1
公开(公告)日:2022-03-31
申请号:US17036453
申请日:2020-09-29
Applicant: ADOBE INC.
Inventor: Handong Zhao , Yikun Xian , Sungchul Kim , Tak Yeon Lee , Nikhil Belsare , Shashi Kant Rai , Vasanthi Holtcamp , Thomas Jacobs , Duy-Trung T. Dinh , Caroline Jiwon Kim
Abstract: Systems and methods for lifelong schema matching are described. The systems and methods include receiving data comprising a plurality of information categories, classifying each information category according to a schema comprising a plurality of classes, wherein the classification is performed by a neural network classifier trained based on a lifelong learning technique using a plurality of exemplar training sets, wherein each of the exemplar training sets includes a plurality of examples corresponding to one of the classes, and wherein the examples are selected based on a metric indicating how well each of the examples represents the corresponding class, and adding the data to a database based on the classification, wherein the database is organized according to the schema.
-
公开(公告)号:US20210264244A1
公开(公告)日:2021-08-26
申请号:US16796681
申请日:2020-02-20
Applicant: Adobe Inc.
Inventor: Yikun Xian , Tak Yeon Lee , Sungchul Kim , Ryan Rossi , Handong Zhao
IPC: G06N3/08 , G06F16/22 , G06F16/901 , G06F16/248 , G06F16/2457 , G06N5/02
Abstract: Systems, methods, and non-transitory computer-readable media are disclosed for generating generate explanatory paths for column annotations determined using a knowledge graph and a deep representation learning model. For instance, the disclosed systems can utilize a knowledge graph to generate an explanatory path for a column label determination from a deep representation learning model. For example, the disclosed systems can identify a column and determine a label for the column using a knowledge graph (e.g., a representation of a knowledge graph) that includes encodings of columns, column features, relational edges, and candidate labels. Then, the disclosed systems can determine a set of candidate paths between the column and the determined label for the column within the knowledge graph. Moreover, the disclosed systems can generate an explanatory path by ranking and selecting paths from the set of candidate paths using a greedy ranking and/or diversified ranking approach.
-
公开(公告)号:US12182713B2
公开(公告)日:2024-12-31
申请号:US16203263
申请日:2018-11-28
Applicant: Adobe Inc.
Inventor: Handong Zhao , Zheng Wen , Sungchul Kim , Sheng Li , Branislav Kveton
Abstract: Systems and techniques for multi-task equidistant embedding are described that process categorical feature data to explore feature interactions. A digital analytics system enforces an equidistant relationship among features within a category while extracting high-order feature interactions by punishing both positive correlations and negative correlations among low-dimensional representations of different features. By enforcing an equidistant embedding, information is retained and accuracy is increased while higher order feature interactions are determined. Further, the digital analytics system shares knowledge among different tasks by connecting a shared network representation common to multiple tasks with exclusive network representations specific to particular tasks.
-
公开(公告)号:US20240427998A1
公开(公告)日:2024-12-26
申请号:US18339694
申请日:2023-06-22
Applicant: Adobe Inc.
Inventor: Haoliang Wang , Tong Yu , Sungchul Kim , Ruiyi Zhang , Paiheng Xu , Junda Wu , Handong Zhao , Ani Nenkova
Abstract: Contextual query generation techniques are described that enable generation of a contextual query for output to a question-answering (QA) model. A content processing system, for instance, configures a language model using in-context learning to generate queries based on semantic contexts of input documents, e.g., based on one or more linguistic cues from text of the input documents. The content processing system receives an input that includes a document having text and a reference query. The content processing system leverages the language model to generate a contextual query based on a semantic context of the text of the document and the reference query. The content processing system then outputs the contextual query and the document to a QA model. Using the QA model, the content processing system generates a response as an answer to the contextual query based on the contextual query and the document.
-
公开(公告)号:US12124439B2
公开(公告)日:2024-10-22
申请号:US17513127
申请日:2021-10-28
Applicant: Adobe Inc.
Inventor: Handong Zhao , Zhe Lin , Zhaowen Wang , Zhankui He , Ajinkya Gorakhnath Kale
IPC: G06F16/245 , G06F16/248 , G06N20/00
CPC classification number: G06F16/245 , G06F16/248 , G06N20/00
Abstract: Digital content search techniques are described that overcome the challenges found in conventional sequence-based techniques through use of a query-aware sequential search. In one example, a search query is received and sequence input data is obtained based on the search query. The sequence input data describes a sequence of digital content and respective search queries. Embedding data is generated based on the sequence input data using an embedding module of a machine-learning model. The embedding module includes a query-aware embedding layer that generates embeddings of the sequence of digital content and respective search queries. A search result is generated referencing at least one item of digital content by processing the embedding data using at least one layer of the machine-learning model.
-
公开(公告)号:US12019671B2
公开(公告)日:2024-06-25
申请号:US17501191
申请日:2021-10-14
Applicant: Adobe Inc.
Inventor: Handong Zhao , Zhankui He , Zhaowen Wang , Ajinkya Gorakhnath Kale , Zhe Lin
IPC: G06F16/43 , G06F16/438 , G06F16/44 , G06N3/045
CPC classification number: G06F16/438 , G06F16/447 , G06N3/045
Abstract: Digital content search techniques are described. In one example, the techniques are incorporated as part of a multi-head self-attention module of a transformer using machine learning. A localized self-attention module, for instance, is incorporated as part of the multi-head self-attention module that applies local constraints to the sequence. This is performable in a variety of ways. In a first instance, a model-based local encoder is used, examples of which include a fixed-depth recurrent neural network (RNN) and a convolutional network. In a second instance, a masking-based local encoder is used, examples of which include use of a fixed window, Gaussian initialization, and an adaptive predictor.
-
公开(公告)号:US20240169410A1
公开(公告)日:2024-05-23
申请号:US17980790
申请日:2022-11-04
Applicant: Adobe Inc.
Inventor: Handong Zhao , Zhankui He , Tong Yu , Fan Du , Sungchul Kim
IPC: G06Q30/06
CPC classification number: G06Q30/0631
Abstract: Techniques for predicting and recommending item bundles in a multi-round conversation to discover a target item bundle that would be accepted by a client. An example method includes receiving an input response in reply to a first item bundle that includes one or more items. A state model is updated to reflect the input response to the first item bundle. A machine-learning (ML) conversation module is applied to the state model to determine an action type as a follow-up to the input response to the first item bundle. Based on selection of a recommendation action as the action type, an ML bundling module is applied to the state model to generate a second item bundle different than the first item bundle. The second item bundle is then recommended.
-
19.
公开(公告)号:US11809822B2
公开(公告)日:2023-11-07
申请号:US16803480
申请日:2020-02-27
Applicant: Adobe Inc.
Inventor: Zhe Lin , Xihui Liu , Quan Tran , Jianming Zhang , Handong Zhao
IPC: G06F16/538 , G06F40/216 , G06F16/583 , G06N3/08 , G06F40/30 , G06F16/56 , G06F16/2457 , G06V30/262 , G06F18/22 , G06F18/213 , G06F18/214 , G06V30/19 , G06V10/75
CPC classification number: G06F40/216 , G06F16/24578 , G06F16/538 , G06F16/56 , G06F16/5854 , G06F18/213 , G06F18/214 , G06F18/22 , G06F40/30 , G06N3/08 , G06V10/75 , G06V30/19147 , G06V30/274
Abstract: Certain embodiments involve a method for generating a search result. The method includes processing devices performing operations including receiving a query having a text input by a joint embedding model trained to generate an image result. Training the joint embedding model includes accessing a set of images and textual information. Training further includes encoding the images into image feature vectors based on spatial features. Further, training includes encoding the textual information into textual feature vectors based on semantic information. Training further includes generating a set of image-text pairs based on matches between image feature vectors and textual feature vectors. Further, training includes generating a visual grounding dataset based on spatial information. Training further includes generating a set of visual-semantic joint embeddings by grounding the image-text pairs with the visual grounding dataset. Additionally, operations include generating an image result for display by the joint embedding model based on the text input.
-
公开(公告)号:US11711581B2
公开(公告)日:2023-07-25
申请号:US17200691
申请日:2021-03-12
Applicant: Adobe Inc.
Inventor: Handong Zhao , Zhankui He , Zhe Lin , Zhaowen Wang , Ajinkya Gorakhnath Kale
IPC: G06Q30/00 , H04N21/466 , G06N3/08 , H04N21/45 , H04N21/4722 , G06Q30/0282 , G06Q30/0601
CPC classification number: H04N21/4666 , G06N3/08 , G06Q30/0282 , G06Q30/0631 , H04N21/4532 , H04N21/4667 , H04N21/4722
Abstract: A multimodal recommendation identification system analyzes data describing a sequence of past content item interactions to generate a recommendation for a content item for a user. An indication of the recommended content item is provided to a website hosting system or recommendation system so that the recommended content item is displayed or otherwise presented to the user. The multimodal recommendation identification system identifies a content item to recommend to the user by generating an encoding that encodes identifiers of the sequence of content items the user has interacted with and generating encodings that encode multimodal information for content items in the sequence of content items the user has interacted with. An aggregated information encoding for a user based on these encodings and a system analyzes the content item sequence encoding and interaction between the content item sequence encoding and the multiple modality encodings to generate the aggregated information encoding.
-
-
-
-
-
-
-
-
-