INTELLIGENTLY MODIFYING DIGITAL CALENDARS UTILIZING A GRAPH NEURAL NETWORK AND REINFORCEMENT LEARNING

    公开(公告)号:US20220343155A1

    公开(公告)日:2022-10-27

    申请号:US17337998

    申请日:2021-06-03

    Applicant: Adobe Inc.

    Abstract: This disclosure describes methods, non-transitory computer readable storage media, and systems that intelligently generate and modify schedules of task sequences utilizing a graph neural network and/or reinforcement learning model. For example, the disclosed system utilizes a graph neural network to generate performance efficiency scores indicating predicted performances of the sets of tasks. Additionally, the disclosed systems utilizes the performance efficiency scores to rank sets of tasks and then determine a schedule including an ordered sequence of tasks. Furthermore, disclosed system generates modified schedules in response to detecting a modification to the schedule. For example, the disclosed system utilizes a reinforcement learning model to provide recommendations of new tasks or task sequences deviating from the schedule in the event of an interruption. The disclosed system also utilizes the reinforcement learning model to learn from user choices to inform future scheduling of tasks.

    DETERMINING PATTERNS WITHIN A STRING SEQUENCE OF USER ACTIONS

    公开(公告)号:US20220148015A1

    公开(公告)日:2022-05-12

    申请号:US17096255

    申请日:2020-11-12

    Applicant: Adobe Inc.

    Abstract: Techniques are provided for analyzing user actions that have occurred over a time period. The user actions can be, for example, with respect to the user's navigation of content or interaction with an application. Such user data is provided in an action string, which is converted into a highly searchable format. As such, the presence and frequency of particular user actions and patterns of user actions within an action string of a particular user, as well as among multiple action strings of multiple users, are determinable. Subsequences of one or more action strings are identified and both the number of action strings that include a particular subsequence and the frequency that a particular subsequence is present in a given action string are determinable. The conversion involves breaking that string into a sorted list of locations for the actions within that string. Queries can be readily applied against the sorted list.

    SYSTEM AND METHOD FOR RESOURCE SCALING FOR EFFICIENT RESOURCE MANAGEMENT

    公开(公告)号:US20210357255A1

    公开(公告)日:2021-11-18

    申请号:US16867104

    申请日:2020-05-05

    Applicant: ADOBE INC.

    Abstract: A system and method for automatically adjusting computing resources provisioned for a computer service or application by applying historical resource usage data to a predictive model to generate predictive resource usage. The predictive resource usage is then simulated for various service configurations, determining scaling requirements and resource wastage for each configuration. A cost value is generated based on the scaling requirement and resource wastage, with the cost value for each service configuration used to automatically select a configuration to apply to the service. Alternatively, the method for automatically adjusting computer resources provisioned for a service may include receiving resource usage data of the service, applying it to a linear quadratic regulator (LQR) to find an optimal stationary policy (treating the resource usage data as states and resource-provisioning variables as actions), and providing instructions for configuring the service based on the optimal stationary policy.

    UTILIZING RELEVANT OFFLINE MODELS TO WARM START AN ONLINE BANDIT LEARNER MODEL

    公开(公告)号:US20210097350A1

    公开(公告)日:2021-04-01

    申请号:US16584082

    申请日:2019-09-26

    Applicant: Adobe Inc.

    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing offline models to warm start online bandit learner models. For example, the disclosed system can determine relevant offline models for an environment based on reward estimate differences between the offline models and the online model. The disclosed system can then utilize the relevant offline models (if any) to select an arm for the environment. The disclosed system can update the online model based on observed rewards for the selected arm. Additionally, the disclosed system can also use entropy reduction of arms to determine the utility of the arms in differentiating relevant and irrelevant offline models. For example, the disclosed system can select an arm based on a combination of the entropy reduction of the arm and the reward estimate for the arm and use the observed reward to update an observation history.

    Determining patterns within a string sequence of user actions

    公开(公告)号:US11978067B2

    公开(公告)日:2024-05-07

    申请号:US17096255

    申请日:2020-11-12

    Applicant: Adobe Inc.

    CPC classification number: G06Q30/0201 G06F7/08 G06Q10/10 G06F3/14

    Abstract: Techniques are provided for analyzing user actions that have occurred over a time period. The user actions can be, for example, with respect to the user's navigation of content or interaction with an application. Such user data is provided in an action string, which is converted into a highly searchable format. As such, the presence and frequency of particular user actions and patterns of user actions within an action string of a particular user, as well as among multiple action strings of multiple users, are determinable. Subsequences of one or more action strings are identified and both the number of action strings that include a particular subsequence and the frequency that a particular subsequence is present in a given action string are determinable. The conversion involves breaking that string into a sorted list of locations for the actions within that string. Queries can be readily applied against the sorted list.

    WARM STARTING AN ONLINE BANDIT LEARNER MODEL UTILIZING RELEVANT OFFLINE MODELS

    公开(公告)号:US20230259829A1

    公开(公告)日:2023-08-17

    申请号:US18306449

    申请日:2023-04-25

    Applicant: Adobe Inc.

    CPC classification number: G06N20/00 G06N5/04 G06F18/2193

    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing offline models to warm start online bandit learner models. For example, the disclosed system can determine relevant offline models for an environment based on reward estimate differences between the offline models and the online model. The disclosed system can then utilize the relevant offline models (if any) to select an arm for the environment. The disclosed system can update the online model based on observed rewards for the selected arm. Additionally, the disclosed system can also use entropy reduction of arms to determine the utility of the arms in differentiating relevant and irrelevant offline models. For example, the disclosed system can select an arm based on a combination of the entropy reduction of the arm and the reward estimate for the arm and use the observed reward to update an observation history.

    Utilizing relevant offline models to warm start an online bandit learner model

    公开(公告)号:US11669768B2

    公开(公告)日:2023-06-06

    申请号:US16584082

    申请日:2019-09-26

    Applicant: Adobe Inc.

    CPC classification number: G06F18/2193 G06N5/04 G06N20/00

    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing offline models to warm start online bandit learner models. For example, the disclosed system can determine relevant offline models for an environment based on reward estimate differences between the offline models and the online model. The disclosed system can then utilize the relevant offline models (if any) to select an arm for the environment. The disclosed system can update the online model based on observed rewards for the selected arm. Additionally, the disclosed system can also use entropy reduction of arms to determine the utility of the arms in differentiating relevant and irrelevant offline models. For example, the disclosed system can select an arm based on a combination of the entropy reduction of the arm and the reward estimate for the arm and use the observed reward to update an observation history.

    Detecting cognitive biases in interactions with analytics data

    公开(公告)号:US11669755B2

    公开(公告)日:2023-06-06

    申请号:US16921202

    申请日:2020-07-06

    Applicant: Adobe Inc.

    CPC classification number: G06N5/04 G06F9/451 G06N20/00

    Abstract: The present disclosure relates to methods, systems, and non-transitory computer-readable media for determining a cognitive, action-selection bias of a user that influences how the user will select a sequence of digital actions for execution of a task. For example, the disclosed systems can identify, from a digital behavior log of a user, a set of digital action sequences that correspond to a set of sessions for a task previously executed by the user. The disclosed systems can utilize a machine learning model to analyze the set of sessions to generate session weights. The session weights can correspond to an action-selection bias that indicates an extent to which a future session for the task executed by the user is predicted to be influenced by the set of sessions. The disclosed systems can provide a visual indication of the action-selection bias of the user for display on a graphical user interface.

Patent Agency Ranking