Using a genetic algorithm to identify a balanced assignment of online system users to a control group and a test group for performing a test

    公开(公告)号:US11978087B2

    公开(公告)日:2024-05-07

    申请号:US17897049

    申请日:2022-08-26

    Applicant: Maplebear Inc.

    CPC classification number: G06Q30/0243 G06N3/126

    Abstract: An online system generates a set of genomic representations, each including multiple genes, in which each gene represents users assigned to a control or test group for performing a test. A metric is identified based on a treatment associated with the test group and a score for each representation is computed based on a difference between two values, in which each value is based on the metric associated with users assigned to the test or control group. A propagation process is executed by identifying representations having at least a threshold score, propagating genes included in the representations to an additional set of representations through recombination and/or mutation, and computing the score for each additional representation. The propagation process is repeated for each additional set of representations until stopping criteria are met and a representation is selected based on scores associated with one or more representations.

    SIMULATED TRAINING DATA GENERATION FOR A MULTI-ARMED BANDIT MODEL

    公开(公告)号:US20240290501A1

    公开(公告)日:2024-08-29

    申请号:US18175723

    申请日:2023-02-28

    CPC classification number: G16H50/50 G06N3/08

    Abstract: An online system adjusts a guardrail setting used by a user treatment engine based on conditions faced by the online system. The online system simulates the performance of the user treatment engine using different candidate guardrail settings and computes a score for each of the guardrail settings based on the performance of the user treatment engine using each of the guardrail settings. The online system selects a new guardrail setting for the user treatment engine based on the performance scores for the candidate guardrail settings. Furthermore, the online system generates simulated training examples to initially train a user treatment engine. The online system uses a treatment performance model to simulate the effect of treatments applied to users and generates simulated training examples based on the predicted effect of the treatments. The online system retrains the user treatment engine on real training examples that are generated based on actual treatments.

    DYNAMIC GUARDRAIL ADJUSTMENTS FOR A MULTI-ARMED BANDIT MODEL

    公开(公告)号:US20240289853A1

    公开(公告)日:2024-08-29

    申请号:US18175720

    申请日:2023-02-28

    CPC classification number: G06Q30/0601 G06Q30/0202

    Abstract: An online system adjusts a guardrail setting used by a user treatment engine based on conditions faced by the online system. The online system simulates the performance of the user treatment engine using different candidate guardrail settings and computes a score for each of the guardrail settings based on the performance of the user treatment engine using each of the guardrail settings. The online system selects a new guardrail setting for the user treatment engine based on the performance scores for the candidate guardrail settings. Furthermore, the online system generates simulated training examples to initially train a user treatment engine. The online system uses a treatment performance model to simulate the effect of treatments applied to users and generates simulated training examples based on the predicted effect of the treatments. The online system retrains the user treatment engine on real training examples that are generated based on actual treatments.

    MACHINE LEARNING MODEL FOR DYNAMICALLY BOOSTING ORDER DELIVERY TIME

    公开(公告)号:US20240249238A1

    公开(公告)日:2024-07-25

    申请号:US18158368

    申请日:2023-01-23

    CPC classification number: G06Q10/087 G06N5/022

    Abstract: A method or a system for using machine learning to dynamically boost order delivery time. The system receives an order associated with a delivery time and a compensation value. The system applies a machine-learning model to an order to predict an amount of lateness time that an order will be fulfilled late. The system then determines a lateness value based in part on the predicted amount of lateness time. The lateness value indicates a penalty caused by the predicted amount of lateness time. For each of a plurality of proposed boost amounts for the compensation value, the system determines an uplift, indicating a reduction of the lateness value caused by the boost amount. The system then selects a boost amount from the plurality of boost amounts based in part on the determined uplifts, causing the order to be accepted sooner to thereby boost order delivery time.

    USING A GENETIC ALGORITHM TO IDENTIFY A BALANCED ASSIGNMENT OF ONLINE SYSTEM USERS TO A CONTROL GROUP AND A TEST GROUP FOR PERFORMING A TEST

    公开(公告)号:US20240070715A1

    公开(公告)日:2024-02-29

    申请号:US17897049

    申请日:2022-08-26

    CPC classification number: G06Q30/0243 G06N3/126

    Abstract: An online system generates a set of genomic representations, each including multiple genes, in which each gene represents users assigned to a control or test group for performing a test. A metric is identified based on a treatment associated with the test group and a score for each representation is computed based on a difference between two values, in which each value is based on the metric associated with users assigned to the test or control group. A propagation process is executed by identifying representations having at least a threshold score, propagating genes included in the representations to an additional set of representations through recombination and/or mutation, and computing the score for each additional representation. The propagation process is repeated for each additional set of representations until stopping criteria are met and a representation is selected based on scores associated with one or more representations.

Patent Agency Ranking