Invention Grant
- Patent Title: A/B testing sample ratio mismatch solver
-
Application No.: US17077812Application Date: 2020-10-22
-
Publication No.: US11544178B2Publication Date: 2023-01-03
- Inventor: Michael Lindon
- Applicant: Optimizely, Inc.
- Applicant Address: US CA San Francisco
- Assignee: Optimizely, Inc.
- Current Assignee: Optimizely, Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Womble Bond Dickinson (US) LLP
- Main IPC: G06F11/36
- IPC: G06F11/36

Abstract:
A method of executing an A/B test includes configuring the A/B test to comprise a first plurality of users in a control group and a second plurality of users in a test group, wherein the first plurality of users and the second plurality of users are to be provided two different versions of a webpage. The method further includes, while the A/B test is executing, determining, by a processing device, that a sample ratio mismatch corresponding to the second plurality of users has occurred, wherein the sample ratio mismatch is determined before the A/B test ends executing. The method further includes, in response to the determining, ending the executing of the A/B test before a previously scheduled end of the A/B test.
Public/Granted literature
- US20220129372A1 A/B TESTING SAMPLE RATIO MISMATCH SOLVER Public/Granted day:2022-04-28
Information query