-
公开(公告)号:US20210073592A1
公开(公告)日:2021-03-11
申请号:US17074022
申请日:2020-10-19
Applicant: SAS Institute Inc.
Inventor: Joseph Albert Morgan , Ryan Adam Lekivetz , Caleb Bridges King , Bradley Allen Jones
Abstract: A computing system receives a request to validate, according to a validation specification, a response of a system of operation. The validation specification relates to determining deviation from a specified result in response to testing one or more candidate inputs. The initial design space defines design points for the system of operation according to the respective candidate inputs for each factor. The computing system, responsive to the request to validate the response of the system of operation, generates data representing a covering array for design points defined by the initial design space or a subset design space. The computing system generates, based on the data, a test suite for testing the system of operation. The computing system obtains the response of the system of operation and generates an output indicating the deviation from the specified result.
-
公开(公告)号:US10803214B1
公开(公告)日:2020-10-13
申请号:US16719200
申请日:2019-12-18
Applicant: SAS Institute Inc.
Inventor: Bradley Allen Jones , Ryan Adam Lekivetz , Joseph Albert Morgan , Caleb Bridges King
IPC: G06F30/20
Abstract: A computing device receives a request for a design of an experiment. The design comprises test cases with test conditions for testing factors for the experiment. The device receives a value for a parameter of multiple parameters for the design. The multiple parameters indicate a total number of test cases for the design, a total number of factors for the design, and a total number of groups for grouping factors. The device generates a value for each of one or more other parameters of the multiple parameters such that the design is a supersaturated design. The device generates, based on the first value for the first parameter and the value for each of the one or more other parameters, the supersaturated design for the experiment that is a design that distributes each of the factors into one of the groups. The device outputs an indication of the supersaturated design.
-
公开(公告)号:US20200057963A1
公开(公告)日:2020-02-20
申请号:US16663474
申请日:2019-10-25
Applicant: SAS Institute Inc.
Inventor: Ryan Adam Lekivetz , Joseph Albert Morgan , Bradley Allen Jones , Russ Wolfinger
Abstract: A computing device receives factor information indicating multiple factors (e.g., hyperparameters for designing a system comprising a machine learning algorithm). The computing device receives range information indicating initial ranges with a range for each of possible options for the multiple factors. The computing device obtains a space-filling design for the design space. The space-filing design indicates selected design points in the design space. Each of the selected design points represents assigned options assigned to the multiple factors. The assigned options are assigned from the initial ranges. The computing device generates, based on the space-filling design, an initial design suite that provides initial design cases corresponding to one or more of the selected design points. The computing device generates evaluations of the initial design cases. The computing device outputs, based on the evaluations of the initial design cases, an indication of a selected design case.
-
公开(公告)号:US20180060468A1
公开(公告)日:2018-03-01
申请号:US15690815
申请日:2017-08-30
Applicant: SAS Institute Inc.
Inventor: Joseph Albert Morgan , Bradley Allen Jones , Ryan Adam Lekivetz
IPC: G06F17/50
CPC classification number: G06F17/5009 , G06F3/0482 , G06F17/2795 , G06F2217/04 , G06F2217/14 , G06F2217/16 , G06T11/206
Abstract: An apparatus may include a processor caused to: receive indications of selection of experiment designs to compare; receive indications of selection of a set of terms to include in the comparison; for each experiment design, generate a corresponding term correlation graph of a set of term correlation graphs, wherein: the correlation graph comprises horizontal and vertical axes along both of which the set of terms are arranged, at each intersection within the graph, a degree of correlation between terms is indicated with a visual indicator selected from a set of visual indicators, the set of visual indicators is assigned an order that corresponds to a range of degree of correlation, and the range is divided into a set of contiguous sub-ranges, and each visual indicator corresponds to one of the sub-ranges; and present at least two correlation graphs of the set of correlation graphs at adjacent locations on a display.
-
公开(公告)号:US11346751B1
公开(公告)日:2022-05-31
申请号:US17388519
申请日:2021-07-29
Applicant: SAS Institute Inc.
Inventor: Caleb Bridges King , Joseph Albert Morgan , Ryan Adam Lekivetz , Bradley Allen Jones
Abstract: A computing system receives a request for computer-generated likelihood(s) for candidate evaluations of an industrial product set according to a measurement system analysis (MSA). The MSA comprises tests for evaluating, according to a measurement standard, the industrial product set. The request indicates a metric set representing metric(s) each quantifying an estimate of contribution to variation in evaluating the industrial product set according to the MSA. The system generates a design comprising a respective input set for each test of the MSA. The respective input set comprises setting(s) for conducting a test of the MSA. The design is designed to isolate candidate sources for contributing to the variation in evaluating the industrial product set according to the MSA. The system (e.g., prior to the MSA) outputs, based on the metric set and the design, the computer-generated likelihood(s) for the candidate evaluations of the industrial product set according to the MSA.
-
公开(公告)号:US20210326501A1
公开(公告)日:2021-10-21
申请号:US17365083
申请日:2021-07-01
Applicant: SAS Institute Inc.
Inventor: Ryan Adam Lekivetz , Joseph Albert Morgan , Caleb Bridges King , Bradley Allen Jones
Abstract: A computing system receives a request to generate computer-generated data for an experiment. The computer-generated data comprises generated inputs defining setting(s) for a plurality of factors for a design of the experiment. The generated inputs are generated to be representative of a respective design space of different design spaces for the design of the experiment. The system receives first characteristic(s) for specifying generation of the computer-generated data associated with a first design space. The system receives second characteristic(s) for specifying generation of the computer-generated data associated with a second design space. The system, responsive to the request, generates a design suite that comprises the computer-generated data that represents, in a first set of design cases of the design suite, settings constrained by the first design space, and represents, in a second set of design cases of the design suite, settings constrained by the second design space.
-
公开(公告)号:US11087033B1
公开(公告)日:2021-08-10
申请号:US17153731
申请日:2021-01-20
Applicant: SAS Institute Inc.
Inventor: Ryan Adam Lekivetz , Bradley Allen Jones , Joseph Albert Morgan , Caleb Bridges King
IPC: G06F30/12 , G06F17/18 , G06F30/27 , G06F111/20
Abstract: A computing system generates a subset of design cases of candidate design cases. The system indexes, in the subset, data elements. The system generates a design of an experiment by, for each respective data element, determining a status indicating whether the respective data element corresponds to an uncontrolled factor or a controlled factor. When the status indicates the uncontrolled factor, the system determines if substituting a respective set of specified options of a respective candidate design case comprising the respective data element with a different set of specified options of the candidate design cases improves a criterion measure according to a design criterion. When the status indicates the controlled factor, the system determines if changing an assigned option of the respective data element improves the criterion measure. The system updates the criterion measure with an updated criterion measure according to a change of the subset based on generating the design.
-
公开(公告)号:US20200371001A1
公开(公告)日:2020-11-26
申请号:US16985512
申请日:2020-08-05
Applicant: SAS Institute Inc.
Inventor: Ryan Adam Lekivetz , Joseph Albert Morgan , Bradley Allen Jones , Caleb Bridges King
IPC: G01M99/00
Abstract: A computing device receives a request for a design of an experiment. The device generates a data representation of a matrix Y that defines a supersaturated design for the design of the experiment. The generating the data representation is by: generating a data representation of a matrix X according to an obtained design; computing an indication of correlation between effects of factors of a matrix Y; and generating, based on the indication of correlation, the data representation of the matrix Y that is the transposition of the matrix X or is the transposition of a matrix X*. The matrix X* is a first subset of the matrix X such that the transposition of the matrix X* represents a same number of factors as the transposition of the matrix X. The device outputs a setting for each test condition of the supersaturated design for the experiment.
-
公开(公告)号:US20200117580A1
公开(公告)日:2020-04-16
申请号:US16692172
申请日:2019-11-22
Applicant: SAS Institute Inc.
Abstract: A computing device receives data comprising inputs representing a respective option for each of factors in each of test cases. The data comprises a response of the system for each of the test cases. The computing device receives a request requesting an evaluation of the data for generating a model (e.g. a machine learning algorithm) to predict responses based on the factors. The computing device obtains different group identifiers for each of groups for distributing the test cases for the system (e.g., groups of a K-fold cross-validation). The computing device for each of validation(s): generates a data set comprising a respective data element for each of the test cases of the plurality of test cases; and controls assignment of a group identifier of the different group identifiers to each of the respective data elements. The computing device outputs an indication of one or more generated data sets for the validation(s).
-
公开(公告)号:US10535422B2
公开(公告)日:2020-01-14
申请号:US16507769
申请日:2019-07-10
Applicant: SAS Institute Inc.
Inventor: Ryan Adam Lekivetz , Caleb Bridges King , Joseph Albert Morgan , Bradley Allen Jones
Abstract: A computing device obtains a metric N indicating a quantity of a plurality of test cases for an output design of an experiment Each element of a test case of the output design is a test condition for testing one of factors for the experiment. The computing device obtains input indicating a quantity p of an indicated plurality of factors for the output design. The computing device determines whether there are stored instructions for generating an initial screening design for the experiment. The computing device responsive to determining that there are stored instructions, selects, using the stored instructions, the initial screening design for the experiment. The computing device determines whether to modify the initial screening design based on modification criteria comprising a secondary criterion, the metric N, and/or the quantity p. The computing device outputs an indication of the updated screening design for the output design of the experiment.
-
-
-
-
-
-
-
-
-