Invention Grant
- Patent Title: Model comparison with unknown metric importance
-
Application No.: US16816344Application Date: 2020-03-12
-
Publication No.: US11237942B2Publication Date: 2022-02-01
- Inventor: Lukasz G. Cmielowski , Wojciech Sobala , Rafal Bigaj , Maksymilian Erazmus
- Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Applicant Address: US NY Armonk
- Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Current Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Current Assignee Address: US NY Armonk
- Agency: Roberts Calderon Safran & Cole, P.C.
- Agent Robert Shatto; Andrew D. Wright
- Main IPC: G06F11/36
- IPC: G06F11/36 ; G06N5/04 ; G06N20/00

Abstract:
A method includes generating first metric data by executing a test suite on a first version of a software model; generating second metric data by executing the test suite on a second version of the software model; generating first and second version principal components that represent the first and second metric data by executing a dimension reduction technique on the first and second metric data; determining at least one control limit based on at least one of the first version principal components; determining a mean value of one of the second version principal components; determining whether the second version of the software model performs within at least one control limit by comparing the mean value to the at least one control limit; and notifying a user of the results of the determining whether the second version of the software model performs within the at least one control limit.
Public/Granted literature
- US20210286703A1 MODEL COMPARISON WITH UNKNOWN METRIC IMPORTANCE Public/Granted day:2021-09-16
Information query