Invention Grant
- Patent Title: Generating performance predictions with uncertainty intervals
-
Application No.: US16842295Application Date: 2020-04-07
-
Publication No.: US11989626B2Publication Date: 2024-05-21
- Inventor: Matthew Richard Arnold , Benjamin Tyler Elder , Jiri Navratil , Ganesh Venkataraman
- Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agency: Patterson + Sheridan, LLP
- Main IPC: G06N20/00
- IPC: G06N20/00 ; G06F11/34 ; G06F17/18 ; G06N20/20

Abstract:
A technique for generating a performance prediction of a machine learning model with uncertainty intervals includes obtaining a first model configured to perform a task and a production dataset. At least one metric predicting a performance of the first model at performing the task on the production dataset is generated using a second model. The second model is a meta-model associated with the first model. At least one value predicting an uncertainty of the at least one metric predicting the performance of the first model at performing the task on the production dataset is generated using a third model. The third model is a meta-meta-model associated with the second model. An indication of the at least one metric and the at least one value is provided.
Public/Granted literature
- US20210312323A1 GENERATING PERFORMANCE PREDICTIONS WITH UNCERTAINTY INTERVALS Public/Granted day:2021-10-07
Information query