- Patent Title: Evaluation of predictions in the absence of a known ground truth
-
Application No.: US15386608Application Date: 2016-12-21
-
Publication No.: US10915826B2Publication Date: 2021-02-09
- Inventor: Erhan Bilal , Gustavo Stolovitzky
- Applicant: International Business Machines Corporation
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agency: Fleit Intellectual Property Law
- Agent Jon Gibbons
- Main IPC: G06N5/04
- IPC: G06N5/04 ; G06N5/02 ; G06N7/00 ; G05B13/04 ; G06F19/00

Abstract:
Disclosed is a novel system, and method to evaluate a prediction of a possibly unknown outcome out of a plurality of predictions of that outcome. The method begins with accessing a particular prediction of an outcome out of a plurality of predictions of that outcome in which the outcome may be unknown. Next, a subsample of the plurality of predictions of the outcome is accessed. The subsample can possibly include the particular prediction. A consensus prediction of the outcome based on the subsample of the plurality of predictions is determined. A proximity of the particular prediction to the consensus prediction is determined Each prediction is ranked out of the plurality of predictions in an order of a closest in proximity to the consensus prediction to a farthest in proximity to the consensus prediction.
Public/Granted literature
- US20170103331A1 EVALUATION OF PREDICTIONS IN THE ABSENCE OF A KNOWN GROUND TRUTH Public/Granted day:2017-04-13
Information query