Invention Grant
- Patent Title: Identification of sample data items for re-judging
- Patent Title (中): 识别重新评估的样本数据项
-
Application No.: US12484256Application Date: 2009-06-15
-
Publication No.: US08935258B2Publication Date: 2015-01-13
- Inventor: Krysta M. Svore , Elbio Renato Torres Abib , Christopher J. C. Burges , Bhuvan Middha
- Applicant: Krysta M. Svore , Elbio Renato Torres Abib , Christopher J. C. Burges , Bhuvan Middha
- Applicant Address: US WA Redmond
- Assignee: Microsoft Corporation
- Current Assignee: Microsoft Corporation
- Current Assignee Address: US WA Redmond
- Agent Sula Miia; Doug Barker; Micky Minhas
- Main IPC: G06F17/30
- IPC: G06F17/30 ; G06K9/62

Abstract:
Described is a technology for identifying sample data items (e.g., documents corresponding to query-URL pairs) having the greatest likelihood of being mislabeled when previously judged, and selecting those data items for re-judging. In one aspect, lambda gradient scores (information associated with ranked sample data items that indicates a relative direction and how “strongly” to move each data item for lowering a ranking cost) are summed for pairs of sample data items to compute re-judgment scores for each of those sample data items. The re-judgment scores indicate a relative likelihood of mislabeling. Once the selected sample data items are re-judged, a new training set is available, whereby a new ranker may be trained.
Public/Granted literature
- US20100318540A1 IDENTIFICATION OF SAMPLE DATA ITEMS FOR RE-JUDGING Public/Granted day:2010-12-16
Information query