Invention Grant
- Patent Title: Evaluating automatic malware classifiers in the absence of reference labels
-
Application No.: US17238248Application Date: 2021-04-23
-
Publication No.: US11977632B2Publication Date: 2024-05-07
- Inventor: Robert J. Joyce , Edward Raff
- Applicant: Booz Allen Hamilton Inc.
- Applicant Address: US VA McLean
- Assignee: BOOZ ALLEN HAMILTON INC.
- Current Assignee: BOOZ ALLEN HAMILTON INC.
- Current Assignee Address: US VA McLean
- Agency: BUCHANAN INGERSOLL & ROONEY PC
- Main IPC: G06F21/56
- IPC: G06F21/56 ; G06F18/23 ; G06F18/2431

Abstract:
Disclosed are methods and apparatuses for classifier evaluation. The evaluation involves constructing a ground truth refinement having a degree of error within specified bounds from a malware reference dataset as an approximate ground truth refinement. The evaluation further involves using the approximate ground truth refinement to determine at least one of: a lower bound on precision or an upper bound on recall and accuracy. The evaluation further involves evaluating a classifier by evaluating at least one of a classification method or clustering method by examining changes to the upper bound and/or the lower bound produced by the approximate ground truth refinement.
Public/Granted literature
- US20220366043A1 EVALUATING AUTOMATIC MALWARE CLASSIFIERS IN THE ABSENCE OF REFERENCE LABELS Public/Granted day:2022-11-17
Information query