Invention Grant
- Patent Title: Framework for processing machine learning model metrics
-
Application No.: US16805656Application Date: 2020-02-28
-
Publication No.: US11605012B2Publication Date: 2023-03-14
- Inventor: Qingbo Hu , Sumanth Venkatasubbaiah , Caio Vinicius Soares
- Applicant: Intuit Inc.
- Applicant Address: US CA Mountain View
- Assignee: Intuit Inc.
- Current Assignee: Intuit Inc.
- Current Assignee Address: US CA Mountain View
- Agency: Ferguson Braswell Fraser Kubasta PC
- Main IPC: G06N5/04
- IPC: G06N5/04 ; G06N20/00 ; G06F11/30 ; G06F9/54 ; G06N20/20

Abstract:
A method including extracting, from an input, supported data. The input includes outputs from machine learning models in different formats. The supported data includes a subset of the input after data normalization. The method also includes inferring, from the supported data, data types to be used with respect to generating metrics for the machine learning models. The method also includes generating, from the supported data and using the data types, a relational event including the supported data. The relational event further includes a first data structure object including the types and having a first data structure different than the different formats. The method also includes calculating, using the supported data in the first data structure, the metrics for the machine learning models. The method also includes generating, from the relational event, a monitoring event. The monitoring event includes a second data structure object segmented into data buckets storing the metrics.
Public/Granted literature
- US20210271986A1 FRAMEWORK FOR PROCESSING MACHINE LEARNING MODEL METRICS Public/Granted day:2021-09-02
Information query