Invention Grant
- Patent Title: Inference model optimization
-
Application No.: US17122774Application Date: 2020-12-15
-
Publication No.: US12008487B2Publication Date: 2024-06-11
- Inventor: Li Cao , Ze Ming Zhao , Hong Min , Jing Yan Ma
- Applicant: International Business Machines Corporation
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agent Gilbert Harmon, Jr.
- Main IPC: G06F3/048
- IPC: G06F3/048 ; G06F16/54 ; G06N5/048 ; G06F3/01

Abstract:
An approach to optimize performance for large scale inference models. Data in the form of images is received from sensors such as cameras. The data is processed to generate data tags associated with the context of the image and portion the images. Model tags are generated based on data characteristics or user input. The tags and their associated data are added to a time-based queue for delivery to the appropriate inference models. Based on the embedded delivery time and frequency, the portioned images are delivered to the appropriate inference models.
Public/Granted literature
- US20220188676A1 INFERENCE MODEL OPTIMIZATION Public/Granted day:2022-06-16
Information query