Invention Grant
- Patent Title: Framework for training machine-learned models on extremely large datasets
-
Application No.: US16657042Application Date: 2019-10-18
-
Publication No.: US11295171B2Publication Date: 2022-04-05
- Inventor: Joonseok Lee , Balakrishnan Varadarajan , Ariel Gordon , Apostol Ivanov Natsev , Seong Jae Hwang
- Applicant: Google LLC
- Applicant Address: US CA Mountain View
- Assignee: Google LLC
- Current Assignee: Google LLC
- Current Assignee Address: US CA Mountain View
- Agency: Dority & Manning, P.A.
- Main IPC: G06K9/62
- IPC: G06K9/62 ; G06N20/00 ; G06K9/00 ; G06K1/00

Abstract:
A MapReduce-based training framework exploits both data parallelism and model parallelism to scale training of complex models. Particular model architectures facilitate and benefit from use of such training framework. As one example, a machine-learned model can include a shared feature extraction portion configured to receive and process a data input to produce an intermediate feature representation and a plurality of prediction heads that are configured to receive and process the intermediate feature representation to respectively produce a plurality of predictions. For example, the data input can be a video and the plurality of predictions can be a plurality of classifications for content of the video (e.g., relative to a plurality of classes).
Public/Granted literature
- US20210117728A1 Framework for Training Machine-Learned Models on Extremely Large Datasets Public/Granted day:2021-04-22
Information query