- Patent Title: Cache and I/O management for analytics over disaggregated stores
-
Application No.: US16660554Application Date: 2019-10-22
-
Publication No.: US11055225B2Publication Date: 2021-07-06
- Inventor: Virajith Jalaparti , Sriram S. Rao , Christopher W. Douglas , Ashvin Agrawal , Avrilia Floratou , Ishai Menache , Srikanth Kandula , Mainak Ghosh , Joseph Naor
- Applicant: Microsoft Technology Licensing, LLC
- Applicant Address: US WA Redmond
- Assignee: Microsoft Technology Licensing, LLC
- Current Assignee: Microsoft Technology Licensing, LLC
- Current Assignee Address: US WA Redmond
- Agency: Fiala & Weaver P.L.L.C.
- Main IPC: G06F12/0862
- IPC: G06F12/0862 ; H04L29/08 ; G06F12/0868 ; G06F12/0891

Abstract:
Methods, systems, apparatuses, and computer program products are provided for prefetching data. A workload analyzer may identify job characteristics for a plurality of previously executed jobs in a workload executing on a cluster of one or more compute resources. For each job, identified job characteristics may include identification of an input dataset and an input bandwidth characteristic for the input dataset. A future workload predictor may identify future jobs expected to execute on the cluster based at least on the identified job characteristics. A cache assignment determiner may determine a cache assignment that identifies a prefetch dataset for at least one of the future jobs. A network bandwidth allocator may determine a network bandwidth assignment for the prefetch dataset. A plan instructor may instruct a compute resource of the cluster to load data to a cache local to the cluster according to the cache assignment and the network bandwidth assignment.
Public/Granted literature
- US20210096996A1 CACHE AND I/O MANAGEMENT FOR ANALYTICS OVER DISAGGREGATED STORES Public/Granted day:2021-04-01
Information query
IPC分类: