Invention Grant
US09331943B2 Asynchronous scheduling informed by job characteristics and anticipatory provisioning of data for real-time, parallel processing 有权
异步调度通过作业特性和预期的数据提供来实时,并行处理

Asynchronous scheduling informed by job characteristics and anticipatory provisioning of data for real-time, parallel processing
Abstract:
Systems and methods are disclosed for scheduling jobs processed in a distributed fashion to realize unharnessed efficiencies latent in the characteristics of the jobs and distributed processing technologies. A job store may be communicatively coupled to a job analyzer. The job analyzer may be operable to read information characterizing a job to identify multiple data blocks to be processed during the job at multiple locations in a cluster of nodes. A scheduling module may use information about the multiple data blocks, their storage locations, their status with respect to being provisioned to processing logic, data blocks to be processed by other jobs, data blocks in cache that have been pre-fetched for a prior job, quality-of-services parameters, and/or job characteristics, such as job size, to schedule the job in relation to other jobs.
Information query
Patent Agency Ranking
0/0