Intelligent resource allocation agent for cluster computing
Abstract:
A resource allocation module may be configured to monitor an input queue of a cluster computing framework for a batch of one or more programs for processing. The resource allocation module parses commands in each of the one or more programs to determine an input/output (I/O) complexity parameter and at least one operation complexity parameter corresponding to each program of the one or more program files. The resource allocation module triggers execution of the one or more program files by a cluster computing framework via a network communication, wherein the cluster computing framework is configured based on the I/O complexity parameter and the at least one operation complexity parameter. Based on analysis of feedback from the cluster computing framework, the resource allocation module modifies a calculation for determining the I/O complexity parameter and/or a calculation for determining the operation complexity of the program files.
Public/Granted literature
Information query
Patent Agency Ranking
0/0