Invention Grant
- Patent Title: System, method, and computer program product for processing large data sets by balancing entropy between distributed data segments
-
Application No.: US16157543Application Date: 2018-10-11
-
Publication No.: US10922139B2Publication Date: 2021-02-16
- Inventor: Paul Max Payton
- Applicant: Visa International Service Association
- Applicant Address: US CA San Francisco
- Assignee: Visa International Service Association
- Current Assignee: Visa International Service Association
- Current Assignee Address: US CA San Francisco
- Agency: The Webb Law Firm
- Main IPC: G06F9/50
- IPC: G06F9/50 ; G06F9/46 ; G06F16/27

Abstract:
Systems, methods, and computer program products are provided for load balancing for processing large data sets. The method includes identifying a number of segments and a transaction data set comprising transaction data for a plurality of transactions, the transaction data for each transaction of the plurality of transactions comprising a transaction value, determining an entropy of the transaction data set based on the transaction value of each transaction of the plurality of transactions, segmenting the transaction data set into the number of segments based on the entropy of the transaction data set and balancing respective entropies of each segment of the number of segments, and distributing processing tasks associated with each segment of the number of segments to at least one processor of a plurality of processors to process each transaction in each respective segment.
Information query