Invention Grant
- Patent Title: Automatic exploitation of data parallelism in streaming applications
-
Application No.: US13651004Application Date: 2012-10-12
-
Publication No.: US09176717B2Publication Date: 2015-11-03
- Inventor: Bugra Gedik , Martin J. Hirzel , Scott A. Schneider , Kun-Lung Wu
- Applicant: International Business Machines Corporation
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agency: Cahn & Samuels, LLP
- Main IPC: G06F9/45
- IPC: G06F9/45

Abstract:
An embodiment of the invention provides a method for exploiting stateless and stateful data parallelism in a streaming application, wherein a compiler determines whether an operator of the streaming application is safe to parallelize based on a definition of the operator and an instance of the definition. The operator is not safe to parallelize when the operator has selectivity greater than 1, wherein the selectivity is the number of output tuples generated for each input tuple. Parallel regions are formed within the streaming application with the compiler when the operator is safe to parallelize. Synchronization strategies for the parallel regions are determined with the compiler, wherein the synchronization strategies are determined based on the definition of the operator and the instance of the definition. The synchronization strategies of the parallel regions are enforced with a runtime system.
Public/Granted literature
- US20140068578A1 Automatic Exploitation of Data Parallelism in Streaming Applications Public/Granted day:2014-03-06
Information query