Invention Grant
- Patent Title: Optimizing skewed joins in big data
-
Application No.: US14757748Application Date: 2015-12-23
-
Publication No.: US10585889B2Publication Date: 2020-03-10
- Inventor: Soila P. Kavulya , Michael R. Alton , Abolfazl Shahbazi , Todd Lisonbee
- Applicant: INTEL CORPORATION
- Applicant Address: US CA Santa Clara
- Assignee: Intel Corporation
- Current Assignee: Intel Corporation
- Current Assignee Address: US CA Santa Clara
- Agency: International IP Law Group, P.L.L.C.
- Main IPC: G06F16/2453
- IPC: G06F16/2453 ; G06F16/2455

Abstract:
An apparatus for optimizing a skewed join is described herein. The apparatus includes logic, at least partially including hardware logic, to determine that a dataset for the skewed join comprises a skewed key that does not fit in memory. The apparatus also includes logic to model the skewed join as a queue. The apparatus also includes logic to estimate a cost of the skewed join based on the modeled queue. The apparatus evaluates different join techniques, and partitioning strategies for the skewed join, and chooses the plan with the lowest cost.
Public/Granted literature
- US20170185648A1 Optimizing skewed joins in big data Public/Granted day:2017-06-29
Information query