Invention Grant
US07941424B2 System, method, and computer-readable medium for dynamic detection and management of data skew in parallel join operations 有权
用于动态检测和管理并行连接操作中数据偏移的系统,方法和计算机可读介质

  • Patent Title: System, method, and computer-readable medium for dynamic detection and management of data skew in parallel join operations
  • Patent Title (中): 用于动态检测和管理并行连接操作中数据偏移的系统,方法和计算机可读介质
  • Application No.: US12130060
    Application Date: 2008-05-30
  • Publication No.: US07941424B2
    Publication Date: 2011-05-10
  • Inventor: Yu XuPekka KostamaaMark Sirek
  • Applicant: Yu XuPekka KostamaaMark Sirek
  • Applicant Address: US OH Dayton
  • Assignee: Teradata US, Inc.
  • Current Assignee: Teradata US, Inc.
  • Current Assignee Address: US OH Dayton
  • Agent Steve McDonald; Michael Chan
  • Main IPC: G06F7/00
  • IPC: G06F7/00 G06F17/30
System, method, and computer-readable medium for dynamic detection and management of data skew in parallel join operations
Abstract:
A system, method, and computer-readable medium for dynamic detection and management of data skew in parallel join operations are provided. Receipt of an excessive number of redistributed rows by a processing module is detected thereby identifying the processing module as a hot processing module. Other processing modules then terminate redistribution of rows to the hot processing module and maintain rows of a skewed table of the join operation that would be redistributed to the hot processing module in a local spool. Rows of a smaller table that would be redistributed to the hot processing module are duplicated to each processing module involved in the join operation. Rows of tables that are to be redistributed by a processing module to any processing module excluding the hot processing module are redistributed accordingly and maintained locally by the processing module. The join operation is completed by merging results of local join data sets of each processing module.
Information query
Patent Agency Ranking
0/0