Invention Grant
- Patent Title: Generation and application of correctness-enforced executable filters
-
Application No.: US13324202Application Date: 2011-12-13
-
Publication No.: US09817860B2Publication Date: 2017-11-14
- Inventor: Christos Gkantsidis , Dimitrios Vytiniotis , Orion Hodson , Dushyanth Narayanan , Antony Rowstron
- Applicant: Christos Gkantsidis , Dimitrios Vytiniotis , Orion Hodson , Dushyanth Narayanan , Antony Rowstron
- Applicant Address: US WA Redmond
- Assignee: Microsoft Technology Licensing, LLC
- Current Assignee: Microsoft Technology Licensing, LLC
- Current Assignee Address: US WA Redmond
- Main IPC: G06F9/46
- IPC: G06F9/46 ; G06F9/455 ; G06F17/30 ; G06F9/54

Abstract:
Methods of generating filters automatically from data processing jobs are described. In an embodiment, these filters are automatically generated from a compiled version of the data processing job using static analysis which is applied to a high-level representation of the job. The executable filter is arranged to suppress rows and/or columns within the data to which the job is applied and which do not affect the output of the job. The filters are generated by a filter generator and then stored and applied dynamically at a filtering proxy that may be co-located with the storage node that holds the data. In another embodiment, the filtered data may be cached close to a compute node which runs the job and data may be provided to the compute node from the local cache rather than from the filtering proxy.
Public/Granted literature
- US20130152088A1 Generating Filters Automatically From Data Processing Jobs Public/Granted day:2013-06-13
Information query