Invention Grant
- Patent Title: Method and system for scalable acceleration of data processing pipeline
-
Application No.: US18049363Application Date: 2022-10-25
-
Publication No.: US12050563B2Publication Date: 2024-07-30
- Inventor: Mayank Mishra , Archisman Bhowmick , Rekha Singhal
- Applicant: Tata Consultancy Services Limited
- Applicant Address: IN Mumbai
- Assignee: TATA CONSULTANCY SERVICES LIMITED
- Current Assignee: TATA CONSULTANCY SERVICES LIMITED
- Current Assignee Address: IN Mumbai
- Agency: FINNEGAN, HENDERSON, FARABOW, GARRETT & DUNNER LLP
- Priority: IN 2121058260 2021.12.14
- Main IPC: G06F17/00
- IPC: G06F17/00 ; G06F7/00 ; G06F16/21

Abstract:
The present disclosure provides a scalable acceleration of data processing in Machine Learning pipeline which is unavailable in conventional methods. Initially, the system receives a dataset and a data processing code. A plurality of sample datasets are obtained based on the received dataset using a sampling technique. A plurality of performance parameters corresponding to each of the plurality of sample datasets are obtained based on the data processing code using a profiling technique. A plurality of scalable performance parameters corresponding to each of a plurality of larger datasets are predicted based on the plurality of performance parameters and the data processing code using a curve fitting technique. Simultaneously, a plurality of anti-patterns are located in the data processing code using a pattern matching technique. Finally, an accelerated code is recommended based on the plurality of anti-patterns and the predicted plurality of scalable performance parameters using an accelerated code recommendation technique.
Public/Granted literature
- US20230185778A1 METHOD AND SYSTEM FOR SCALABLE ACCELERATION OF DATA PROCESSING PIPELINE. Public/Granted day:2023-06-15
Information query