公开(公告)号：US11169788B2

公开(公告)日：2021-11-09

申请号：US17225023

申请日：2021-04-07

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Ronald Earl Stogner ,  Eric Jian Yang ,  Qing Gong ,  Partha Dutta ,  Kais Arfaoui

IPC: G06F9/46 ,  G06F8/51 ,  G06N3/08 ,  G06F16/901 ,  G06F16/903 ,  H04L29/08

Abstract: An apparatus includes a processor to: use an identifier of a requesting device or operator thereof to identify federated area(s) to which access is authorized; based on data dependencies among a set of tasks of a job flow, derive an order of performance specifying the first task to be performed; store, within a task queue, a task routine execution request message including an identifier associated with the first task, and federated area identifier(s) of the identified federated area(s); within a resolver container, in response to storage of the task routine execution request message, use the identifier associated with the first task and identifier(s) of the federated area(s) to identify one in which a first task routine is stored; within a task container, execute the first task routine to perform the first task; and upon completion of the job flow, transmit an indication of completion to the requesting device.

公开(公告)号：US11086608B2

公开(公告)日：2021-08-10

申请号：US17139503

申请日：2020-12-31

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Ronald Earl Stogner ,  Eric Jian Yang ,  Qing Gong

IPC: G06F9/46 ,  G06F8/51 ,  G06N3/08 ,  G06F16/901 ,  G06F16/903 ,  H04L29/08

Abstract: An apparatus includes at least one processor to: within a kill container, execute a kill routine to monitor a task kill queue for storage of an execution status message indicating a level of a parameter of execution of a task routine to perform a task of a job flow, and in response to the level exceeding a threshold, store, within the task kill queue, a kill tasks request message; within a task container, in response to the kill tasks request message, cease execution of the task routine, and store, within a task queue, a task cancelation message; within a performance container, execute instructions of a performance routine to, in response to the task cancelation message, store, within a job queue, a job cancelation message; and in response to the job cancelation message, transmit an indication of cancelation of the job flow to a requesting device.

公开(公告)号：US20210141622A1

公开(公告)日：2021-05-13

申请号：US17139503

申请日：2020-12-31

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Ronald Earl Stogner ,  Eric Jian Yang ,  Qing Gong

IPC: G06F8/51 ,  G06N3/08 ,  G06F9/46 ,  G06F16/901 ,  G06F16/903

Abstract: An apparatus includes at least one processor to: within a kill container, execute a kill routine to monitor a task kill queue for storage of an execution status message indicating a level of a parameter of execution of a task routine to perform a task of a job flow, and in response to the level exceeding a threshold, store, within the task kill queue, a kill tasks request message; within a task container, in response to the kill tasks request message, cease execution of the task routine, and store, within a task queue, a task cancelation message; within a performance container, execute instructions of a performance routine to, in response to the task cancelation message, store, within a job queue, a job cancelation message; and in response to the job cancelation message, transmit an indication of cancelation of the job flow to a requesting device.

公开(公告)号：US10795935B2

公开(公告)日：2020-10-06

申请号：US16814481

申请日：2020-03-10

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Kais Arfaoui ,  Qing Gong

IPC: G06F9/46 ,  G06F16/901 ,  H04L29/08 ,  G06F16/903

Abstract: An apparatus includes a processor to: receive a request to generate a superset job flow replacing multiple job flows including an output job flow and preceding job flows previously performed to generate an output data object; identify a first subset of mid-flow data object(s) generated by preceding job flow(s) as input(s) to the output job flow to generate the output data object; identify a second subset of the mid-flow data object(s) generated by preceding job flow(s) as input(s) to other preceding job flow(s) generating the first subset; in response to a lack of a second subset, derive the superset job flow and/or corresponding DAG to include at least one task of the output job flow and at least one task of each preceding job flow that generated the first subset; and transmit an indication of the generation of the superset job flow.

公开(公告)号：US10740076B2

公开(公告)日：2020-08-11

申请号：US16708179

申请日：2019-12-09

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Ronald Earl Stogner ,  Chaowang “Ricky” Zhang ,  Eric Jian Yang ,  Qing Gong

IPC: G06F9/46 ,  G06F8/51 ,  G06N3/08 ,  G06F16/901 ,  G06F16/903 ,  H04L29/08

Abstract: An apparatus includes a processor to: receive a request to perform a set of tasks; analyze input data objects used as inputs and output data objects generated as outputs by the set of tasks to identify at least one dependency between tasks and at least one pair of tasks performable in parallel; determine an order of performance of the set of tasks; retrieve executable instructions of a corresponding set of task routines that define input interfaces and output interfaces for the input data objects and output data objects, respectively; generate a job flow definition defining the order of performance, each input interface and each output interface; use the job flow definition to perform the set of tasks; and transmit one of the output data objects to the requesting device as a result report serving as the output of the set of tasks.

公开(公告)号：US10664253B2

公开(公告)日：2020-05-26

申请号：US16708179

申请日：2019-12-09

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Ronald Earl Stogner ,  Chaowang “Ricky” Zhang ,  Eric Jian Yang ,  Qing Gong

IPC: G06F9/46 ,  G06F8/51 ,  G06N3/08 ,  G06F16/901 ,  G06F16/903 ,  H04L29/08

Abstract: An apparatus includes a processor to: receive a request to perform a set of tasks; analyze input data objects used as inputs and output data objects generated as outputs by the set of tasks to identify at least one dependency between tasks and at least one pair of tasks performable in parallel; determine an order of performance of the set of tasks; retrieve executable instructions of a corresponding set of task routines that define input interfaces and output interfaces for the input data objects and output data objects, respectively; generate a job flow definition defining the order of performance, each input interface and each output interface; use the job flow definition to perform the set of tasks; and transmit one of the output data objects to the requesting device as a result report serving as the output of the set of tasks.

公开(公告)号：US10565261B2

公开(公告)日：2020-02-18

申请号：US16587965

申请日：2019-09-30

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Eric Jian Yang ,  Ronald Earl Stogner ,  Chaowang “Ricky” Zhang ,  Partha Dutta ,  Qing Gong

IPC: G06F9/46 ,  G06F16/901 ,  H04L29/08 ,  G06F16/903

Abstract: An apparatus includes a processor to: receive a request from a remote device to perform a job flow; retrieve a job flow definition defining the job flow and each of a set of task routines to perform tasks of the job flow from a set of storage devices where each is stored as an undivided object within one storage device; and in response to determining that a data set is stored as multiple data object blocks, generate a container containing the job flow definition and set of task routines to enable each storage device to perform the job flow using a locally stored data object block of the data set as input to generate a corresponding data object block of a result report, provide a copy of the container to each storage device, and transmit the result report assembled from the data object blocks thereof to the remote device.

公开(公告)号：US11137990B2

公开(公告)日：2021-10-05

申请号：US17139546

申请日：2020-12-31

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Eric Jian Yang ,  Qing Gong ,  Kais Arfaoui ,  Ronald Earl Stogner ,  Partha Dutta

IPC: G06F9/46 ,  G06F8/51 ,  G06N3/08 ,  G06F16/901 ,  G06F16/903 ,  H04L29/08

Abstract: An apparatus includes at least on processor to: parse a job flow definition for a job flow to identify an implicit expression of a data dependency arising from a data object output by a first task of the job flow and input to a second task thereof, wherein the first task is referred to as a data object required by the second as an input; in response to identifying the implicit expression, derive an order of performance of the tasks of the job flow that includes performing the first task before the second to ensure generation of the data object prior to performance of the second; for each task, retrieve a corresponding task routine; execute the task routines in an order that follows the order of performance of the tasks; and transmit, to the requesting device via the network, an indication of successful performance of the job flow.

公开(公告)号：US20210072964A1

公开(公告)日：2021-03-11

申请号：US17066029

申请日：2020-10-08

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Ronald Earl Stogner ,  Eric Jian Yang ,  Qing Gong ,  Chaowang "Ricky" Zhang

IPC: G06F8/51 ,  G06F9/46 ,  G06N3/08 ,  G06F16/901 ,  G06F16/903

Abstract: An apparatus includes processor(s) to: within a kill container, monitor a task kill queue for execution failure message(s) indicating failure of a task routine to perform a task of a job flow, and in response to a quantity of execution failure messages reaching a threshold, store, within the task kill queue, a kill tasks request message; within a task container, in response to the kill tasks request message, cease execution of the task routine to cease performance of the task, and store, within the task queue, a task cancelation message indicating cancelation of the task routine; within a performance container, in response to the task canceled message, store, within a job queue, a job cancelation message indicating cancelation of the job flow; and in response to the job cancelation message, transmit an indication of cancelation of the job flow to a requesting device.

公开(公告)号：US10657107B1

公开(公告)日：2020-05-19

申请号：US16729409

申请日：2019-12-29

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Ronald Earl Stogner ,  Eric Jian Yang ,  Chaowang “Ricky” Zhang ,  Partha Dutta ,  Qing Gong

IPC: G06F16/182 ,  G06F16/17 ,  G06F16/16

Abstract: An apparatus includes a processor to: receive a request from a remote device to perform a job flow; retrieve a job flow definition defining the job flow and each of a set of task routines to perform tasks of the job flow from a set of storage devices where each is stored as an undivided object within one storage device; and in response to determining that a data set is stored as multiple data object blocks, generate a container containing the job flow definition and set of task routines to enable each storage device to perform the job flow using a locally stored data object block of the data set as input to generate a corresponding data object block of a result report, provide a copy of the container to each storage device, and transmit the result report assembled from the data object blocks thereof to the remote device.