公开(公告)号：US20210255843A1

公开(公告)日：2021-08-19

申请号：US17308355

申请日：2021-05-05

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Ronald Earl Stogner ,  Eric Jian Yang ,  Qing Gong ,  Partha Dutta ,  Kais Arfaoui

IPC: G06F8/51 ,  G06F9/46 ,  G06N3/08 ,  G06F16/903 ,  G06F16/901

Abstract: An apparatus includes a processor to: based on data dependencies specified in a job flow definition, identify first and second tasks of the corresponding job flow to be performed sequentially, wherein the first task outputs a data object used as an input to the second; store, within a task queue, at least one message conveying at least an identifier of the first task, and an indication that the data object is to be exchanged through a shared memory space; within a task container, in response to storage of the at least one message within the task queue, sequentially execute first and second task routines to sequentially perform the first and second tasks, respectively, and instantiate the shared memory space to be accessible to the first and second task routines during their executions; and upon completion of the job flow, transmit an indication of completion to another device via a network.

公开(公告)号：US20200097270A1

公开(公告)日：2020-03-26

申请号：US16699245

申请日：2019-11-29

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Kais Arfaoui

IPC: G06F8/51 ,  G06F16/901 ,  G06F16/903 ,  G06N3/08 ,  G06F9/46

Abstract: An apparatus includes a processor to: receive a job flow definition; retrieve the most recent versions of a set of task routines for the defined job flow; translate, into an intermediate representation, executable instructions of each task routine implementing an interface for data input and/or output during execution; translate executable instructions of the job flow definition that defines the interface for each task routine into an intermediate representation; compare each intermediate representation from a task routine to the corresponding intermediate representation from the job flow definition to determine if there is a match; and in response to there being a match for each comparison and to the executable instructions of the job flow definition being written in a secondary programming language, translate the executable instructions of the job flow definition into a primary programming language, and store the resulting translated form of the job flow definition in a federated area.

公开(公告)号：US11137990B2

公开(公告)日：2021-10-05

申请号：US17139546

申请日：2020-12-31

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Eric Jian Yang ,  Qing Gong ,  Kais Arfaoui ,  Ronald Earl Stogner ,  Partha Dutta

IPC: G06F9/46 ,  G06F8/51 ,  G06N3/08 ,  G06F16/901 ,  G06F16/903 ,  H04L29/08

Abstract: An apparatus includes at least on processor to: parse a job flow definition for a job flow to identify an implicit expression of a data dependency arising from a data object output by a first task of the job flow and input to a second task thereof, wherein the first task is referred to as a data object required by the second as an input; in response to identifying the implicit expression, derive an order of performance of the tasks of the job flow that includes performing the first task before the second to ensure generation of the data object prior to performance of the second; for each task, retrieve a corresponding task routine; execute the task routines in an order that follows the order of performance of the tasks; and transmit, to the requesting device via the network, an indication of successful performance of the job flow.

公开(公告)号：US10649750B2

公开(公告)日：2020-05-12

申请号：US16539222

申请日：2019-08-13

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Kais Arfaoui

IPC: G06F9/46 ,  G06F8/51 ,  G06N3/08 ,  H04L29/08

Abstract: An apparatus includes a processor to: receive a job flow definition; retrieve the most recent versions of a set of task routines for the defined job flow; translate, into an intermediate representation, executable instructions of each task routine implementing an interface for data input and/or output during execution; translate executable instructions of the job flow definition that defines the interface for each task routine into an intermediate representation; compare each intermediate representation from a task routine to the corresponding intermediate representation from the job flow definition to determine if there is a match; and in response to there being a match for each comparison and to the executable instructions of the job flow definition being written in a secondary programming language, translate the executable instructions of the job flow definition into a primary programming language, and store the resulting translated form of the job flow definition in a federated area.

公开(公告)号：US09684544B1

公开(公告)日：2017-06-20

申请号：US15425886

申请日：2017-02-06

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Kais Arfaoui ,  Ronald Earl Stogner

IPC: G06F9/46 ,  G06F9/50 ,  G06F17/30

CPC classification number: G06F17/30949 ,  G06F17/30985 ,  H04L67/10

Abstract: An apparatus includes a processor and a storage storing instructions causing the processor to: maintain a federated area; receive a request to perform a job flow with a data set from a remote device; retrieve a job flow definition specifying the tasks of the job flow from the federated area; determine whether there is an instance log in the federated area generated by a previous performance of the job flow with the data set; in response to there being such an instance log, retrieve the version specified in the instance log of each task routine for each task from the federated area; in response to there being no such instance log, retrieve the most recent version of each task routine; perform the job flow with the retrieved versions of the task routines and the data set to generate a result report; and provide the result report to the remote device.

公开(公告)号：US11169788B2

公开(公告)日：2021-11-09

申请号：US17225023

申请日：2021-04-07

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Ronald Earl Stogner ,  Eric Jian Yang ,  Qing Gong ,  Partha Dutta ,  Kais Arfaoui

IPC: G06F9/46 ,  G06F8/51 ,  G06N3/08 ,  G06F16/901 ,  G06F16/903 ,  H04L29/08

Abstract: An apparatus includes a processor to: use an identifier of a requesting device or operator thereof to identify federated area(s) to which access is authorized; based on data dependencies among a set of tasks of a job flow, derive an order of performance specifying the first task to be performed; store, within a task queue, a task routine execution request message including an identifier associated with the first task, and federated area identifier(s) of the identified federated area(s); within a resolver container, in response to storage of the task routine execution request message, use the identifier associated with the first task and identifier(s) of the federated area(s) to identify one in which a first task routine is stored; within a task container, execute the first task routine to perform the first task; and upon completion of the job flow, transmit an indication of completion to the requesting device.

公开(公告)号：US10795935B2

公开(公告)日：2020-10-06

申请号：US16814481

申请日：2020-03-10

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Kais Arfaoui ,  Qing Gong

IPC: G06F9/46 ,  G06F16/901 ,  H04L29/08 ,  G06F16/903

Abstract: An apparatus includes a processor to: receive a request to generate a superset job flow replacing multiple job flows including an output job flow and preceding job flows previously performed to generate an output data object; identify a first subset of mid-flow data object(s) generated by preceding job flow(s) as input(s) to the output job flow to generate the output data object; identify a second subset of the mid-flow data object(s) generated by preceding job flow(s) as input(s) to other preceding job flow(s) generating the first subset; in response to a lack of a second subset, derive the superset job flow and/or corresponding DAG to include at least one task of the output job flow and at least one task of each preceding job flow that generated the first subset; and transmit an indication of the generation of the superset job flow.

公开(公告)号：US10747517B2

公开(公告)日：2020-08-18

申请号：US16699245

申请日：2019-11-29

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Kais Arfaoui

IPC: G06F9/46 ,  G06F8/51 ,  G06F16/901 ,  G06N3/08 ,  G06F16/903 ,  H04L29/08

Abstract: An apparatus includes a processor to: receive a job flow definition; retrieve the most recent versions of a set of task routines for the defined job flow; translate, into an intermediate representation, executable instructions of each task routine implementing an interface for data input and/or output during execution; translate executable instructions of the job flow definition that defines the interface for each task routine into an intermediate representation; compare each intermediate representation from a task routine to the corresponding intermediate representation from the job flow definition to determine if there is a match; and in response to there being a match for each comparison and to the executable instructions of the job flow definition being written in a secondary programming language, translate the executable instructions of the job flow definition into a primary programming language, and store the resulting translated form of the job flow definition in a federated area.

公开(公告)号：US20180136983A1

公开(公告)日：2018-05-17

申请号：US15851869

申请日：2017-12-22

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Kais Arfaoui ,  Ronald Earl Stogner

IPC: G06F9/50 ,  G06F17/30

CPC classification number: G06F17/30949 ,  G06F17/30985 ,  H04L67/10

Abstract: An apparatus includes a processor and a storage storing instructions causing the processor to: maintain a federated area; receive a request to perform a job flow with a data set from a remote device; retrieve a job flow definition specifying the tasks of the job flow from the federated area; determine whether there is an instance log in the federated area generated by a previous performance of the job flow with the data set; in response to there being such an instance log, retrieve the version specified in the instance log of each task routine for each task from the federated area; in response to there being no such instance log, retrieve the most recent version of each task routine; perform the job flow with the retrieved versions of the task routines and the data set to generate a result report; and provide the result report to the remote device.

公开(公告)号：US09852013B2

公开(公告)日：2017-12-26

申请号：US15613516

申请日：2017-06-05

Applicant: SAS Institute Inc.

Inventor： Henry Gabriel Victor Bequet ,  Kais Arfaoui ,  Ronald Earl Stogner

IPC: G06F9/46 ,  G06F9/50 ,  G06F17/30

CPC classification number: G06F17/30949 ,  G06F17/30985 ,  H04L67/10

Abstract: An apparatus includes a processor and a storage storing instructions causing the processor to: maintain a federated area; receive a request to perform a job flow with a data set from a remote device; retrieve a job flow definition specifying the tasks of the job flow from the federated area; determine whether there is an instance log in the federated area generated by a previous performance of the job flow with the data set; in response to there being such an instance log, retrieve the version specified in the instance log of each task routine for each task from the federated area; in response to there being no such instance log, retrieve the most recent version of each task routine; perform the job flow with the retrieved versions of the task routines and the data set to generate a result report; and provide the result report to the remote device.