Exchange of data objects between task routines via shared memory space

    公开(公告)号:US11204809B2

    公开(公告)日:2021-12-21

    申请号:US17308355

    申请日:2021-05-05

    Abstract: An apparatus includes a processor to: based on data dependencies specified in a job flow definition, identify first and second tasks of the corresponding job flow to be performed sequentially, wherein the first task outputs a data object used as an input to the second; store, within a task queue, at least one message conveying at least an identifier of the first task, and an indication that the data object is to be exchanged through a shared memory space; within a task container, in response to storage of the at least one message within the task queue, sequentially execute first and second task routines to sequentially perform the first and second tasks, respectively, and instantiate the shared memory space to be accessible to the first and second task routines during their executions; and upon completion of the job flow, transmit an indication of completion to another device via a network.

    PER TASK ROUTINE DISTRIBUTED RESOLVER

    公开(公告)号:US20210224051A1

    公开(公告)日:2021-07-22

    申请号:US17225023

    申请日:2021-04-07

    Abstract: An apparatus includes a processor to: use an identifier of a requesting device or operator thereof to identify federated area(s) to which access is authorized; based on data dependencies among a set of tasks of a job flow, derive an order of performance specifying the first task to be performed; store, within a task queue, a task routine execution request message including an identifier associated with the first task, and federated area identifier(s) of the identified federated area(s); within a resolver container, in response to storage of the task routine execution request message, use the identifier associated with the first task and identifier(s) of the federated area(s) to identify one in which a first task routine is stored; within a task container, execute the first task routine to perform the first task; and upon completion of the job flow, transmit an indication of completion to the requesting device.

    MESSAGE-BASED COORDINATION OF CONTAINER-SUPPORTED MANY TASK COMPUTING

    公开(公告)号:US20210026611A1

    公开(公告)日:2021-01-28

    申请号:US17064577

    申请日:2020-10-06

    Abstract: An apparatus includes processor(s) to: receive a request to perform a job flow; retrieve a job flow definition from federated area(s); store, within a job queue, a job performance request message comprising the job flow definition; within a first performance container, execute a performance routine causing the processor(s) to, in response to the storage of the job performance request message within the job queue, derive an order of performance of tasks specifying a first task based on dependencies among the tasks, and store, within a task queue, a first task routine execution request message comprising an identifier associated with the first task; and within a first task container, in response to the storage of the first task routine execution request message within the task queue, use the identifier to retrieve a first task routine from the federated area(s), and execute the first task routine to perform the first task.

    Staged training of neural networks for improved time series prediction performance

    公开(公告)号:US10650045B2

    公开(公告)日:2020-05-12

    申请号:US16556573

    申请日:2019-08-30

    Abstract: An apparatus includes a processor to: train a first neural network of a chain to generate first configuration data including first trained parameters, wherein the chain performs an analytical function generating a set of output values from a set of input values, each neural network has inputs to receive the set of input values and outputs to output a portion of the set of output values, and the neural networks are ordered from the first at the head to a last neural network at the tail, and are interconnected so that each neural network additionally receives the outputs of a preceding neural network; train, using the first configuration data, a next neural network in the chain ordering to generate next configuration data including next trained parameters; and use at least the first and next configuration data and data indicating the interconnections to instantiate the chain to perform the analytical function.

    Generation of job flow objects in federated areas from data structure

    公开(公告)号:US10380185B2

    公开(公告)日:2019-08-13

    申请号:US16223518

    申请日:2018-12-18

    Abstract: An apparatus includes a processor to: receive a request to provide, within a specified federated area, a set of objects that enable a performance of a job flow to perform multiple tasks of an analysis based on data table(s) and formulae of a spreadsheet data structure, wherein the set of objects includes at least one task routine to perform a task of the multiple tasks; correlate each indication of data required as input or output to at least a subpart of a data table; identify data dependencies and determine an order of performance among the multiple tasks based on the formulae; generate, within the specified federated area, a job flow definition that specifies the order of performance of the multiple tasks; and for each task routine of the at least one task routine, generate, within the specified federated area, a corresponding macro data structure.

    Generation of directed acyclic graphs from task routines

    公开(公告)号:US10331495B2

    公开(公告)日:2019-06-25

    申请号:US15897723

    申请日:2018-02-15

    Abstract: An apparatus including a processor to: parse comments of multiple task routines to identify I/O parameters; generate a visualization of a DAG to include a visual representation of each task routine, wherein each representation includes a task graph object of the task routine, at least one input data graph object that represents an input to the task routine and that includes a visual indication of at least one characteristic of the input; and at least one output data graph object that represents an output of the task routine and that includes a visual indication of at least one characteristic of the output; in the I/O parameters, identify each dependency between an output of one task routine and an input of another; for each identified dependency, augment the visualization with a dependency marker that visually links the visual representations of each associated pair of task routines; and visually output the visualization.

    GENERATION OF JOB FLOW OBJECTS IN FEDERATED AREAS FROM DATA STRUCTURE

    公开(公告)号:US20190146997A1

    公开(公告)日:2019-05-16

    申请号:US16223518

    申请日:2018-12-18

    Abstract: An apparatus includes a processor to: receive a request to provide, within a specified federated area, a set of objects that enable a performance of a job flow to perform multiple tasks of an analysis based on data table(s) and formulae of a spreadsheet data structure, wherein the set of objects includes at least one task routine to perform a task of the multiple tasks; correlate each indication of data required as input or output to at least a subpart of a data table; identify data dependencies and determine an order of performance among the multiple tasks based on the formulae; generate, within the specified federated area, a job flow definition that specifies the order of performance of the multiple tasks; and for each task routine of the at least one task routine, generate, within the specified federated area, a corresponding macro data structure.

    Generation of directed acyclic graphs from task routines

    公开(公告)号:US10255115B2

    公开(公告)日:2019-04-09

    申请号:US15897723

    申请日:2018-02-15

    Abstract: An apparatus including a processor to: parse comments of multiple task routines to identify I/O parameters; generate a visualization of a DAG to include a visual representation of each task routine, wherein each representation includes a task graph object of the task routine, at least one input data graph object that represents an input to the task routine and that includes a visual indication of at least one characteristic of the input; and at least one output data graph object that represents an output of the task routine and that includes a visual indication of at least one characteristic of the output; in the I/O parameters, identify each dependency between an output of one task routine and an input of another; for each identified dependency, augment the visualization with a dependency marker that visually links the visual representations of each associated pair of task routines; and visually output the visualization.

    Generation of directed acyclic graphs from task routines

    公开(公告)号:US10210025B2

    公开(公告)日:2019-02-19

    申请号:US15897723

    申请日:2018-02-15

    Abstract: An apparatus including a processor to: parse comments of multiple task routines to identify I/O parameters; generate a visualization of a DAG to include a visual representation of each task routine, wherein each representation includes a task graph object of the task routine, at least one input data graph object that represents an input to the task routine and that includes a visual indication of at least one characteristic of the input; and at least one output data graph object that represents an output of the task routine and that includes a visual indication of at least one characteristic of the output; in the I/O parameters, identify each dependency between an output of one task routine and an input of another; for each identified dependency, augment the visualization with a dependency marker that visually links the visual representations of each associated pair of task routines; and visually output the visualization.

Patent Agency Ranking