公开(公告)号：US09767217B1

公开(公告)日：2017-09-19

申请号：US14288456

申请日：2014-05-28

Applicant: Google Inc.

Inventor： Matthew Harold Austern ,  Reuven Lax ,  Vyacheslav Alekseyevich Chernyak

IPC: G06F17/00 ,  G06F17/30

CPC classification number: G06F17/30569 ,  G06F9/5038 ,  G06F17/30312 ,  G06F17/30424

Abstract: Methods, systems, and apparatus are described for performing streaming graph computations in a distributed processing system. In one aspect, a method includes receiving, during a first superstep, streaming graph input that comprises continuous input of first graph updates for updating the state of an existing graph, the existing graph comprising a plurality of vertices and edges, and each first graph update specifying a vertex and a message; scheduling, during the first superstep, the first graph updates for processing during a second superstep; providing, during the first superstep, the first graph updates as input to a graph computation for the existing graph; determining that the graph computation has completed processing for the first superstep, and in response: initiating the second superstep; and processing, during the second superstep, each first graph update; and providing, during the second superstep, graph output based at least in part on the first graph updates.

公开(公告)号：US09819731B1

公开(公告)日：2017-11-14

申请号：US15177652

申请日：2016-06-09

Applicant: Google Inc.

Inventor： Matthew Harold Austern ,  James C. Dehnert ,  Aart J. C. Bik ,  Grzegorz Czajkowski

IPC: H04L29/08 ,  G06F9/50 ,  G06N99/00

CPC classification number: G06T11/206 ,  G06F7/00 ,  G06F8/457 ,  G06F9/46 ,  G06F9/5005 ,  G06F11/1464 ,  G06F11/1469 ,  G06F11/2082 ,  G06F15/17312 ,  G06F17/30 ,  G06F17/30958 ,  G06F17/30961 ,  G06F2201/84 ,  G06F2221/0793 ,  G06N99/00 ,  G06N99/005 ,  G06T2210/32 ,  H04L5/0032 ,  H04L29/08135 ,  H04L67/10

Abstract: A value is distributed in a distributed computing system having a master system in communication with a plurality of worker systems. Partitions of a graph are assigned to the worker systems. The graph represents relationships among a set of tangible items that model a real-world condition having an associated problem. Configuration information is determined that describes a configuration of the distributed computing system. A distribution scheme is selected for distributing a value from the master system to the plurality of worker systems based on the configuration information. The value is distributed from the master system to the worker systems according to the selected distribution scheme. The worker systems are configured to use the value to produce an output representing a solution to the real-world problem.