Method and system for efficient content transfer to distributed stores
Abstract:
A method is performed by a computer system. The method includes receiving the source object; providing an upload queue; executing a chunk creation loop to create a first plurality of chunks and add the first plurality of chunks to the upload queue, each chunk in the first plurality of chunks containing a respective portion of the source object; implementing an upload thread pool of upload threads; and executing the upload threads to upload the source object to a distributed data store, including executing the upload threads to upload chunks from the first plurality of chunks to the distributed data store in parallel.
Information query
Patent Agency Ranking
0/0