Importation, presentation, and persistent storage of data
Abstract:
The disclosed subject matter includes systems, methods, and computer readable medium for importing/presenting data for computer system use. A logging process can receive data. Log file(s) can be created in memory. A listener can parse received log data to be appended to columns. A log tailer process can transmit data read from log file(s) to data import server(s). At data import server(s): the data can be written to column(s) of the associated table location in cache memory buffers, for immediate use by data consumers and for writing to persistent storage; a current number of rows of data written to the cache memory buffers can be confirmed; column data can be synchronized from the cache memory buffers into a persistent table data store; and table location metadata can be updated. A check point can be written for the persisted data for resuming import after a fault.
Public/Granted literature
Information query
Patent Agency Ranking
0/0