Preprocessing in database system workload capture and replay

    公开(公告)号:US11615012B2

    公开(公告)日:2023-03-28

    申请号:US16984303

    申请日:2020-08-04

    Applicant: SAP SE

    Abstract: Methods, systems, and computer-readable storage media for receiving a capture file, the capture file including data representative of a workload executed in a source database system, and processing the capture file to provide a replay file, the replay file being in a format that is executable by a replayer to replay the workload in a target database system, processing the capture file including: processing the capture file to provide a set of intermediate files, and processing the set of intermediate files using in-memory merge sort operations to generate a set of replay files.

    Order-independent multi-record hash generation and data filtering

    公开(公告)号:US11468062B2

    公开(公告)日:2022-10-11

    申请号:US16801039

    申请日:2020-02-25

    Applicant: SAP SE

    Abstract: A process is provided for independently hashing and filtering a data set, such as during preprocessing. For the data set, one or more records, separately having one or more fields, may be identified. A record hash value set, containing one or more record hash values for the respective one or more records, may be generated. Generating a given record hash value may be accomplished as follows. For a given record, a hash value set may be generated, having one or more field hash values for the respective one or more fields of the given record. The record hash value for the given record may be generated based on the hash value set. A total hash value for the data set may be generated based on the record hash value set. The records of the data set may be filtered based on classification of the query that generated the records.

    Query cancelation using a signal handler throwing an exception

    公开(公告)号:US11288272B2

    公开(公告)日:2022-03-29

    申请号:US16406945

    申请日:2019-05-08

    Applicant: SAP SE

    Abstract: In some embodiments, a method detects a cancelation of a query for an application that is running. The query is being performed on a database system. The method processes the cancellation to determine one or more threads associated with the query and sends a signal to the one or more threads that are associated with the process to suspend the one or more threads. One or more signal handlers for the one or more threads are called and an exception is thrown by the one or more signal handlers to cancel the query. The exception causes the query to be canceled.

    TRANSACTION COMMIT OPERATIONS WITH THREAD DECOUPLING

    公开(公告)号:US20210271510A1

    公开(公告)日:2021-09-02

    申请号:US17322715

    申请日:2021-05-17

    Applicant: SAP SE

    Abstract: Innovations in the area of server-side processing when committing transactions to disk in a distributed database system can improve computational efficiency at database nodes and/or reduce network bandwidth utilization. For example, when transactions are committed in a database system, at a master node of the database system, a server uses different threads for certain processor-intensive operations and certain I/O-intensive operations.

    REAL-TIME CROSS-SYSTEM DATABASE REPLICATION FOR HYBRID-CLOUD ELASTIC SCALING AND HIGH-PERFORMANCE DATA VIRTUALIZATION

    公开(公告)号:US20210149915A1

    公开(公告)日:2021-05-20

    申请号:US16686827

    申请日:2019-11-18

    Applicant: SAP SE

    Abstract: RTR of a database transaction to a replica table may include receiving replication and transaction commit log entries (representing a database transaction). The replication log entry has a row-ID value, and the row at the replica table has a row-ID value. The replication log entry may be dispatched to a parallel log replayer and the associated transaction commit log entry to a transaction commit log replayer. The row-ID values may be compared, and the replication log entry is replayed at the parallel log replayer based on the comparison. The database transaction may then be committed to the replica table by replaying the associated transaction commit log entry at the transaction log replayer, wherein the database transaction is associated with row-level parallel replay having transactional consistency and DDL replication and reconstruction of a DDL statement at the replica system is associated with one or multiple metadata update log entries.

    Unified table query processing
    36.
    发明授权

    公开(公告)号:US11003665B2

    公开(公告)日:2021-05-11

    申请号:US15260175

    申请日:2016-09-08

    Applicant: SAP SE

    Abstract: A system and method of query processing in a multi-level storage system having a unified table architecture. A query is received by a common query execution engine connected with the unified table architecture, the query specifying a data record. The common query execution engine performs a look-up for the data record based on the query at the first level storage structure. If the data record is not present at the first level storage structure, the common query execution engine performs separate look-ups in each of the second level storage structure and the main store.

    VIRTUAL DATABASE TABLES WITH UPDATABLE LOGICAL TABLE POINTERS

    公开(公告)号:US20210089540A1

    公开(公告)日:2021-03-25

    申请号:US16713929

    申请日:2019-12-13

    Applicant: SAP SE

    Abstract: Techniques and solutions are described for implementing virtual table schemas. A virtual table schema includes a logical pointer that is used to target a table that includes data and is defined according to the virtual table schema. Values assigned to the logical pointer can be used to target tables at different locations, such as in-memory storage or in dynamic storage of a database management system. The dynamic storage includes an in-memory buffer cache and persistent storage. The logical pointer can be updated to point to the in-memory storage or the dynamic storage, including based on use statistics. Similarly, a table having data for the virtual table can be transitioned between the in-memory buffer cache and the persistent storage, including based on use statistics for the virtual table. A value for the logical pointer can be updated when the table is transferred between the in-memory buffer cache and the dynamic storage.

    Client-driven commit of distributed write transactions in a database environment

    公开(公告)号:US10936578B2

    公开(公告)日:2021-03-02

    申请号:US15611156

    申请日:2017-06-01

    Applicant: SAP SE

    Abstract: Technologies are described for facilitating transaction processing in a distributed database environment. A database client sends database operations to a slave node, which mediates execution of the transaction. A connection between the database client and the slave node is associated with an identifier, and the transaction has an identifier. The database client sends a commit request to a master node over a network connection between the master node and the database client. The commit request includes the transaction identifier. The commit request can also include an indication of database nodes executing operations in the transaction.

    AUTOMATIC DETERMINATION OF TABLE DISTRIBUTION FOR MULTINODE, DISTRIBUTED DATABASE SYSTEMS

    公开(公告)号:US20210011898A1

    公开(公告)日:2021-01-14

    申请号:US17037484

    申请日:2020-09-29

    Applicant: SAP SE

    Abstract: Technologies are described for improving the performance of distributed database systems. The technologies provide suggested table distributions that can reduce the performance overhead associated with database operations that involve multiple nodes, and can provide more even distribution of computing resource use. In a particular example, a method includes minimizing a scoring function that includes a plurality of performance metrics, at least a portion of the metrics being associated with a weight. Candidate table distributions can be analyzed in an iterative manner to determine a lowest-score distribution. A final table distribution can be output, such as to a user.

    Multi-level storage architecture
    40.
    发明授权

    公开(公告)号:US10860553B2

    公开(公告)日:2020-12-08

    申请号:US15682358

    申请日:2017-08-21

    Applicant: SAP SE

    Abstract: Deleting a data record from the second level storage or main store is disclosed. A look-up is performed for the data record in the first level storage, where the data record is defined by a row identifier. If the row identifier is found in the first level storage, a look-up is performed for an updated row identifier representing an update of the data record in the second level storage and the main store, the update of the data record being defined by an updated row identifier. If the updated row identifier is found in the second level storage, an undo log is generated from the first level storage to invalidate a row identifier of the row identifier. A flag is generated representing an invalid updated row identifier, and a redo log is generated to restore the data record in the first level storage.

Patent Agency Ranking