Method and system of large amount of data migration with enhanced efficiency

    公开(公告)号:US12265720B2

    公开(公告)日:2025-04-01

    申请号:US17007899

    申请日:2020-08-31

    Inventor: Shu Li

    Abstract: The present disclosure provides methods, systems, and non-transitory computer readable media for migrating data in a data storage system. A method for migrating data comprises: transferring data from a storage cluster in a first data center to a migration cartridge of the first data center; converting, by the migration cartridge of the first data center, the data's format into an archival format; storing the data into a media card; and moving the media card from the first data center to a second data center, wherein the data is read from the media card into a migration cartridge of the second data center and stored into an archival cluster in the second data center according to the archival format of the data.

    System and method for data protection in solid-state drives

    公开(公告)号:US11789814B2

    公开(公告)日:2023-10-17

    申请号:US17660000

    申请日:2022-04-20

    Inventor: Shu Li

    CPC classification number: G06F11/1068 H03M13/154

    Abstract: The present disclosure relates to a system and a method for data protection. In some embodiments, an exemplary method for data encoding includes: receiving a data bulk; performing an erasure coding (EC) encoding on the data bulk to generate one or more EC codewords; distributing a plurality of portions of each EC codeword of the one or more EC codewords across a plurality of solid-state drives (SSDs); performing, at each SSD of the plurality of SSDs, an error correction coding (ECC) encoding on portions of the one or more EC codewords distributed to the SSD to generate an ECC codeword; and storing, in each SSD of the plurality of SSDs, the ECC codeword.

    System and method for data protection in solid-state drives

    公开(公告)号:US11334431B2

    公开(公告)日:2022-05-17

    申请号:US17026761

    申请日:2020-09-21

    Inventor: Shu Li

    Abstract: The present disclosure relates to a system and a method for data protection. In some embodiments, an exemplary method for data encoding includes: receiving a data bulk; performing an erasure coding (EC) encoding on the data bulk to generate one or more EC codewords; distributing a plurality of portions of each EC codeword of the one or more EC codewords across a plurality of solid-state drives (SSDs); performing, at each SSD of the plurality of SSDs, an error correction coding (ECC) encoding on portions of the one or more EC codewords distributed to the SSD to generate an ECC codeword; and storing, in each SSD of the plurality of SSDs, the ECC codeword.

    APPARATUS AND METHOD FOR DATA PACKING AND ORDERING

    公开(公告)号:US20220107754A1

    公开(公告)日:2022-04-07

    申请号:US17065053

    申请日:2020-10-07

    Inventor: Shu Li

    Abstract: The present disclosure relates to an apparatus and method for data storage. In some embodiments, an exemplary method includes: aligning a plurality of sets of data blocks in a plurality of queues; buffering the plurality of sets of data blocks from the plurality of queues in one or more data buffers, each set of data blocks in the one or more data buffers having the same order as that in the plurality of queues; and storing the data blocks in each data buffer into a NAND unit.

    METHOD AND SYSTEM FOR FACILITATING FAST CRASH RECOVERY IN A STORAGE DEVICE

    公开(公告)号:US20220027265A1

    公开(公告)日:2022-01-27

    申请号:US16939961

    申请日:2020-07-27

    Inventor: Shu Li

    Abstract: A system is provided for facilitating crash recovery. The system receives an input/output (I/O) request for data associated with a logical block address. The system retrieves, from a first mapping table associated with a first storage drive, a physical location corresponding to the logical block address, wherein the first mapping table is stored in a random access memory which comprises a block device, and wherein a driver for the block device is stored in system memory separately from the first mapping table stored in the block device. The system accesses the physical location to execute the I/O request. Responsive to determining a crash associated with the driver, the system restarts the driver to recover access to the first mapping table absent of reconstruction of the first mapping table which involves reading data from the first storage drive and extracting mapping relations between logical addresses and physical addresses.

    System and method for user data isolation

    公开(公告)号:US11200337B2

    公开(公告)日:2021-12-14

    申请号:US16272770

    申请日:2019-02-11

    Inventor: Shu Li

    Abstract: One embodiment described herein provides a system and method for isolating data written by different users on a cloud drive. During operation, the system receives a write request from a first user comprising to-be-written data, the to-be-written data being associated with a writer's identifier for the first user. The system then writes the to-be-written data bound with the writer's identifier into physical media associated with the cloud drive, thereby facilitating user data isolation by preventing a second user having a reader's identifier that is different from the writer's identifier of the first user from gaining access to the written data.

    METHOD AND SYSTEM FOR FACILITATING ACCELERATION OF A MAPPING TABLE RECONSTRUCTION

    公开(公告)号:US20210382828A1

    公开(公告)日:2021-12-09

    申请号:US16891778

    申请日:2020-06-03

    Inventor: Shu Li

    Abstract: One embodiment provides a system which facilitates reconstruction of a mapping table. During operation, the system writes at a first physical block address, first data and a corresponding first logical block address to a block of a non-volatile memory. The system stores, in a mapping table, an entry which maps the first logical block address to the first physical block address. The system writes the first logical block address to a journal in a spare page of the block, wherein the journal indicates logical block addresses in an order corresponding to physical block addresses of data written to the block. The system rebuilds the mapping table by: reading the journal to obtain the logical block addresses; and determining, based on the order, the physical block addresses corresponding to the obtained logical block addresses.

    METHOD AND SYSTEM FOR FACILITATING DATA PLACEMENT AND CONTROL OF PHYSICAL ADDRESSES WITH MULTI-QUEUE I/O BLOCKS

    公开(公告)号:US20210349818A1

    公开(公告)日:2021-11-11

    申请号:US16871369

    申请日:2020-05-11

    Inventor: Shu Li

    Abstract: A system is provided to receive a request to write a sector of data to a non-volatile storage device, wherein the request is associated with a physical address in the non-volatile storage device at which the sector of data is to be written. The system identifies, based on the physical address, a channel buffer to which the sector of data is to be transmitted, and stores the sector of data in the channel buffer. Responsive to determining that the channel buffer stores other sectors, the system writes the sector of data and the other sectors of data to the non-volatile storage device based on the physical address.

    System and method for improving efficiency and reducing system resource consumption in a data integrity check

    公开(公告)号:US11119847B2

    公开(公告)日:2021-09-14

    申请号:US16682726

    申请日:2019-11-13

    Inventor: Shu Li

    Abstract: The system receives, by a first controller, data to be written to a first storage device. The data may not be accompanied by a cyclic redundancy check (CRC) signature. The system calculates, by the first controller, a first error detection code based on the data, and writes the data and the first error detection code to the first storage device. The system calculates a second error detection code based on the written data. The system performs a first integrity check of the written data by determining whether the second error detection code matches the first error detection code. The system performs a second integrity check of the written data by: obtaining one or more additional error detection codes from one or more other storage devices, wherein an obtained error detection code is calculated by a controller of a corresponding storage device; and determining whether the first error detection code matches the one or more additional error detection codes.

    ARCHITECTURE AND DESIGN OF A STORAGE DEVICE CONTROLLER FOR HYPERSCALE INFRASTRUCTURE

    公开(公告)号:US20210278998A1

    公开(公告)日:2021-09-09

    申请号:US16813449

    申请日:2020-03-09

    Inventor: Shu Li

    Abstract: An apparatus is provided to facilitate a hyperscale infrastructure. The apparatus comprises a non-volatile memory and a controller. The controller comprises: a memory interface coupled to a first memory; a media interface coupled to the non-volatile memory; a media controller associated with the media interface; a hardware accelerator configured to process, via the memory interface, data to be written to the non-volatile memory; and a reprogrammable hardware component configured to further process the data via the memory interface. The media controller is configured to write, via the media interface, the data to the non-volatile memory system.

Patent Agency Ranking