Invention Grant
- Patent Title: Method, system, and computer program product for normalizing embeddings for cross-embedding alignment
-
Application No.: US18006649Application Date: 2022-05-25
-
Publication No.: US11861324B2Publication Date: 2024-01-02
- Inventor: Yan Zheng , Michael Yeh , Junpeng Wang , Wei Zhang , Liang Wang , Hao Yang , Prince Osei Aboagye
- Applicant: Visa International Service Association
- Applicant Address: US CA San Francisco
- Assignee: Visa International Service Association
- Current Assignee: Visa International Service Association
- Current Assignee Address: US CA San Francisco
- Agency: The Webb Law Firm
- International Application: PCT/US2022/030813 2022.05.25
- International Announcement: WO2022/251282A 2022.12.01
- Date entered country: 2023-01-24
- Main IPC: G06F5/01
- IPC: G06F5/01 ; G06F40/40 ; G06F17/16

Abstract:
Provided is a method for normalizing embeddings for cross-embedding alignment. The method may include applying mean centering to the at least one embedding set, applying spectral normalization to the at least one embedding set, and/or applying length normalization to the at least one embedding set. Spectral normalization may include decomposing the at least one embedding set, determining an average singular value of the at least one embedding set, determining a respective substitute singular value for each respective singular value of a diagonal matrix, and/or replacing the at least one embedding set with a product of the at least one embedding set, a right singular vector, and an inverse of the substitute diagonal matrix. The mean centering, spectral normalization, and/or length normalization may be iteratively repeated for a configurable number of iterations. A system and computer program product are also disclosed.
Public/Granted literature
- US20230214177A1 Method, System, and Computer Program Product for Normalizing Embeddings for Cross-Embedding Alignment Public/Granted day:2023-07-06
Information query