Invention Grant
- Patent Title: Language autodetection from non-character sub-token signals
-
Application No.: US17839330Application Date: 2022-06-13
-
Publication No.: US11630951B2Publication Date: 2023-04-18
- Inventor: Andrew Stuart Glass , Margaret Hope Magnus , Roland Radtke
- Applicant: Microsoft Technology Licensing, LLC
- Applicant Address: US WA Redmond
- Assignee: Microsoft Technology Licensing, LLC
- Current Assignee: Microsoft Technology Licensing, LLC
- Current Assignee Address: US WA Redmond
- Main IPC: G06F40/263
- IPC: G06F40/263

Abstract:
In non-limiting examples of the present disclosure, systems, methods and devices for determining a language of a text string are presented. A language detection model may be maintained. The language detection model may comprise identities and weights for initial and final consonants, identities and weights for prefixes and suffixes, and identities and weights for vowel sequences, where each identity is derived from a training corpus. The weights may correspond to a frequency of a text unit in the corpus. A text string may be received and a match score between the text string and the language of the language detection model may be determined. The match score may be based on initial and final consonant scores, prefix and suffix scores, and/or vowel sequence scores for each word in the text string. If the match score meets a threshold value a follow-up action associated with the language may be performed.
Public/Granted literature
- US20220309242A1 LANGUAGE AUTODETECTION FROM NON-CHARACTER SUB-TOKEN SIGNALS Public/Granted day:2022-09-29
Information query