Invention Grant
- Patent Title: Multi-lingual code generation with zero-shot inference
-
Application No.: US17978627Application Date: 2022-11-01
-
Publication No.: US11693630B2Publication Date: 2023-07-04
- Inventor: Colin Bruce Clement , Shuai Lu , Neelakantan Sundaresan , Alexey Svyatkovskiy , Duyu Tang
- Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC.
- Applicant Address: US WA Redmond
- Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC.
- Current Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC.
- Current Assignee Address: US WA Redmond
- Main IPC: G06F8/33
- IPC: G06F8/33 ; G06F8/41 ; G06N3/088 ; G06F18/211 ; G06F18/213

Abstract:
A neural transformer model with attention is trained to predict candidates to complete a line of source code with a zero-inference capability. The model is trained on an unsupervised training dataset that includes features from source code written in multiple programming languages. The features include a file-level context and a local context, where the file-level context includes a global context, a class context, a function context, and/or a method context for each class, function and/or method of the source code programs used in the training dataset. The local context includes method bodies, function bodies, and/or stand-alone code of main method routines. From these features, the model is able to learn to predict an ordered sequence of code elements that complete a line of source code in a programming language seen and not seen during training.
Public/Granted literature
- US20230048186A1 MULTI-LINGUAL CODE GENERATION WITH ZERO-SHOT INFERENCE Public/Granted day:2023-02-16
Information query