-
公开(公告)号:WO2021247764A1
公开(公告)日:2021-12-09
申请号:PCT/US2021/035532
申请日:2021-06-02
Applicant: QUALCOMM INCORPORATED
Inventor: BHALGAT, Yash Sanjay , PORIKLI, Fatih Murat , LIN, Jamie Menjay
IPC: G06N3/04 , G06N3/08 , G06N3/063 , G06F17/153 , G06F17/16 , G06N3/0454
Abstract: Certain aspects of the present disclosure provide techniques for performing machine learning, including generating a set of basis masks for a convolution layer of a machine learning model, wherein each basis mask comprises a binary mask; determining a set of scaling factors, wherein each scaling factor of the set of scaling factors corresponds to a basis mask in the set of basis masks; generating a composite kernel based on the set of basis masks and the set of scaling factors; and performing a convolution operation based on the composite kernel.
-
公开(公告)号:WO2022198210A1
公开(公告)日:2022-09-22
申请号:PCT/US2022/071171
申请日:2022-03-15
Applicant: QUALCOMM INCORPORATED
Inventor: YANG, John , BHALGAT, Yash Sanjay , PORIKLI, Fatih Murat , CHANG, Simyung
Abstract: Certain aspects of the present disclosure provide a method, including: processing input data with a feature extraction stage of a machine learning model to generate a feature map; applying an attention map to the feature map to generate an augmented feature map; processing the augmented feature map with a refinement stage of the machine learning model to generate a refined feature map; processing the refined feature map with a first regression stage of the machine learning model to generate multi-dimensional task output data; and processing the refined feature data with an attention stage of the machine learning model to generate an updated attention map.
-
公开(公告)号:WO2021072338A1
公开(公告)日:2021-04-15
申请号:PCT/US2020/055167
申请日:2020-10-10
Applicant: QUALCOMM INCORPORATED
Inventor: AZARIAN YAZDI, Kambiz , BLANKEVOORT, Tijmen Pieter Frederik , LEE, Jin Won , BHALGAT, Yash Sanjay
Abstract: A method for pruning weights of an artificial neural network based on a learned threshold includes determining a pruning threshold for pruning a first set of pre-trained weights of multiple pre-trained weights based on a function of a classification loss and a regularization loss. The first set of pre-trained weights is pruned in response to a first value of each pre-trained weight in the first set of pre-trained weights being greater than the pruning threshold. A second set of pre-trained weights of the multiple pre-trained weights is fine-tuned or adjusted in response to a second value of each pre-trained weight in the second set of pre-trained weights being greater than the pruning threshold.
-
公开(公告)号:WO2022256814A1
公开(公告)日:2022-12-08
申请号:PCT/US2022/072709
申请日:2022-06-02
Applicant: QUALCOMM INCORPORATED
Inventor: LIN, Jamie Menjay , BHALGAT, Yash Sanjay , PARK, Edwin Chongwoo
Abstract: Certain aspects of the present disclosure provide techniques for kernel expansion. An input data tensor is received at a first layer in a neural network, and a first convolution is performed for a first kernel, where the first kernel has a size greater than a preferred size. Performing the first convolution comprises generating a plurality of intermediate tensors by performing a plurality of intermediate convolutions using a plurality of intermediate kernels with a size of the preferred size, and accumulating the plurality of intermediate tensors to generate an output tensor for the first convolution.
-
公开(公告)号:WO2022170085A1
公开(公告)日:2022-08-11
申请号:PCT/US2022/015298
申请日:2022-02-04
Applicant: QUALCOMM INCORPORATED
Inventor: AZARIAN YAZDI, Kambiz , BLANKEVOORT, Tijmen Pieter Frederik , LEE, Jin Won , BHALGAT, Yash Sanjay
Abstract: A method for pruning weights of an artificial neural network based on a learned threshold includes designating a group of pre-trained weights of an artificial neural network to be evaluated for pruning. The method also includes determining a norm of the group of pre-trained weights, and performing a process based on the norm to determine whether to prune the entire group of pre-trained weights.
-
公开(公告)号:EP4405855A1
公开(公告)日:2024-07-31
申请号:EP22777151.6
申请日:2022-08-25
Applicant: QUALCOMM INCORPORATED
Inventor: LIN, Jamie Menjay , BHALGAT, Yash Sanjay , PORIKLI, Fatih Murat
CPC classification number: G06N3/063 , G06N3/084 , G06N3/048 , G06N3/0464 , G06N3/09
-
公开(公告)号:WO2023049596A1
公开(公告)日:2023-03-30
申请号:PCT/US2022/075460
申请日:2022-08-25
Applicant: QUALCOMM INCORPORATED
Inventor: LIN, Jamie Menjay , BHALGAT, Yash Sanjay , PORIKLI, Fatih Murat
Abstract: Certain aspects of the present disclosure provide techniques for using shaped convolution kernels, comprising: receiving an input data patch, and processing the input data patch with a shaped kernel to generate convolution output.
-
公开(公告)号:WO2022174207A1
公开(公告)日:2022-08-18
申请号:PCT/US2022/070241
申请日:2022-01-18
Applicant: QUALCOMM INCORPORATED
Inventor: BHALGAT, Yash Sanjay , LEE, Jin Won , LIN, Jamie Menjay , PORIKLI, Fatih Murat , PATEL, Chirag Sureshbhai
IPC: G06N3/08
Abstract: Certain aspects of the present disclosure provide techniques for improved machine learning using gradient pruning, comprising computing, using a first batch of training data, a first gradient tensor comprising a gradient for each parameter of a parameter tensor for a machine learning model; identifying a first subset of gradients in the first gradient tensor based on a first gradient criteria; and updating a first subset of parameters in the parameter tensor based on the first subset of gradients in the first gradient tensor.
-
公开(公告)号:EP4292019A1
公开(公告)日:2023-12-20
申请号:EP22704248.8
申请日:2022-01-18
Applicant: QUALCOMM INCORPORATED
Inventor: BHALGAT, Yash Sanjay , LEE, Jin Won , LIN, Jamie Menjay , PORIKLI, Fatih Murat , PATEL, Chirag Sureshbhai
IPC: G06N3/08
-
公开(公告)号:EP4042333A1
公开(公告)日:2022-08-17
申请号:EP20800455.6
申请日:2020-10-10
Applicant: QUALCOMM INCORPORATED
-
-
-
-
-
-
-
-
-