Invention Grant
- Patent Title: Mutual information with absolute dependency for feature selection in machine learning models
-
Application No.: US14230222Application Date: 2014-03-31
-
Publication No.: US10832158B2Publication Date: 2020-11-10
- Inventor: Yifang Liu
- Applicant: Google LLC
- Applicant Address: US CA Mountain View
- Assignee: Google LLC
- Current Assignee: Google LLC
- Current Assignee Address: US CA Mountain View
- Agency: Fish & Richardson P.C.
- Main IPC: G06N20/00
- IPC: G06N20/00 ; G06N7/00

Abstract:
Systems and techniques are provided for determining mutual information with absolute dependency for feature selection. Items may be received from a dataset. Each item may include two random variables. A first random variable may be associated with a first range of discrete values, and a second random variable may be associated with a second range of discrete values. Mutual information between the two random variables may be determined according to one of: I ( X , Y ) = ∑ x ∈ X ∑ y ∈ Y p ( x , y ) · log ( p ( x , y ) p ( x ) · p ( y ) ) and I ( X , Y ) = ∑ x ∈ X ∑ y ∈ Y p ( y ) · log ( p ( x , y ) p ( x ) · p ( y ) ) , I(X,Y) may be the mutual information between X and Y, x may be a value for X, y may be a value for Y, p(x,y) may be a joint probability distribution function of x and y, p(x) may be a marginal probability distribution function of x, and p(y) may be a marginal probability distribution function of y. The mutual information may be used in a machine learning system to predict a value for one of the random variables for an item for which the value is unknown.
Public/Granted literature
- US20150278703A1 MUTUAL INFORMATION WITH ABSOLUTE DEPENDENCY FOR FEATURE SELECTION IN MACHINE LEARNING MODELS Public/Granted day:2015-10-01
Information query