17 Mar 2004
CS 3243 - Learning
36
Information gain
nA chosen attribute A divides the training set E into subsets E1, … , Ev according to their values for A, where A has v distinct values.
n
n
nInformation Gain (IG) or reduction in entropy from the attribute test:
n
n
nChoose the attribute with the largest IG