| Information
gain |
|
|
|
|
|
|
|
| n | A chosen
attribute A divides the training set E into |
|||||
| subsets E1,
… , Ev according to their values for A, |
||||||
| where A
has v distinct values. |
||||||
| n | Information Gain
(IG) or reduction in entropy from |
|||||
| the attribute
test: |
||||||
| n | Choose the
attribute with the largest IG |
|||||
