17 Mar 2004
CS 3243 - Learning
35
Using information theory
nTo implement Choose-Attribute in the DTL
algorithm
nEntropy:
nI(P(v1), … , P(vn)) = Σi=1 -P(vi) log2 P(vi)
nFor a training set
containing p positive examples
and n negative examples:
n
