Hypothesis spaces
How many distinct decision trees with n Boolean attributes?
= number of Boolean functions
= number of distinct truth tables with 2n rows = 22n
n E.g., with 6 Boolean attributes, there are
18,446,744,073,709,551,616 trees
How many purely conjunctive hypotheses (e.g., Hungry Rain)?
n Each attribute can be in (positive), in (negative), or out
     3n distinct conjunctive hypotheses
n More expressive hypothesis space
¡ increases chance that target function can be expressed
¡ increases number of hypotheses consistent with training set
     may get worse predictions