14 Apr 2005
CS 3243 - Revision
40
Training and testing
¡Judge induced h()’s quality by using a test set
¡Training and test set must be separate; otherwise peeking occurs
¡Modeling noise or specifics of the training data can lead to overfitting
lUse pruning to remove parts of the hypothesis that aren’t justifiable