24 Mar 2004
CS 3243 - Revision
38
Training and testing
¡Judge induced h()’s quality by using a test set
¡Training and test set must be separate; otherwise peeking occurs
¡Modeling noise or specifics of the training data can lead to overfitting
lUse pruning to remove parts of the hypothesis that aren’t justifiable