26 Oct 2004
CS 5244: DL Extended Services
21
Bayes
Theorem on function words
ˇM & W examined the
frequency of 100 function words
ˇSmoothed
these frequencies using negative binomial (not Poisson) distribution
ˇUsed Bayes’ theorem and
linear regression to find weights
to fit for observed data
ˇSample words:
as do has is no or than this
at down have it
not our that to
be even her its now shall the up
.184
.0758
2
.368
.303
1
.368
.607
0
Madison
Hamilton
Frequency