Add a preprocessor script that does n-gram expansion based on either POS tags or words. For every expansion we start with a word unigram, and then try to extend to a part of speech tag or a word.
Add a preprocessor script that does n-gram expansion based on either
POS tags or words. For every expansion we start with a word unigram,
and then try to extend to a part of speech tag or a word.

This is here just for experimentation and to get a feeling for the
expansion (and variations thereof).


git-svn-id: 32ba8059fceb065088d774c95c05b3faeef81197@13728 ec612bfc-cd47-4aa5-b870-24b09f3dd185

rug-compling/errormining,rug-compling/errormining