Added some feature squeezing and extra tokenization step to deal with not-so-preprocessed text as input
Added some feature squeezing and extra tokenization step to deal with not-so-preprocessed text as input

liyazhe/AML-Project2,pippobaudos/samr,rafacarrascosa/samr