Add unit tests for tokenizing non-unicode strings
Add unit tests for tokenizing non-unicode strings

wodim/cobe-ng,pteichman/cobe,LeMagnesium/cobe,DarkMio/cobe,LeMagnesium/cobe,wodim/cobe-ng,DarkMio/cobe,meska/cobe,tiagochiavericosta/cobe,meska/cobe,pteichman/cobe,tiagochiavericosta/cobe