changed tokenization to not assume tokens are separated by whitespace; tweaked regex documentation
changed tokenization to not assume tokens are separated by whitespace; tweaked regex documentation

calebsmith/sebastian,jtauber/sebastian