Removed premature optimization of using the regexp to decide when to tokenize.  We'll optimize when we have to, likely by making tokenize memoize.
Removed premature optimization of using the regexp to decide when to tokenize.  We'll optimize when we have to, likely by making tokenize memoize.

frumiousbandersnatch/supybot-code,ProgVal/Limnoria-test,haxwithaxe/supybot,jeffmahoney/supybot,ProgVal/Limnoria-test,raboof/supybot,Ban3/Limnoria,prashantpawar/supybot-rothbot,buildbot/supybot,mazaclub/mazabot-core,kblin/supybot-gsoc,mazaclub/mazabot-core,Ban3/Limnoria