use a list to hold a tokenizer output
use a list to hold a tokenizer output

using this module on Python built with --with-pydebug can crash
the interpreter. to avoid the crash, use a list instead of a generator.
it can increase memory usage at a moment.

(not verified) It seems a generator and/or objects referred from
the generator are garbage collected.

hideaki-t/sqlite-fts-python