Only push fulltext tokens if they exceed minimum length
Only push fulltext tokens if they exceed minimum length

Doing this in C will be much faster than doing it in Ruby, and will save
memory to boot. This first step uses a hard-coded limit of three;
forthcoming is an override.

Signed-off-by: Wincent Colaiuta <c76ac2e9cd86441713c7dfae92c451f3e6d17fdc@wincent.com>

geni/wikitext,wincent/wikitext,geni/wikitext,wincent/wikitext,barnaclebarnes/wikitext,barnaclebarnes/wikitext,barnaclebarnes/wikitext,geni/wikitext