Support whether to calculate effective number of tokens when applying the `batch_max_tokens`
Support whether to calculate effective number of tokens when applying the `batch_max_tokens`

hankcs/HanLP,hankcs/HanLP