Support suffix arrays that are fewer than 8 bytes per token if we don't need that many
Support suffix arrays that are fewer than 8 bytes per token if we don't need that many

google-research/deduplicate-text-datasets,google-research/deduplicate-text-datasets,google-research/deduplicate-text-datasets