Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • VoxCPM

  • Log In
  • Sign Up

dustalov
/
wikitext-wordlevel

English
tokenizers
tokenizer
wordlevel
wikitext
Model card Files Files and versions
xet
Community
wikitext-wordlevel
1.81 MB
  • 1 contributor
History: 3 commits
dustalov's picture
dustalov
Rename wikitext-wordlevel.json to tokenizer.json
ecd8ec6 verified over 1 year ago
  • .gitattributes
    1.52 kB
    initial commit over 1 year ago
  • README.md
    30 Bytes
    initial commit over 1 year ago
  • tokenizer.json
    1.81 MB
    Rename wikitext-wordlevel.json to tokenizer.json over 1 year ago