Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • VoxCPM

  • Log In
  • Sign Up

InterwebAlchemy
/
PGNTokenizer

chess
pgn
tokenizer
Model card Files Files and versions
xet
Community
PGNTokenizer
266 kB
  • 1 contributor
History: 4 commits
InterwebAlchemy's picture
InterwebAlchemy
Switch from NFD -> NFC
0dcea10 verified 7 months ago
  • .gitattributes
    1.52 kB
    initial commit 8 months ago
  • README.md
    433 Bytes
    Update README.md 8 months ago
  • special_tokens_map.json
    3 Bytes
    Upload tokenizer 8 months ago
  • tokenizer.json
    263 kB
    Switch from NFD -> NFC 7 months ago
  • tokenizer_config.json
    887 Bytes
    Upload tokenizer 8 months ago