Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
免费去水印
Log In
Sign Up
ArthaLabs
/
panini-tokenizer
like
0
Transformers
Sanskrit
sanskrit
tokenizer
nlp
morphology
linguistics
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
panini-tokenizer
6.78 MB
Ctrl+K
Ctrl+K
1 contributor
History:
12 commits
ArthaLabs
Upload src/splitter.py with huggingface_hub
e1cd59b
verified
3 months ago
src
Upload src/splitter.py with huggingface_hub
3 months ago
.gitattributes
Safe
1.52 kB
initial commit
3 months ago
BENCHMARKS.md
Safe
11.8 kB
Upload folder using huggingface_hub
3 months ago
README.md
Safe
3.74 kB
Upload folder using huggingface_hub
3 months ago
app.py
Safe
8.32 kB
Upload folder using huggingface_hub
3 months ago
requirements.txt
Safe
69 Bytes
Upload folder using huggingface_hub
3 months ago
special_tokens_map.json
Safe
180 Bytes
Upload folder using huggingface_hub
3 months ago
stems.json
Safe
3 MB
Upload folder using huggingface_hub
3 months ago
tokenizer_config.json
Safe
348 Bytes
Upload folder using huggingface_hub
3 months ago
tokenizer_hf.py
Safe
4.41 kB
Upload tokenizer_hf.py with huggingface_hub
3 months ago
vocab.json
Safe
3.64 MB
Upload folder using huggingface_hub
3 months ago
×
Free Tool
Free AI Image Generator
Create images in seconds. No sign-up, no paywall, no setup.
No Sign-Up
Instant Results
Ready to Use
Create Images Free
Great for posters, avatars, covers, and social visuals.
Free AI Image Generator
No sign-up. Instant results.
Open Now
