Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
xmadai
/
Llama-3.1-405B-Instruct-xMADai-INT4
like
6
Follow
xMAD.ai
21
Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
4-bit precision
gptq
arxiv:
2407.10032
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-3.1-405B-Instruct-xMADai-INT4
Ctrl+K
Ctrl+K
4 contributors
History:
15 commits
Tianyi Zhang
Update README.md
051a9d7
verified
10 months ago
.gitattributes
Safe
1.52 kB
initial commit
11 months ago
README.md
Safe
3.97 kB
Update README.md
10 months ago
config.json
Safe
1.28 kB
Upload of AutoGPTQ quantized model
10 months ago
model.safetensors.index.json
Safe
283 kB
Upload of AutoGPTQ quantized model
10 months ago
model_000.safetensors
Safe
46.1 GB
LFS
Upload of AutoGPTQ quantized model
10 months ago
model_001.safetensors
Safe
46.5 GB
LFS
Upload of AutoGPTQ quantized model
10 months ago
model_002.safetensors
Safe
41.4 GB
LFS
Upload of AutoGPTQ quantized model
10 months ago
model_003.safetensors
Safe
41.7 GB
LFS
Upload of AutoGPTQ quantized model
10 months ago
model_004.safetensors
Safe
41.4 GB
LFS
Upload of AutoGPTQ quantized model
10 months ago
quantize_config.json
Safe
313 Bytes
Upload of AutoGPTQ quantized model
10 months ago
special_tokens_map.json
Safe
296 Bytes
Upload tokenizer
11 months ago
tokenizer.json
Safe
9.09 MB
Upload tokenizer
11 months ago
tokenizer_config.json
Safe
55.4 kB
Upload tokenizer
11 months ago