Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
SoraWatermarkRemover
Log In
Sign Up
RedHatAI
/
Meta-Llama-3.1-70B-Instruct-quantized.w8a8
like
21
Follow
Red Hat AI
1.59k
Text Generation
Transformers
Safetensors
8 languages
llama
int8
vllm
conversational
text-generation-inference
8-bit precision
compressed-tensors
arxiv:
2210.17323
License:
llama3.1
Model card
Files
Files and versions
xet
Community
3
Train
Deploy
Use this model
05c9eb7
Meta-Llama-3.1-70B-Instruct-quantized.w8a8
1.52 kB
3 contributors
History:
1 commit
alexmarques
initial commit
05c9eb7
verified
over 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
over 1 year ago