Hugging Face's logo

RedHatAI
/
Meta-Llama-3.1-405B-Instruct-FP8

Text Generation
Transformers
Safetensors
llama
fp8
vllm
conversational
text-generation-inference
compressed-tensors
Model card Files
xet
Community
2
Meta-Llama-3.1-405B-Instruct-FP8
410 GB
  • 4 contributors
 History: 30 commits
mgoin's picture
mgoin
Updated compression_config to quantization_config
ca6a401 verified