Hugging Face's logo

RedHatAI
/
Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation
Transformers
Safetensors
llama
facebook
meta
llama-3
int4
vllm
chat
neuralmagic
llmcompressor
conversational
4-bit precision
gptq
compressed-tensors
text-generation-inference
4-bit precision
Model card Files
xet
Community
4
robgreenberg3 commited on
Commit
3921b6a
·
verified ·
1 Parent(s): 104f2d8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -34,6 +34,10 @@ tasks:
34
  - text-to-text
35
  provider: Meta
36
  license_link: https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/LICENSE
 
 
 
 
37
  ---
38
  <h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">
39
  Meta-Llama-3.1-8B-Instruct-quantized.w4a16
 
34
  - text-to-text
35
  provider: Meta
36
  license_link: https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/LICENSE
37
+ validated_on:
38
+ - RHOAI 2.20
39
+ - RHAIIS 3.0
40
+ - RHELAI 1.5
41
  ---
42
  <h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">
43
  Meta-Llama-3.1-8B-Instruct-quantized.w4a16