RedHatAI
/

granite-3.1-8b-instruct-quantized.w4a16

Text Generation

compressed-tensors

Model card Files Files and versions

robgreenberg3 commited on 3 days ago

Commit

91db795

·

verified ·

1 Parent(s): b283db3

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -39,6 +39,7 @@ license_link: https://www.apache.org/licenses/LICENSE-2.0
   - **Activation quantization:** INT4
 - **Release Date:** 1/8/2025
 - **Version:** 1.0
 - **Model Developers:** Neural Magic
 Quantized version of [ibm-granite/granite-3.1-8b-instruct](https://huggingface.co/ibm-granite/granite-3.1-8b-instruct).

   - **Activation quantization:** INT4
 - **Release Date:** 1/8/2025
 - **Version:** 1.0
+- **Validated on:** RHOAI 2.20, RHAIIS 3.0, RHELAI 1.5
 - **Model Developers:** Neural Magic
 Quantized version of [ibm-granite/granite-3.1-8b-instruct](https://huggingface.co/ibm-granite/granite-3.1-8b-instruct).