Quantized Models - a teknium Collection

teknium 's Collections

Quantized Models

Quantized Models

updated Nov 3, 2023

TheBloke/OpenHermes-2.5-Mistral-7B-GGUF

7B • Updated Nov 2, 2023 • 9.15k • 273
TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 102 • 29
TheBloke/OpenHermes-2.5-Mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 6.75k • 21
bartowski/OpenHermes-2.5-Mistral-7B-exl2

Updated Nov 2, 2023 • 11 • 11