Quantized Models - a teknium Collection

teknium 's Collections

Quantized Models

Quantized Models

updated Nov 3, 2023

TheBloke/OpenHermes-2.5-Mistral-7B-GGUF

7B • Updated Nov 2, 2023 • 38.5k • 266
TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • 1B • Updated Nov 2, 2023 • 933 • 29
TheBloke/OpenHermes-2.5-Mistral-7B-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 7.63k • 21
bartowski/OpenHermes-2.5-Mistral-7B-exl2

Updated Nov 2, 2023 • 3 • 11