Hugging Face's logo

Darkhn
/
M3.2-36B-Animus-V8.0-GGUF

GGUF
llama.cpp
q2-k
Model card Files
xet
Community

M3.2-36B-Animus-V8.0-GGUF

GGUF model files for M3.2-36B-Animus-V8.0.

This repository contains GGUF models quantized using llama.cpp.

  • Base Model: M3.2-36B-Animus-V8.0
  • Quantization Methods Processed in this Job: Q8_0, Q6_K, Q5_K_M, Q5_0, Q5_K_S, Q4_K_M, Q4_K_S, Q4_0, Q3_K_L, Q3_K_M, Q3_K_S, Q2_K
  • Importance Matrix Used: No

This specific upload is for the Q2_K quantization.

Downloads last month
3,932
GGUF
Model size
34.7B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including Darkhn/M3.2-36B-Animus-V8.0-GGUF