Hugging Face's logo

Darkhn
/
M3.2-24B-Animus-V6-Exp-GGUF

GGUF
llama.cpp
bf16
Model card Files
xet
Community

Send me your support to help me feed the data beast! also taking comissions for universe specific models

model is an experiment not even a full epoch (0.8), it seems bad to me (for some reason it likes to generate smut, going back to 64 lora rank)

Downloads last month
185
GGUF
Model size
23.6B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Darkhn/M3.2-24B-Animus-V6-Exp-GGUF

Base model

Darkhn/M3.2-24B-Animus-V6-Exp
Quantized
(1)
this model

Collection including Darkhn/M3.2-24B-Animus-V6-Exp-GGUF