A newer version of this model is available: Lewdiculous/CaptainErisNebula-12B-Chimera-v1.1-GGUF-IQ-Imatrix

GGUF quants for testing at the moment. Thank you, "mad scientist" Nitral-AI!

This model has potential! Not chaotic, and at the ideal size for most people.

Doesn't show excessive alignment – note that my initial testing had a relatively permissive prompt and focused on NSFW scenarios, so you should also try to guide it to your needs – so it should be good for any scenarios/writing situations.

Downloads last month: 4,055

GGUF

Model size

12.2B params

Architecture

llama

Hardware compatibility

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

View +1 variant

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Lewdiculous/CaptainErisNebula-12B-AOE-v1-GGUF-IQ-Imatrix

Base model

Nitral-Archive/CaptainErisNebula-12B-AOE-v0.69

Finetuned

Nitral-AI/CaptainErisNebula-12B-AOE-v1

Quantized

(1)

this model

Collection including Lewdiculous/CaptainErisNebula-12B-AOE-v1-GGUF-IQ-Imatrix

Quantized Models (GGUF, IQ, Imatrix)

Collection

Various GGUF quantizations of small models. Models with a "checkmark" are personal favorites. An "orange arrow" means it's being uploaded. • 98 items • Updated about 16 hours ago • 63