llama.ccp support & GGUFs

#15
by Substance455 - opened

this is me looking for GGUFs to use on my ai wife

A5PSdolXhW.png

"Use on"? Like using the quantized model as a disciplinary implement, or what? Please elaborate.

GGUFs are optimized and compressed models for chat bots, which could be proxied to websites like jantorai or tavernai.

You're absolutely right!

WHY?

This model is worse than Qwen 30B A3B

WHY?

This model is worse than Qwen 30B A3B

i wish my computer was beefy enough to host 30B :(

and it will host Grok-2?

WHY?

This model is worse than Qwen 30B A3B

Why do you still believe in benchmarks in 2025?

WHY?

This model is worse than Qwen 30B A3B

Why do you still believe in benchmarks in 2025?

LOL, omega lul. Its not about benchmarks, it like in 2025 using llama 2 70B.

Sign up or log in to comment