Alkohole/T-pro-it-1.0-4.5bpw-h8-exl2
Updated
•
4
Libretto Lab
Alkohole
AI & ML interests
TTS
Recent Activity
reacted
to
danielhanchen's
post
with ❤️
about 14 hours ago
Run DeepSeek-V3.1 locally on 170GB RAM with Dynamic 1-bit GGUFs!🐋
GGUFs: https://huggingface.co/unsloth/DeepSeek-V3.1-GGUF
The 715GB model gets reduced to 170GB (-80% size) by smartly quantizing layers.
The 1-bit GGUF passes all our code tests & we fixed the chat template for llama.cpp supported backends.
Guide: https://docs.unsloth.ai/basics/deepseek-v3.1
new activity
about 15 hours ago
Jinx-org/Jinx-gpt-oss-20b:reasoning_effort
new activity
about 15 hours ago
Jinx-org/Jinx-gpt-oss-20b:Great work!
Organizations
None yet
datasets
0
None public yet