MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF Text Generation • 71B • Updated Jul 29, 2024 • 155k • 39
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit Text Generation • 37B • Updated Nov 22, 2024 • 3.25k • 31
legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF Text Generation • 71B • Updated Jul 27, 2024 • 472 • 11
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic Text Generation • 71B • Updated Oct 19, 2024 • 1.3k • 7
lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF Text Generation • 71B • Updated Jul 28, 2024 • 596 • 36
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • 19B • Updated Oct 9, 2024 • 873 • 5
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated Feb 11 • 16.4k • 21
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • 11B • Updated Feb 12 • 11.7k • 32