Meta-Llama-3.1-Quantized - a fsaudm Collection

fsaudm 's Collections

Meta-Llama-3.1-Quantized

Meta-Llama-3.1-Quantized

updated Aug 28, 2024

Collection of quantized Llama 3.1 models (8B & 70B versions for now), using bitsandbites.

fsaudm/Meta-Llama-3.1-8B-Instruct-NF4

Text Generation • 8B • Updated Sep 27, 2024 • 9
fsaudm/Meta-Llama-3.1-70B-Instruct-NF4

Text Generation • 73B • Updated Oct 5, 2024 • 9
fsaudm/Meta-Llama-3.1-8B-Instruct-INT8

Text Generation • 8B • Updated Aug 21, 2024 • 4
fsaudm/Meta-Llama-3.1-70B-Instruct-INT8

Text Generation • 71B • Updated Aug 21, 2024 • 32