Edit Models filters

Model Tree

nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

47

Full-text search

Active filters: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 2, 2024 • 3

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_6.0bpw

Text Generation • Updated Dec 2, 2024 • 3

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 2, 2024 • 2

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_4.5bpw

Text Generation • Updated Dec 2, 2024 • 3

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_4.0bpw

Text Generation • Updated Dec 2, 2024 • 3

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_3.5bpw

Text Generation • Updated Dec 2, 2024 • 3

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_3.0bpw

Text Generation • Updated Dec 2, 2024 • 3

OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc

11B • Updated Apr 24 • 4

sandbox-ai/Llama-3.1-Tango-70b-bnb_4b

Text Generation • 37B • Updated Jan 3 • 607 • 3

cnfusion/Llama-3.1-Nemotron-70B-Instruct-HF-Q2-mlx

Text Generation • 7B • Updated Dec 16, 2024 • 6

backyardai/Llama-3.1-Nemotron-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 22, 2024 • 28

matatonic/Llama-3.1-Nemotron-70B-Instruct-HF-abliterated-6.5bpw-h8-exl2

Text Generation • Updated Jan 6 • 3

EliasOenal/Llama-3.1-Nemotron-70B-Instruct-W8A8-dynamic

Text Generation • 71B • Updated Feb 12 • 5

medmekk/Llama-3.1-Nemotron-70B-Instruct-HF-bnb-4bit

Text Generation • 36B • Updated Mar 19 • 9

featherless-ai-quants/nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • 71B • Updated Jun 3

surus-lat/Llama-3.1-Tango-70b-bnb_4b

Text Generation • 37B • Updated Jul 17 • 7

etsien/Llama-3.1-Nemotron-70B-Instruct-HF-GPTQ-W4A8

Text Generation • 71B • Updated 5 days ago • 4