Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

105

Full-text search

Active filters: compsci

mradermacher/Llama3.1-70B-PlumChat-GGUF

71B • Updated Nov 19, 2024 • 133

mradermacher/Llama3.1-70B-PlumChat-i1-GGUF

71B • Updated Nov 19, 2024 • 498

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_S-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 8

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 8

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 13

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 20

Triangle104/Llama3.2-3B-ShiningValiant2-Q6_K-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 12

Triangle104/Llama3.2-3B-ShiningValiant2-Q8_0-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 16

Triangle104/Llama3.1-8B-ShiningValiant2-Q4_K_S-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 5 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q4_K_M-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 11 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 4 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 15 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q6_K-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 13 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q8_0-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 6 • 1

Triangle104/Llama3.1-8B-PlumMath-Q4_K_S-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 9

Triangle104/Llama3.1-8B-PlumMath-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 11

Triangle104/Llama3.1-8B-PlumMath-Q5_K_S-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 12

Triangle104/Llama3.1-8B-PlumMath-Q6_K-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 13

Triangle104/Llama3.1-8B-PlumMath-Q5_K_M-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 8

Triangle104/Llama3.1-8B-PlumMath-Q8_0-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 13

Triangle104/Llama3.1-8B-PlumCode-Q4_K_S-GGUF

8B • Updated Jan 18 • 25

Triangle104/Llama3.1-8B-PlumCode-Q4_K_M-GGUF

8B • Updated Jan 18 • 29

Triangle104/Llama3.1-8B-PlumCode-Q5_K_S-GGUF

8B • Updated Jan 18 • 28

Triangle104/Llama3.1-8B-PlumCode-Q5_K_M-GGUF

8B • Updated Jan 18 • 24

Triangle104/Llama3.1-8B-PlumCode-Q6_K-GGUF

8B • Updated Jan 18 • 22

Triangle104/Llama3.1-8B-PlumCode-Q8_0-GGUF

8B • Updated Jan 18 • 14

ValiantLabs/Qwen3-8B-ShiningValiant3

Text Generation • 8B • Updated 1 day ago • 69 • 3

mradermacher/Qwen3-8B-ShiningValiant3-GGUF

8B • Updated Jul 8 • 642 • 2

Triangle104/Qwen3-8B-ShiningValiant3-Q4_K_S-GGUF

Text Generation • 8B • Updated Jul 8 • 23

Triangle104/Qwen3-8B-ShiningValiant3-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 8 • 13