Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

53

Base only

Active filters: OpenArc

Echo9Zulu/Cydonia-24B-v2.1-int4_asym-awq-wqe-se-ov

Text Generation • Updated Mar 28, 2025 • 11

Echo9Zulu/gemma-3-4b-it-int8_asym-ov

Image-Text-to-Text • Updated Apr 13, 2025 • 17 • 1

Echo9Zulu/gemma-3-12b-it-int4_asym-ov

Image-Text-to-Text • Updated Apr 12, 2025 • 14 • 1

Echo9Zulu/gemma-3-12b-it-int8_asym-ov

Image-Text-to-Text • Updated Apr 12, 2025 • 13 • 1

Echo9Zulu/The-Omega-Abomination-Gemma3-12B-v1.0-nf4-ov

Updated Apr 16, 2025 • 8

Echo9Zulu/gemma-3-4b-it-qat-int4_asym-ov

Image-Text-to-Text • Updated Apr 18, 2025 • 11 • 3

Echo9Zulu/Qwen3-8B-nf4-wqe-awq-se-ov

Text Generation • Updated Apr 30, 2025 • 10

Echo9Zulu/Qwen3-14B-int4_sym-ov

Text Generation • Updated Apr 30, 2025 • 29 • 1

Echo9Zulu/Qwen3-14B-nf4_sym-ov

Text Generation • Updated Apr 30, 2025 • 12

Echo9Zulu/Qwen3-1.7B-int8_asym-ov

Text Generation • Updated Apr 30, 2025 • 22

Echo9Zulu/Qwen3-0.6B-fp16-ov

Text Generation • Updated Apr 30, 2025 • 10

Echo9Zulu/Phi-4-mini-instruct-OpenVINO

Text Generation • Updated May 20, 2025 • 1

Echo9Zulu/gemma-3-4b-it-OpenVINO

Image-Text-to-Text • Updated May 20, 2025

Echo9Zulu/gemma-3-12b-it-OpenVINO

Image-Text-to-Text • Updated May 20, 2025 • 1

Echo9Zulu/DeepSeek-R1-0528-Qwen3-8B-OpenVINO

Text Generation • Updated May 29, 2025 • 4

Echo9Zulu/Mistral-NeMo-Minitron-8B-Instruct-OpenVINO

Updated Jun 12, 2025 • 1

Echo9Zulu/Phi-lthy4-OpenVINO

Updated Jun 13, 2025

Echo9Zulu/Hermes-4-70B-int4_asym-ov

Text Generation • Updated Aug 26, 2025 • 8

Echo9Zulu/Hermes-4-70B-int4_asym-awq-ov

Text Generation • Updated Aug 29, 2025 • 6

Echo9Zulu/Kokoro-82M-FP16-OpenVINO

Text-to-Speech • Updated Sep 21, 2025 • 63 • 7

Echo9Zulu/Magistral-Small-2509-Text-Only-int4_asym-awq-ov

Updated Oct 3, 2025 • 5

Echo9Zulu/Qwen3-4B-Instruct-2507-int4_asym-awq-ov

Updated Oct 3, 2025 • 13

Echo9Zulu/Qwen3-Embedding-0.6B-int8_asym-ov

Updated Oct 12, 2025 • 8

Echo9Zulu/Dolphin-X1-8B-int4_asym-awq-ov

Text Generation • Updated Oct 14, 2025 • 9

Gapeleon/Satyr-V0.1-4B-HF-int4_awq-ov

Updated Oct 15, 2025 • 8 • 2

Echo9Zulu/Impish_Nemo_12B-int4_asym-awq-ov

Updated Oct 19, 2025 • 6

Echo9Zulu/Qwen2.5-Microsoft-NextCoder-Soar-Instruct-FUSED-CODER-Fast-11B-int4_asym-awq-ov

Updated Oct 24, 2025 • 7

Echo9Zulu/Cydonia-24B-v4.2.0-int4_asym-awq-ov

Updated Oct 24, 2025 • 7 • 1

Echo9Zulu/Muse-12B-int4_asym-ov

Updated Nov 8, 2025 • 5

Echo9Zulu/gpt-oss-7.2b-specialized-science-pruned-moe-only-9-experts-int4_asym-ov

Updated Jan 4 • 10 • 1