Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

79

Base only

Active filters: OpenVINO

Echo9Zulu/Qwen3-ASR-0.6B-INT8_ASYM-OpenVINO

Updated Feb 18 • 42 • 5

Siris/openjourney-openvino-model

Updated May 29, 2023

yujiepan/mpt-7b-gsm8k-dummy

Text Generation • Updated Feb 4, 2024 • 1

rupeshs/sdxs-512-0.9-openvino

Text-to-Image • Updated Jun 10, 2024 • 394 • 2

nsbendre25/llama-3-8B-Instruct-ov-fp16-int4-sym

Text Generation • Updated Apr 30, 2024 • 7 • 1

nsbendre25/Phi-3-mini-128k-instruct-ov-fp16-int4-asym

Text Generation • Updated Apr 30, 2024 • 9

nsbendre25/llama-3-70B-Instruct-ov-fp16-int4-asym

Text Generation • Updated Apr 30, 2024 • 10

vuiseng9/ov-mpt-7b-gsm8k-sparse70

Text Generation • Updated Jun 25, 2024

rupeshs/FLUX.1-schnell-openvino-int4

Updated Aug 18, 2024 • 13

rupeshs/taef1-openvino

Text-to-Image • Updated May 4, 2025 • 4

juampahc/gliner_multi-v2.1-openvino

Token Classification • Updated Feb 12, 2025 • 6

FM-1976/ov_NuExtract-1.5-tiny

Text Generation • Updated Nov 29, 2024 • 9

FM-1976/ov_Llama-SmolTalk-3.2-1B-Instruct

Text Generation • Updated Nov 29, 2024 • 16

Echo9Zulu/gemma-3-4b-it-int8_asym-ov

Image-Text-to-Text • Updated Apr 13, 2025 • 21 • 1

Echo9Zulu/gemma-3-12b-it-int4_asym-ov

Image-Text-to-Text • Updated Apr 12, 2025 • 19 • 1

Echo9Zulu/gemma-3-12b-it-int8_asym-ov

Image-Text-to-Text • Updated Apr 12, 2025 • 13 • 1

Echo9Zulu/The-Omega-Abomination-Gemma3-12B-v1.0-nf4-ov

Updated Apr 16, 2025 • 9

Echo9Zulu/gemma-3-4b-it-qat-int4_asym-ov

Image-Text-to-Text • Updated Apr 18, 2025 • 17 • 3

Echo9Zulu/Qwen3-8B-nf4-wqe-awq-se-ov

Text Generation • Updated Apr 30, 2025 • 9

Echo9Zulu/Qwen3-14B-int4_sym-ov

Text Generation • Updated Apr 30, 2025 • 29 • 1

Echo9Zulu/Qwen3-14B-nf4_sym-ov

Text Generation • Updated Apr 30, 2025 • 12

Echo9Zulu/Qwen3-1.7B-int8_asym-ov

Text Generation • Updated Apr 30, 2025 • 23

Echo9Zulu/Qwen3-0.6B-fp16-ov

Text Generation • Updated Apr 30, 2025 • 9

Echo9Zulu/Qwen3-30B-A3B-int4_asym-hia-awq-gptq-se-ov

Updated May 8, 2025 • 12 • 1

Echo9Zulu/Phi-4-mini-instruct-OpenVINO

Text Generation • Updated May 20, 2025 • 1

Echo9Zulu/gemma-3-4b-it-OpenVINO

Image-Text-to-Text • Updated May 20, 2025

Echo9Zulu/gemma-3-12b-it-OpenVINO

Image-Text-to-Text • Updated May 20, 2025 • 1

Echo9Zulu/DeepSeek-R1-0528-Qwen3-8B-OpenVINO

Text Generation • Updated May 29, 2025 • 4

Echo9Zulu/Mistral-NeMo-Minitron-8B-Instruct-OpenVINO

Updated Jun 12, 2025 • 1

Echo9Zulu/Phi-lthy4-OpenVINO

Updated Jun 13, 2025